2026-01-27 20:00:27 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-27 20:00:27 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-27 20:00:27 [ayvens.es] INFO: Starting spider ayvens.es
2026-01-27 20:00:27 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-27 20:00:27 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-27 20:00:27 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-27 20:00:27 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-27 20:00:27 [scrapy.extensions.telnet] INFO: Telnet Password: 789795876ede6e0e
2026-01-27 20:00:27 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-01-27 20:00:27 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.es/task_54_2026-01-27T20_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-27 20:00:27 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-27 20:00:27 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-27 20:00:27 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-27 20:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-27 20:00:27 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-27 20:00:27 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-01-27 20:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:00:27 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-27 20:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-27 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:27 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-01-27 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-01-27 20:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-27 20:00:27 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-27 20:00:27 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-27 20:00:27 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-27 20:00:27 [scrapy.core.engine] INFO: Spider opened
2026-01-27 20:00:27 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-27 20:00:28 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-01-27 20:00:28 [scrapy-playwright] INFO: Starting download handler
2026-01-27 20:00:28 [scrapy-playwright] INFO: Starting download handler
2026-01-27 20:00:32 [scrapy-playwright] INFO: Launching browser firefox
2026-01-27 20:00:33 [scrapy-playwright] INFO: Browser firefox launched
2026-01-27 20:00:33 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-01-27 20:00:35 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-01-27 20:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-01-27 20:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-01-27 20:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-01-27 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-01-27 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4QVFFAQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7YT6ABHA.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WFA2IVWG.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LVJXO4QX.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2N74OY7W.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KZOV2SQ2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-P3E7UHUI.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WE77U2QS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-O3OWKDIN.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WFA2IVWG.js>
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-3HJTOVT5.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-G7VKZLNV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-27 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-IOF7VMBJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4QVFFAQG.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7YT6ABHA.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2N74OY7W.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LVJXO4QX.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KZOV2SQ2.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-P3E7UHUI.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WE77U2QS.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PGNL7WWW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RQLFCBMH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-S5E5FHXZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGXSF4AK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5HD3KQV3.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FB6RKR5I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ALI5XYZJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LHCNJE3I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7C2GTJ24.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-O3OWKDIN.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CMYMW4RH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-276SS4TV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-J7KVSNWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OION63CA.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NO5FJ6IE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RJGQXDQB.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MADFXCQX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-3HJTOVT5.js>
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-57LOL62V.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JK3VA6V3.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ECZFIAAV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RWL6TUXQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-3ZRJENLY.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-35VRT2WM.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WJPXCSUZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-GWHLDUVT.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LYOOO25D.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7LLFTWQ2.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-G7VKZLNV.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-IOF7VMBJ.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PGNL7WWW.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RQLFCBMH.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-S5E5FHXZ.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FB6RKR5I.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5HD3KQV3.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ALI5XYZJ.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGXSF4AK.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LHCNJE3I.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7C2GTJ24.js>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-01-27 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-J7KVSNWE.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-276SS4TV.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CMYMW4RH.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OION63CA.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NO5FJ6IE.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RJGQXDQB.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MADFXCQX.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-57LOL62V.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JK3VA6V3.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ECZFIAAV.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RWL6TUXQ.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-3ZRJENLY.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-GWHLDUVT.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WJPXCSUZ.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-35VRT2WM.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7LLFTWQ2.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LYOOO25D.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HLMVA2XG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HLMVA2XG.js>
2026-01-27 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-J7WQD6B5.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HLMVA2XG.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-J7WQD6B5.js>
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7P3LAPEA.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-J7WQD6B5.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7P3LAPEA.js>
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6TCU7CUH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-TXAFC7UM.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MIPFLQ72.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-J7WQD6B5.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6TCU7CUH.js>
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RJDFUE4N.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPJAYUCB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-TXAFC7UM.js>
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MIPFLQ72.js>
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OIQIERBW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-UFB65P4A.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NTG4JAHX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7TECJER3.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-27 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RJDFUE4N.js>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPJAYUCB.js>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-UFB65P4A.js>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NTG4JAHX.js>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7TECJER3.js>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OIQIERBW.js>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K3XLXP2R.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HBBQKHO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-UFB65P4A.js)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HXFSIYAP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-TXAFC7UM.js)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QMSFYIWN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-TXAFC7UM.js)
2026-01-27 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K3XLXP2R.js>
2026-01-27 20:00:43 [ayvens.es] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'QT+lWwXn1Nd9woQCCh5AmQ|2026-01-27T20:00:41.505Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1801080041, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'FGp2eQzxRVvr3V5VDS2JZx|1769544043386|1769544043386', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1769545843, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-01-27 20:00:43 [ayvens.es] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'QT+lWwXn1Nd9woQCCh5AmQ|2026-01-27T20:00:41.505Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'FGp2eQzxRVvr3V5VDS2JZx|1769544043386|1769544043386', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-01-27 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-01-27 20:00:43 [ayvens.es] INFO: Intercepting token...
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-01-27 20:00:43 [ayvens.es] INFO: Scrolling element to trigger lazy load...
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QMSFYIWN.js>
2026-01-27 20:00:43 [ayvens.es] INFO: GraphQL headers: {'host': 'api.aldcarmarket.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'cross-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9QdGpxbi1jYy1FVTpLSks1eEVqSGtGek1GOFRBWEJoek1NckV5dFVYamZ1ZnhYQ0YzOFQ3ejMwNGo5TmtqRDJGNnhTdzdqNGRBdGFE', 'connection': 'keep-alive'}
2026-01-27 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MSBSCS6P.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api.aldcarmarket.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HBBQKHO4.js>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HXFSIYAP.js>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VZKIXU23.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HBBQKHO4.js)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EOYYGPOY.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HBBQKHO4.js)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MSBSCS6P.js>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-T4CT3E3U.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MSBSCS6P.js)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VZKIXU23.js>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6YCHXE2J.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EOYYGPOY.js>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/bell.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-T4CT3E3U.js>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LMJCIPKN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7TECJER3.js)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6YCHXE2J.js>
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-27 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/fr.svg>
2026-01-27 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/es.svg>
2026-01-27 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-01-27 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LMJCIPKN.js>
2026-01-27 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-01-27 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-27 20:00:45 [ayvens.es] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-01-27 20:00:45 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-01-27 20:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-27 20:00:47 [ayvens.es] INFO: Found listing with ID: 1875024
2026-01-27 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875024%27 HTTP/1.1" 200 None
2026-01-27 20:00:47 [ayvens.es] INFO: Scrape type for 1875024: 1
2026-01-27 20:00:47 [ayvens.es] INFO: Extracting data for car ID: 1875024
2026-01-27 20:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13 with identifier: 1875024
2026-01-27 20:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13 with scrape type 1
2026-01-27 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13
2026-01-27 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13
2026-01-27 20:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13, identifier: 1875024
2026-01-27 20:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13 with identifier: 1875024
2026-01-27 20:00:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13 with identifier: 1875024
2026-01-27 20:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13 with identifier: 1875024 to the API
2026-01-27 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-27 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.pipelines.post_to_api] ERROR: ayvens.es, item_id e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Tue, 27 Jan 2026 20:00:47 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-01-27 20:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e8a3f916-9e6f-51c8-a84a-ff82bb2b0f13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 109218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 1.2 8v 51kW (69CV) Lounge',
 'transmission': 'manual',
 'trim': '1.2 8v 51kW (69CV) Lounge',
 'vin': None,
 'year': 2017}
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875024%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Saving data for 1875024: {'created_time': 1769544048.088009, 'last_price_update_time': 1769544048.08802, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875024') HTTP/1.1" 204 0
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875025
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875025%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875025: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875025
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 with identifier: 1875025
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 30d8e0a4-53c7-5aca-9125-07e35fd2ade5
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F985%252F11587dac79bc4d3caadb84faa8e94955%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/985/11587dac79bc4d3caadb84faa8e94955/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875026
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875026%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875026: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875026
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 with identifier: 1875026
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252Ff2ab6fa77a75462ebd0fd4ad8ba47b9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/f2ab6fa77a75462ebd0fd4ad8ba47b9b/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875027
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875027%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875027: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875027
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a3be87-b47c-534f-ba52-0c3b774e0815 with identifier: 1875027
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a3be87-b47c-534f-ba52-0c3b774e0815 with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21a3be87-b47c-534f-ba52-0c3b774e0815
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F844%252Fb556c3c8d503474c9a3c07c890e19fd0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/844/b556c3c8d503474c9a3c07c890e19fd0/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875028
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875028%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875028: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875028
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a736b61d-04e2-5ef7-8295-11e49c70308b with identifier: 1875028
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a736b61d-04e2-5ef7-8295-11e49c70308b with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a736b61d-04e2-5ef7-8295-11e49c70308b
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F673%252Fbc37eb5eaf6548d88ca218cc4b6c8d14%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/673/bc37eb5eaf6548d88ca218cc4b6c8d14/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875029
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875029%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875029: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875029
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 474799ac-2fe5-5eba-924c-3061dc68bfeb with identifier: 1875029
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474799ac-2fe5-5eba-924c-3061dc68bfeb with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 474799ac-2fe5-5eba-924c-3061dc68bfeb
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F02bd2f0d0b97443a808219fd31a4c30d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/02bd2f0d0b97443a808219fd31a4c30d/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875030
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875030%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875030: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875030
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 with identifier: 1875030
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252F047a1dec4b7b454485c5b308d6ed488e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/047a1dec4b7b454485c5b308d6ed488e/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875031
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875031%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875031: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875031
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52746c71-02e7-57e8-a636-bc09d4ccc2f9 with identifier: 1875031
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52746c71-02e7-57e8-a636-bc09d4ccc2f9 with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 52746c71-02e7-57e8-a636-bc09d4ccc2f9
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F778%252Fc92c36fdfaa9465ab4d0c80e9a522d6a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/778/c92c36fdfaa9465ab4d0c80e9a522d6a/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875032
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875032%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875032: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875032
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 901a9f62-eb54-5e54-a39d-ba0c8754569b with identifier: 1875032
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901a9f62-eb54-5e54-a39d-ba0c8754569b with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 901a9f62-eb54-5e54-a39d-ba0c8754569b
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252F60971a7529cd4fde95bf15540ffdb174%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/60971a7529cd4fde95bf15540ffdb174/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875033
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875033%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875033: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875033
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82bbe6c-a153-58b2-98cc-b9bc17df95d7 with identifier: 1875033
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82bbe6c-a153-58b2-98cc-b9bc17df95d7 with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c82bbe6c-a153-58b2-98cc-b9bc17df95d7
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F94f989201654461da0d19ea8326932db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/94f989201654461da0d19ea8326932db/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875034
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875034%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875034: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875034
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20339578-0929-5f11-9fcb-4295aff3c4fa with identifier: 1875034
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20339578-0929-5f11-9fcb-4295aff3c4fa with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 20339578-0929-5f11-9fcb-4295aff3c4fa
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F074%252F149425e60ca947228ceab3129daf0f39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/074/149425e60ca947228ceab3129daf0f39/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875035
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875035%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875035: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875035
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d98b09bf-5440-52af-8e5b-b8f8293b675e with identifier: 1875035
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d98b09bf-5440-52af-8e5b-b8f8293b675e with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d98b09bf-5440-52af-8e5b-b8f8293b675e
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F591%252Ff9032409f21344189222220f16a0766f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/591/f9032409f21344189222220f16a0766f/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875036
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875036%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875036: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875036
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d4bff54-0714-51f4-acad-dc0220cdf7bc with identifier: 1875036
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d4bff54-0714-51f4-acad-dc0220cdf7bc with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8d4bff54-0714-51f4-acad-dc0220cdf7bc
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F738%252F85f9071fbfcc450ab95a230cfba3be01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/738/85f9071fbfcc450ab95a230cfba3be01/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875037
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875037%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875037: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875037
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10951fad-9f0c-5474-80e5-510ad22464bb with identifier: 1875037
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10951fad-9f0c-5474-80e5-510ad22464bb with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 10951fad-9f0c-5474-80e5-510ad22464bb
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252F9d5c6721807a47cf915487fbc419b45f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/9d5c6721807a47cf915487fbc419b45f/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875038
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875038%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875038: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875038
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73821dfe-a64f-5aec-bf88-5a7a108ebfbe with identifier: 1875038
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73821dfe-a64f-5aec-bf88-5a7a108ebfbe with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73821dfe-a64f-5aec-bf88-5a7a108ebfbe
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F116%252Fd0c48b8c3bfb47509603863991ce4cca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/116/d0c48b8c3bfb47509603863991ce4cca/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875039
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875039%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875039: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875039
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 855338b6-30b3-516d-8232-5b6c760c0af3 with identifier: 1875039
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 855338b6-30b3-516d-8232-5b6c760c0af3 with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 855338b6-30b3-516d-8232-5b6c760c0af3
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F63fef69f10f24d7b8a963d491795af11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/63fef69f10f24d7b8a963d491795af11/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875040
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875040%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875040: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875040
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df836029-26c1-53c4-9fdd-f48982147aca with identifier: 1875040
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df836029-26c1-53c4-9fdd-f48982147aca with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item df836029-26c1-53c4-9fdd-f48982147aca
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F720%252F4adb216bfb9e4f2f98582852c452640e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/720/4adb216bfb9e4f2f98582852c452640e/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875041
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875041%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875041: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875041
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6579074-acdb-50af-93ea-7737921c125f with identifier: 1875041
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6579074-acdb-50af-93ea-7737921c125f with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6579074-acdb-50af-93ea-7737921c125f
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F519%252F09bea7bf803a4717a222e2ea06e07883%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/519/09bea7bf803a4717a222e2ea06e07883/images/large/1.jpg not downloaded yet
2026-01-27 20:00:48 [ayvens.es] INFO: Found listing with ID: 1875042
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875042%27 HTTP/1.1" 200 None
2026-01-27 20:00:48 [ayvens.es] INFO: Scrape type for 1875042: 1
2026-01-27 20:00:48 [ayvens.es] INFO: Extracting data for car ID: 1875042
2026-01-27 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f36bddb-dbe5-5a92-a0bf-56e25850ac39 with identifier: 1875042
2026-01-27 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f36bddb-dbe5-5a92-a0bf-56e25850ac39 with scrape type 1
2026-01-27 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2f36bddb-dbe5-5a92-a0bf-56e25850ac39
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252F309df8edec7f402e8b59e298a7ea8900%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/309df8edec7f402e8b59e298a7ea8900/images/large/1.jpg not downloaded yet
2026-01-27 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/673/bc37eb5eaf6548d88ca218cc4b6c8d14/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:49 [ayvens.es] INFO: Found listing with ID: 1875043
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875043%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [ayvens.es] INFO: Scrape type for 1875043: 1
2026-01-27 20:00:49 [ayvens.es] INFO: Extracting data for car ID: 1875043
2026-01-27 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9225e28-c339-563d-9e9c-337e3d0aae65 with identifier: 1875043
2026-01-27 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9225e28-c339-563d-9e9c-337e3d0aae65 with scrape type 1
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9225e28-c339-563d-9e9c-337e3d0aae65
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F074%252F7c7399fee2b44cccbd555bdb421df597%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/074/7c7399fee2b44cccbd555bdb421df597/images/large/1.jpg not downloaded yet
2026-01-27 20:00:49 [ayvens.es] INFO: Found listing with ID: 1875044
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875044%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [ayvens.es] INFO: Scrape type for 1875044: 1
2026-01-27 20:00:49 [ayvens.es] INFO: Extracting data for car ID: 1875044
2026-01-27 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a0d771-b4e7-5652-8d78-4f76b6c553b9 with identifier: 1875044
2026-01-27 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a0d771-b4e7-5652-8d78-4f76b6c553b9 with scrape type 1
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 67a0d771-b4e7-5652-8d78-4f76b6c553b9
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252Ffab0a99eb7f24248b06d01003c159251%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/fab0a99eb7f24248b06d01003c159251/images/large/1.jpg not downloaded yet
2026-01-27 20:00:49 [ayvens.es] INFO: Found listing with ID: 1875045
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875045%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [ayvens.es] INFO: Scrape type for 1875045: 1
2026-01-27 20:00:49 [ayvens.es] INFO: Extracting data for car ID: 1875045
2026-01-27 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f with identifier: 1875045
2026-01-27 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f with scrape type 1
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F762%252F99ac287eb20c43d78c94fbf4510dd123%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/762/99ac287eb20c43d78c94fbf4510dd123/images/large/1.jpg not downloaded yet
2026-01-27 20:00:49 [ayvens.es] INFO: Found listing with ID: 1875046
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875046%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [ayvens.es] INFO: Scrape type for 1875046: 1
2026-01-27 20:00:49 [ayvens.es] INFO: Extracting data for car ID: 1875046
2026-01-27 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490ffc4c-c34d-5960-9b7c-1158d831774c with identifier: 1875046
2026-01-27 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490ffc4c-c34d-5960-9b7c-1158d831774c with scrape type 1
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 490ffc4c-c34d-5960-9b7c-1158d831774c
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F564%252F205fb9c038f547ba9e7001244a1ece40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/564/205fb9c038f547ba9e7001244a1ece40/images/large/1.jpg not downloaded yet
2026-01-27 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/810/047a1dec4b7b454485c5b308d6ed488e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a6cd50>
2026-01-27 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a736b61d-04e2-5ef7-8295-11e49c70308b/a736b61d-04e2-5ef7-8295-11e49c70308b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F673%252Fbc37eb5eaf6548d88ca218cc4b6c8d14%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/673/bc37eb5eaf6548d88ca218cc4b6c8d14/images/large/1.jpg saved to cache
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a736b61d-04e2-5ef7-8295-11e49c70308b
2026-01-27 20:00:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a736b61d-04e2-5ef7-8295-11e49c70308b, skipping ID generation
2026-01-27 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a736b61d-04e2-5ef7-8295-11e49c70308b with scrape type 1
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a736b61d-04e2-5ef7-8295-11e49c70308b from tracking dictionaries
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a736b61d-04e2-5ef7-8295-11e49c70308b sending to next pipeline
2026-01-27 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a736b61d-04e2-5ef7-8295-11e49c70308b, identifier: 1875028
2026-01-27 20:00:49 [ayvens.es] INFO: Found listing with ID: 1875047
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875047%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [ayvens.es] INFO: Scrape type for 1875047: 1
2026-01-27 20:00:49 [ayvens.es] INFO: Extracting data for car ID: 1875047
2026-01-27 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2477195e-f4bb-57d1-8001-d177b548f041 with identifier: 1875047
2026-01-27 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2477195e-f4bb-57d1-8001-d177b548f041 with scrape type 1
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2477195e-f4bb-57d1-8001-d177b548f041
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F513%252Fe19f65399d9c4d2c90b3c3e73c56e25d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/513/e19f65399d9c4d2c90b3c3e73c56e25d/images/large/1.jpg not downloaded yet
2026-01-27 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a736b61d-04e2-5ef7-8295-11e49c70308b with identifier: 1875028
2026-01-27 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a736b61d-04e2-5ef7-8295-11e49c70308b with identifier: 1875028
2026-01-27 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '3008', 'trim': '1.2 puretech 96kw (130cv) allure s&s', 'title': 'peugeot 3008 1.2 puretech 96kw (130cv) allure s&s', 'price': 0, 'odometer': 58796, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-20', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 120, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a736b61d-04e2-5ef7-8295-11e49c70308b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a736b61d-04e2-5ef7-8295-11e49c70308b/a736b61d-04e2-5ef7-8295-11e49c70308b_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/673/bc37eb5eaf6548d88ca218cc4b6c8d14/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 307976}], 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 58796}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'a736b61d-04e2-5ef7-8295-11e49c70308b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 58796,
     'odometer_in_km': 58796,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a736b61d-04e2-5ef7-8295-11e49c70308b/a736b61d-04e2-5ef7-8295-11e49c70308b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 307976,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/673/bc37eb5eaf6548d88ca218cc4b6c8d14/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-12-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech 96kw (130cv) allure s&s',
     'transmission': 'manual',
     'trim': '1.2 puretech 96kw (130cv) allure s&s',
     'vin': None,
     'year': 2018}
2026-01-27 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a736b61d-04e2-5ef7-8295-11e49c70308b spider: ayvens.es
2026-01-27 20:00:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: a736b61d-04e2-5ef7-8295-11e49c70308b due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '3008', 'trim': '1.2 puretech 96kw (130cv) allure s&s', 'title': 'peugeot 3008 1.2 puretech 96kw (130cv) allure s&s', 'price': 0, 'odometer': 58796, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-20', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 120, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a736b61d-04e2-5ef7-8295-11e49c70308b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a736b61d-04e2-5ef7-8295-11e49c70308b/a736b61d-04e2-5ef7-8295-11e49c70308b_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/673/bc37eb5eaf6548d88ca218cc4b6c8d14/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 307976}], 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 58796}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'a736b61d-04e2-5ef7-8295-11e49c70308b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 58796,
     'odometer_in_km': 58796,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a736b61d-04e2-5ef7-8295-11e49c70308b/a736b61d-04e2-5ef7-8295-11e49c70308b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 307976,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/673/bc37eb5eaf6548d88ca218cc4b6c8d14/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-12-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech 96kw (130cv) allure s&s',
     'transmission': 'manual',
     'trim': '1.2 puretech 96kw (130cv) allure s&s',
     'vin': None,
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a736b61d-04e2-5ef7-8295-11e49c70308b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 58796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a736b61d-04e2-5ef7-8295-11e49c70308b/a736b61d-04e2-5ef7-8295-11e49c70308b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/673/bc37eb5eaf6548d88ca218cc4b6c8d14/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW (130CV) ALLURE S&S',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW (130CV) ALLURE S&S',
 'vin': None,
 'year': 2018}
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875028%27 HTTP/1.1" 200 None
2026-01-27 20:00:50 [ayvens.es] INFO: Saving data for 1875028: {'created_time': 1769544050.129044, 'last_price_update_time': 1769544050.129058, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875028') HTTP/1.1" 204 0
2026-01-27 20:00:50 [ayvens.es] INFO: Found listing with ID: 1875048
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875048%27 HTTP/1.1" 200 None
2026-01-27 20:00:50 [ayvens.es] INFO: Scrape type for 1875048: 1
2026-01-27 20:00:50 [ayvens.es] INFO: Extracting data for car ID: 1875048
2026-01-27 20:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c323ed6-d850-5928-95fc-babd5c35951e with identifier: 1875048
2026-01-27 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c323ed6-d850-5928-95fc-babd5c35951e with scrape type 1
2026-01-27 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5c323ed6-d850-5928-95fc-babd5c35951e
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F123%252Ffa6f7631a29049688de1957abe5d77ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/123/fa6f7631a29049688de1957abe5d77ff/images/large/1.jpg not downloaded yet
2026-01-27 20:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/778/c92c36fdfaa9465ab4d0c80e9a522d6a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57405c190>
2026-01-27 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3/85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252F047a1dec4b7b454485c5b308d6ed488e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/047a1dec4b7b454485c5b308d6ed488e/images/large/1.jpg saved to cache
2026-01-27 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3
2026-01-27 20:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3, skipping ID generation
2026-01-27 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 with scrape type 1
2026-01-27 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 from tracking dictionaries
2026-01-27 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 sending to next pipeline
2026-01-27 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3, identifier: 1875030
2026-01-27 20:00:50 [ayvens.es] INFO: Found listing with ID: 1875049
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875049%27 HTTP/1.1" 200 None
2026-01-27 20:00:50 [ayvens.es] INFO: Scrape type for 1875049: 1
2026-01-27 20:00:50 [ayvens.es] INFO: Extracting data for car ID: 1875049
2026-01-27 20:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baea1663-1a12-5577-b404-1b0355751e28 with identifier: 1875049
2026-01-27 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baea1663-1a12-5577-b404-1b0355751e28 with scrape type 1
2026-01-27 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item baea1663-1a12-5577-b404-1b0355751e28
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F9944eb55c045423a91ce34cb892b8108%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/9944eb55c045423a91ce34cb892b8108/images/large/1.jpg not downloaded yet
2026-01-27 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 with identifier: 1875030
2026-01-27 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 with identifier: 1875030
2026-01-27 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185667 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185667
2026-01-27 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 spider: ayvens.es
2026-01-27 20:00:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3 due to rule: high_mileage_for_country.json, error: 185667 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185667
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 185667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3/85bc5e47-70ee-5bf6-9dcf-ad8b6556b0e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/810/047a1dec4b7b454485c5b308d6ed488e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW/187CV Titanium HEV AT',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW/187CV Titanium HEV AT',
 'vin': None,
 'year': 2021}
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875030%27 HTTP/1.1" 200 None
2026-01-27 20:00:51 [ayvens.es] INFO: Saving data for 1875030: {'created_time': 1769544051.020864, 'last_price_update_time': 1769544051.020876, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875030') HTTP/1.1" 204 0
2026-01-27 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/94f989201654461da0d19ea8326932db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:51 [ayvens.es] INFO: Found listing with ID: 1875050
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875050%27 HTTP/1.1" 200 None
2026-01-27 20:00:51 [ayvens.es] INFO: Scrape type for 1875050: 1
2026-01-27 20:00:51 [ayvens.es] INFO: Extracting data for car ID: 1875050
2026-01-27 20:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b854bb58-2c4c-5fa6-9f51-a7d210602116 with identifier: 1875050
2026-01-27 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b854bb58-2c4c-5fa6-9f51-a7d210602116 with scrape type 1
2026-01-27 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b854bb58-2c4c-5fa6-9f51-a7d210602116
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F041%252F945578a83e6c4e0f8b45c73f0766e071%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/041/945578a83e6c4e0f8b45c73f0766e071/images/large/1.jpg not downloaded yet
2026-01-27 20:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708c2210>
2026-01-27 20:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52746c71-02e7-57e8-a636-bc09d4ccc2f9/52746c71-02e7-57e8-a636-bc09d4ccc2f9_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F778%252Fc92c36fdfaa9465ab4d0c80e9a522d6a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/778/c92c36fdfaa9465ab4d0c80e9a522d6a/images/large/1.jpg saved to cache
2026-01-27 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52746c71-02e7-57e8-a636-bc09d4ccc2f9
2026-01-27 20:00:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52746c71-02e7-57e8-a636-bc09d4ccc2f9, skipping ID generation
2026-01-27 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52746c71-02e7-57e8-a636-bc09d4ccc2f9 with scrape type 1
2026-01-27 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 52746c71-02e7-57e8-a636-bc09d4ccc2f9 from tracking dictionaries
2026-01-27 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52746c71-02e7-57e8-a636-bc09d4ccc2f9 sending to next pipeline
2026-01-27 20:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 52746c71-02e7-57e8-a636-bc09d4ccc2f9, identifier: 1875031
2026-01-27 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/985/11587dac79bc4d3caadb84faa8e94955/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/074/149425e60ca947228ceab3129daf0f39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 52746c71-02e7-57e8-a636-bc09d4ccc2f9 with identifier: 1875031
2026-01-27 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 52746c71-02e7-57e8-a636-bc09d4ccc2f9 with identifier: 1875031
2026-01-27 20:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 52746c71-02e7-57e8-a636-bc09d4ccc2f9 with identifier: 1875031 to the API
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/778/c92c36fdfaa9465ab4d0c80e9a522d6a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '52746c71-02e7-57e8-a636-bc09d4ccc2f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 68459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52746c71-02e7-57e8-a636-bc09d4ccc2f9/52746c71-02e7-57e8-a636-bc09d4ccc2f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/778/c92c36fdfaa9465ab4d0c80e9a522d6a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875031%27 HTTP/1.1" 200 None
2026-01-27 20:00:51 [ayvens.es] INFO: Saving data for 1875031: {'created_time': 1769544051.913768, 'last_price_update_time': 1769544051.91378, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875031') HTTP/1.1" 204 0
2026-01-27 20:00:51 [ayvens.es] INFO: Found listing with ID: 1875051
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875051%27 HTTP/1.1" 200 None
2026-01-27 20:00:51 [ayvens.es] INFO: Scrape type for 1875051: 1
2026-01-27 20:00:51 [ayvens.es] INFO: Extracting data for car ID: 1875051
2026-01-27 20:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2674345-9f9f-519c-afb1-8f95da7388a7 with identifier: 1875051
2026-01-27 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2674345-9f9f-519c-afb1-8f95da7388a7 with scrape type 1
2026-01-27 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2674345-9f9f-519c-afb1-8f95da7388a7
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F623%252F7464c14f416948a2b495b31c92b97d22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/623/7464c14f416948a2b495b31c92b97d22/images/large/1.jpg not downloaded yet
2026-01-27 20:00:51 [ayvens.es] INFO: Found listing with ID: 1875052
2026-01-27 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875052%27 HTTP/1.1" 200 None
2026-01-27 20:00:52 [ayvens.es] INFO: Scrape type for 1875052: 1
2026-01-27 20:00:52 [ayvens.es] INFO: Extracting data for car ID: 1875052
2026-01-27 20:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31e03e4-129a-527d-9a43-b752d5627d58 with identifier: 1875052
2026-01-27 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31e03e4-129a-527d-9a43-b752d5627d58 with scrape type 1
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b31e03e4-129a-527d-9a43-b752d5627d58
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F03637b70379c445c943ad6ddb545b69b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/03637b70379c445c943ad6ddb545b69b/images/large/1.jpg not downloaded yet
2026-01-27 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/945/02bd2f0d0b97443a808219fd31a4c30d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5709f3350>
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82bbe6c-a153-58b2-98cc-b9bc17df95d7/c82bbe6c-a153-58b2-98cc-b9bc17df95d7_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F94f989201654461da0d19ea8326932db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/94f989201654461da0d19ea8326932db/images/large/1.jpg saved to cache
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c82bbe6c-a153-58b2-98cc-b9bc17df95d7
2026-01-27 20:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c82bbe6c-a153-58b2-98cc-b9bc17df95d7, skipping ID generation
2026-01-27 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82bbe6c-a153-58b2-98cc-b9bc17df95d7 with scrape type 1
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c82bbe6c-a153-58b2-98cc-b9bc17df95d7 from tracking dictionaries
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c82bbe6c-a153-58b2-98cc-b9bc17df95d7 sending to next pipeline
2026-01-27 20:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c82bbe6c-a153-58b2-98cc-b9bc17df95d7, identifier: 1875033
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a72690>
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d8e0a4-53c7-5aca-9125-07e35fd2ade5/30d8e0a4-53c7-5aca-9125-07e35fd2ade5_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F985%252F11587dac79bc4d3caadb84faa8e94955%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/985/11587dac79bc4d3caadb84faa8e94955/images/large/1.jpg saved to cache
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30d8e0a4-53c7-5aca-9125-07e35fd2ade5
2026-01-27 20:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30d8e0a4-53c7-5aca-9125-07e35fd2ade5, skipping ID generation
2026-01-27 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 with scrape type 1
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 from tracking dictionaries
2026-01-27 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 sending to next pipeline
2026-01-27 20:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 30d8e0a4-53c7-5aca-9125-07e35fd2ade5, identifier: 1875025
2026-01-27 20:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b76150>
2026-01-27 20:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20339578-0929-5f11-9fcb-4295aff3c4fa/20339578-0929-5f11-9fcb-4295aff3c4fa_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F074%252F149425e60ca947228ceab3129daf0f39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/074/149425e60ca947228ceab3129daf0f39/images/large/1.jpg saved to cache
2026-01-27 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20339578-0929-5f11-9fcb-4295aff3c4fa
2026-01-27 20:00:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20339578-0929-5f11-9fcb-4295aff3c4fa, skipping ID generation
2026-01-27 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20339578-0929-5f11-9fcb-4295aff3c4fa with scrape type 1
2026-01-27 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 20339578-0929-5f11-9fcb-4295aff3c4fa from tracking dictionaries
2026-01-27 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20339578-0929-5f11-9fcb-4295aff3c4fa sending to next pipeline
2026-01-27 20:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 20339578-0929-5f11-9fcb-4295aff3c4fa, identifier: 1875034
2026-01-27 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/f2ab6fa77a75462ebd0fd4ad8ba47b9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/844/b556c3c8d503474c9a3c07c890e19fd0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:53 [ayvens.es] INFO: Found listing with ID: 1875053
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875053%27 HTTP/1.1" 200 None
2026-01-27 20:00:53 [ayvens.es] INFO: Scrape type for 1875053: 1
2026-01-27 20:00:53 [ayvens.es] INFO: Extracting data for car ID: 1875053
2026-01-27 20:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9082ff7-6cac-5efb-89d5-083c94297770 with identifier: 1875053
2026-01-27 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9082ff7-6cac-5efb-89d5-083c94297770 with scrape type 1
2026-01-27 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d9082ff7-6cac-5efb-89d5-083c94297770
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F058%252F143ff137e19542fe9a3f566faaadb995%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/058/143ff137e19542fe9a3f566faaadb995/images/large/1.jpg not downloaded yet
2026-01-27 20:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c82bbe6c-a153-58b2-98cc-b9bc17df95d7 with identifier: 1875033
2026-01-27 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c82bbe6c-a153-58b2-98cc-b9bc17df95d7 with identifier: 1875033
2026-01-27 20:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c82bbe6c-a153-58b2-98cc-b9bc17df95d7 with identifier: 1875033 to the API
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/94f989201654461da0d19ea8326932db/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c82bbe6c-a153-58b2-98cc-b9bc17df95d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 132057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82bbe6c-a153-58b2-98cc-b9bc17df95d7/c82bbe6c-a153-58b2-98cc-b9bc17df95d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/94f989201654461da0d19ea8326932db/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) DSG AMBITION',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) DSG AMBITION',
 'vin': None,
 'year': 2022}
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875033%27 HTTP/1.1" 200 None
2026-01-27 20:00:53 [ayvens.es] INFO: Saving data for 1875033: {'created_time': 1769544053.896488, 'last_price_update_time': 1769544053.8965, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875033') HTTP/1.1" 204 0
2026-01-27 20:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 with identifier: 1875025
2026-01-27 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 with identifier: 1875025
2026-01-27 20:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163985 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163985
2026-01-27 20:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 spider: ayvens.es
2026-01-27 20:00:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 30d8e0a4-53c7-5aca-9125-07e35fd2ade5 due to rule: high_mileage_for_country.json, error: 163985 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163985
{'auction_title': '',
 'c_o_2_emission_value': 83,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '30d8e0a4-53c7-5aca-9125-07e35fd2ade5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 163985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d8e0a4-53c7-5aca-9125-07e35fd2ade5/30d8e0a4-53c7-5aca-9125-07e35fd2ade5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/985/11587dac79bc4d3caadb84faa8e94955/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Klass DT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Klass DT',
 'vin': None,
 'year': 2020}
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875025%27 HTTP/1.1" 200 None
2026-01-27 20:00:54 [ayvens.es] INFO: Saving data for 1875025: {'created_time': 1769544054.166629, 'last_price_update_time': 1769544054.166641, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875025') HTTP/1.1" 204 0
2026-01-27 20:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 20339578-0929-5f11-9fcb-4295aff3c4fa with identifier: 1875034
2026-01-27 20:00:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 20339578-0929-5f11-9fcb-4295aff3c4fa with identifier: 1875034
2026-01-27 20:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blamco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'cc', 'trim': 'advance 2.0 tdi 150cv bmt', 'title': 'volkswagen cc advance 2.0 tdi 150cv bmt', 'price': 0, 'odometer': 274378, 'odometer_reading_unit': 'km', 'registration_date': '2015-11-10', 'year': 2015, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 4, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 118, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '20339578-0929-5f11-9fcb-4295aff3c4fa', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20339578-0929-5f11-9fcb-4295aff3c4fa/20339578-0929-5f11-9fcb-4295aff3c4fa_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/149425e60ca947228ceab3129daf0f39/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 336268}], 'current_year_diff': 11, 'age_in_months': 122, 'make_model': 'volkswagen cc', 'sanitized_make': 'volkswagen', 'odometer_in_km': 274378}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 122,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'color': 'blamco',
     'currency': 'eur',
     'current_year_diff': 11,
     'doors_number': 4,
     'engine': '2.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '20339578-0929-5f11-9fcb-4295aff3c4fa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen cc',
     'model': 'cc',
     'odometer': 274378,
     'odometer_in_km': 274378,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20339578-0929-5f11-9fcb-4295aff3c4fa/20339578-0929-5f11-9fcb-4295aff3c4fa_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 336268,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/149425e60ca947228ceab3129daf0f39/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-11-10',
     'sanitized_make': 'volkswagen',
     'seats_number': 4,
     'seller_name': None,
     'title': 'volkswagen cc advance 2.0 tdi 150cv bmt',
     'transmission': 'manual',
     'trim': 'advance 2.0 tdi 150cv bmt',
     'vin': None,
     'year': 2015}
2026-01-27 20:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 20339578-0929-5f11-9fcb-4295aff3c4fa spider: ayvens.es
2026-01-27 20:00:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 20339578-0929-5f11-9fcb-4295aff3c4fa due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blamco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'cc', 'trim': 'advance 2.0 tdi 150cv bmt', 'title': 'volkswagen cc advance 2.0 tdi 150cv bmt', 'price': 0, 'odometer': 274378, 'odometer_reading_unit': 'km', 'registration_date': '2015-11-10', 'year': 2015, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 4, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 118, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '20339578-0929-5f11-9fcb-4295aff3c4fa', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20339578-0929-5f11-9fcb-4295aff3c4fa/20339578-0929-5f11-9fcb-4295aff3c4fa_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/149425e60ca947228ceab3129daf0f39/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 336268}], 'current_year_diff': 11, 'age_in_months': 122, 'make_model': 'volkswagen cc', 'sanitized_make': 'volkswagen', 'odometer_in_km': 274378}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 122,
     'auction_title': '',
     'c_o_2_emission_value': 118,
     'color': 'blamco',
     'currency': 'eur',
     'current_year_diff': 11,
     'doors_number': 4,
     'engine': '2.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '20339578-0929-5f11-9fcb-4295aff3c4fa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen cc',
     'model': 'cc',
     'odometer': 274378,
     'odometer_in_km': 274378,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20339578-0929-5f11-9fcb-4295aff3c4fa/20339578-0929-5f11-9fcb-4295aff3c4fa_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 336268,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/149425e60ca947228ceab3129daf0f39/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-11-10',
     'sanitized_make': 'volkswagen',
     'seats_number': 4,
     'seller_name': None,
     'title': 'volkswagen cc advance 2.0 tdi 150cv bmt',
     'transmission': 'manual',
     'trim': 'advance 2.0 tdi 150cv bmt',
     'vin': None,
     'year': 2015}
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blamco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '20339578-0929-5f11-9fcb-4295aff3c4fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CC',
 'odometer': 274378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20339578-0929-5f11-9fcb-4295aff3c4fa/20339578-0929-5f11-9fcb-4295aff3c4fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/149425e60ca947228ceab3129daf0f39/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'VOLKSWAGEN CC Advance 2.0 TDI 150CV BMT',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 150CV BMT',
 'vin': None,
 'year': 2015}
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875034%27 HTTP/1.1" 200 None
2026-01-27 20:00:54 [ayvens.es] INFO: Saving data for 1875034: {'created_time': 1769544054.438678, 'last_price_update_time': 1769544054.438688, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875034') HTTP/1.1" 204 0
2026-01-27 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/591/f9032409f21344189222220f16a0766f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/738/85f9071fbfcc450ab95a230cfba3be01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:54 [ayvens.es] INFO: Found listing with ID: 1875054
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875054%27 HTTP/1.1" 200 None
2026-01-27 20:00:54 [ayvens.es] INFO: Scrape type for 1875054: 1
2026-01-27 20:00:54 [ayvens.es] INFO: Extracting data for car ID: 1875054
2026-01-27 20:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33a19977-81b3-56dc-99d7-041c3dc3b0b2 with identifier: 1875054
2026-01-27 20:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33a19977-81b3-56dc-99d7-041c3dc3b0b2 with scrape type 1
2026-01-27 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33a19977-81b3-56dc-99d7-041c3dc3b0b2
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F077%252F73f80a8a246040d0a135ea11d4217373%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/077/73f80a8a246040d0a135ea11d4217373/images/large/1.jpg not downloaded yet
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a7f990>
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_474799ac-2fe5-5eba-924c-3061dc68bfeb/474799ac-2fe5-5eba-924c-3061dc68bfeb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F02bd2f0d0b97443a808219fd31a4c30d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/02bd2f0d0b97443a808219fd31a4c30d/images/large/1.jpg saved to cache
2026-01-27 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 474799ac-2fe5-5eba-924c-3061dc68bfeb
2026-01-27 20:00:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 474799ac-2fe5-5eba-924c-3061dc68bfeb, skipping ID generation
2026-01-27 20:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474799ac-2fe5-5eba-924c-3061dc68bfeb with scrape type 1
2026-01-27 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 474799ac-2fe5-5eba-924c-3061dc68bfeb from tracking dictionaries
2026-01-27 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 474799ac-2fe5-5eba-924c-3061dc68bfeb sending to next pipeline
2026-01-27 20:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 474799ac-2fe5-5eba-924c-3061dc68bfeb, identifier: 1875029
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a18a90>
2026-01-27 20:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99/2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252Ff2ab6fa77a75462ebd0fd4ad8ba47b9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/f2ab6fa77a75462ebd0fd4ad8ba47b9b/images/large/1.jpg saved to cache
2026-01-27 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99
2026-01-27 20:00:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99, skipping ID generation
2026-01-27 20:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 with scrape type 1
2026-01-27 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 from tracking dictionaries
2026-01-27 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 sending to next pipeline
2026-01-27 20:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99, identifier: 1875026
2026-01-27 20:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a93850>
2026-01-27 20:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a3be87-b47c-534f-ba52-0c3b774e0815/21a3be87-b47c-534f-ba52-0c3b774e0815_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F844%252Fb556c3c8d503474c9a3c07c890e19fd0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/844/b556c3c8d503474c9a3c07c890e19fd0/images/large/1.jpg saved to cache
2026-01-27 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21a3be87-b47c-534f-ba52-0c3b774e0815
2026-01-27 20:00:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21a3be87-b47c-534f-ba52-0c3b774e0815, skipping ID generation
2026-01-27 20:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a3be87-b47c-534f-ba52-0c3b774e0815 with scrape type 1
2026-01-27 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 21a3be87-b47c-534f-ba52-0c3b774e0815 from tracking dictionaries
2026-01-27 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21a3be87-b47c-534f-ba52-0c3b774e0815 sending to next pipeline
2026-01-27 20:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 21a3be87-b47c-534f-ba52-0c3b774e0815, identifier: 1875027
2026-01-27 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/382/60971a7529cd4fde95bf15540ffdb174/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:55 [ayvens.es] INFO: Found listing with ID: 1875055
2026-01-27 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875055%27 HTTP/1.1" 200 None
2026-01-27 20:00:56 [ayvens.es] INFO: Scrape type for 1875055: 1
2026-01-27 20:00:56 [ayvens.es] INFO: Extracting data for car ID: 1875055
2026-01-27 20:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce42cec7-b3a5-5ed3-9926-69b511008d98 with identifier: 1875055
2026-01-27 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce42cec7-b3a5-5ed3-9926-69b511008d98 with scrape type 1
2026-01-27 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce42cec7-b3a5-5ed3-9926-69b511008d98
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F196%252Fd2eb5ecba71c4830af83fc0e7e98749a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/196/d2eb5ecba71c4830af83fc0e7e98749a/images/large/1.jpg not downloaded yet
2026-01-27 20:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 474799ac-2fe5-5eba-924c-3061dc68bfeb with identifier: 1875029
2026-01-27 20:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 474799ac-2fe5-5eba-924c-3061dc68bfeb with identifier: 1875029
2026-01-27 20:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'azul', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'bmw', 'model': 'x1', 'trim': 'sdrive18da corporate', 'title': 'bmw x1 sdrive18da corporate', 'price': 0, 'odometer': 201092, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-04', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 137, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '474799ac-2fe5-5eba-924c-3061dc68bfeb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474799ac-2fe5-5eba-924c-3061dc68bfeb/474799ac-2fe5-5eba-924c-3061dc68bfeb_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/02bd2f0d0b97443a808219fd31a4c30d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 343563}], 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'bmw x1', 'sanitized_make': 'bmw', 'odometer_in_km': 201092}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 137,
     'color': 'azul',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '474799ac-2fe5-5eba-924c-3061dc68bfeb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'bmw',
     'make_model': 'bmw x1',
     'model': 'x1',
     'odometer': 201092,
     'odometer_in_km': 201092,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474799ac-2fe5-5eba-924c-3061dc68bfeb/474799ac-2fe5-5eba-924c-3061dc68bfeb_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 343563,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/02bd2f0d0b97443a808219fd31a4c30d/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-04',
     'sanitized_make': 'bmw',
     'seats_number': 5,
     'seller_name': None,
     'title': 'bmw x1 sdrive18da corporate',
     'transmission': 'manual',
     'trim': 'sdrive18da corporate',
     'vin': None,
     'year': 2021}
2026-01-27 20:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 474799ac-2fe5-5eba-924c-3061dc68bfeb spider: ayvens.es
2026-01-27 20:00:56 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 474799ac-2fe5-5eba-924c-3061dc68bfeb due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'azul', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'bmw', 'model': 'x1', 'trim': 'sdrive18da corporate', 'title': 'bmw x1 sdrive18da corporate', 'price': 0, 'odometer': 201092, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-04', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 137, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '474799ac-2fe5-5eba-924c-3061dc68bfeb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474799ac-2fe5-5eba-924c-3061dc68bfeb/474799ac-2fe5-5eba-924c-3061dc68bfeb_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/02bd2f0d0b97443a808219fd31a4c30d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 343563}], 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'bmw x1', 'sanitized_make': 'bmw', 'odometer_in_km': 201092}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 137,
     'color': 'azul',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '474799ac-2fe5-5eba-924c-3061dc68bfeb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'bmw',
     'make_model': 'bmw x1',
     'model': 'x1',
     'odometer': 201092,
     'odometer_in_km': 201092,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474799ac-2fe5-5eba-924c-3061dc68bfeb/474799ac-2fe5-5eba-924c-3061dc68bfeb_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 343563,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/02bd2f0d0b97443a808219fd31a4c30d/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-04',
     'sanitized_make': 'bmw',
     'seats_number': 5,
     'seller_name': None,
     'title': 'bmw x1 sdrive18da corporate',
     'transmission': 'manual',
     'trim': 'sdrive18da corporate',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '474799ac-2fe5-5eba-924c-3061dc68bfeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 201092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474799ac-2fe5-5eba-924c-3061dc68bfeb/474799ac-2fe5-5eba-924c-3061dc68bfeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/02bd2f0d0b97443a808219fd31a4c30d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18dA Corporate',
 'transmission': 'manual',
 'trim': 'sDrive18dA Corporate',
 'vin': None,
 'year': 2021}
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875029%27 HTTP/1.1" 200 None
2026-01-27 20:00:56 [ayvens.es] INFO: Saving data for 1875029: {'created_time': 1769544056.251219, 'last_price_update_time': 1769544056.251233, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875029') HTTP/1.1" 204 0
2026-01-27 20:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 with identifier: 1875026
2026-01-27 20:00:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 with identifier: 1875026
2026-01-27 20:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
2026-01-27 20:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 spider: ayvens.es
2026-01-27 20:00:56 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.4L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'gas',
 'id': '2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 140982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99/2b9c3f7c-5557-5c0c-adc9-ee32f3cf8c99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/f2ab6fa77a75462ebd0fd4ad8ba47b9b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Profesional Kombi 1.4 TGI 81kW BM',
 'transmission': 'manual',
 'trim': 'Profesional Kombi 1.4 TGI 81kW BM',
 'vin': None,
 'year': 2019}
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875026%27 HTTP/1.1" 200 None
2026-01-27 20:00:56 [ayvens.es] INFO: Saving data for 1875026: {'created_time': 1769544056.508528, 'last_price_update_time': 1769544056.508545, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875026') HTTP/1.1" 204 0
2026-01-27 20:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 21a3be87-b47c-534f-ba52-0c3b774e0815 with identifier: 1875027
2026-01-27 20:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 21a3be87-b47c-534f-ba52-0c3b774e0815 with identifier: 1875027
2026-01-27 20:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 21a3be87-b47c-534f-ba52-0c3b774e0815 with identifier: 1875027 to the API
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/844/b556c3c8d503474c9a3c07c890e19fd0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '21a3be87-b47c-534f-ba52-0c3b774e0815',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 40401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a3be87-b47c-534f-ba52-0c3b774e0815/21a3be87-b47c-534f-ba52-0c3b774e0815_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/844/b556c3c8d503474c9a3c07c890e19fd0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875027%27 HTTP/1.1" 200 None
2026-01-27 20:00:56 [ayvens.es] INFO: Saving data for 1875027: {'created_time': 1769544056.953542, 'last_price_update_time': 1769544056.953554, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875027') HTTP/1.1" 204 0
2026-01-27 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/116/d0c48b8c3bfb47509603863991ce4cca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/557/9d5c6721807a47cf915487fbc419b45f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:56 [ayvens.es] INFO: Found listing with ID: 1875056
2026-01-27 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875056%27 HTTP/1.1" 200 None
2026-01-27 20:00:57 [ayvens.es] INFO: Scrape type for 1875056: 1
2026-01-27 20:00:57 [ayvens.es] INFO: Extracting data for car ID: 1875056
2026-01-27 20:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e with identifier: 1875056
2026-01-27 20:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e with scrape type 1
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252F9a5bb1ef22ab4948a630b1890b613f61%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/9a5bb1ef22ab4948a630b1890b613f61/images/large/1.jpg not downloaded yet
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572128350>
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98b09bf-5440-52af-8e5b-b8f8293b675e/d98b09bf-5440-52af-8e5b-b8f8293b675e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F591%252Ff9032409f21344189222220f16a0766f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/591/f9032409f21344189222220f16a0766f/images/large/1.jpg saved to cache
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d98b09bf-5440-52af-8e5b-b8f8293b675e
2026-01-27 20:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d98b09bf-5440-52af-8e5b-b8f8293b675e, skipping ID generation
2026-01-27 20:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d98b09bf-5440-52af-8e5b-b8f8293b675e with scrape type 1
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d98b09bf-5440-52af-8e5b-b8f8293b675e from tracking dictionaries
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d98b09bf-5440-52af-8e5b-b8f8293b675e sending to next pipeline
2026-01-27 20:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d98b09bf-5440-52af-8e5b-b8f8293b675e, identifier: 1875035
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff574cc6b90>
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d4bff54-0714-51f4-acad-dc0220cdf7bc/8d4bff54-0714-51f4-acad-dc0220cdf7bc_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F738%252F85f9071fbfcc450ab95a230cfba3be01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/738/85f9071fbfcc450ab95a230cfba3be01/images/large/1.jpg saved to cache
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d4bff54-0714-51f4-acad-dc0220cdf7bc
2026-01-27 20:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d4bff54-0714-51f4-acad-dc0220cdf7bc, skipping ID generation
2026-01-27 20:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d4bff54-0714-51f4-acad-dc0220cdf7bc with scrape type 1
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8d4bff54-0714-51f4-acad-dc0220cdf7bc from tracking dictionaries
2026-01-27 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d4bff54-0714-51f4-acad-dc0220cdf7bc sending to next pipeline
2026-01-27 20:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8d4bff54-0714-51f4-acad-dc0220cdf7bc, identifier: 1875036
2026-01-27 20:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d98b09bf-5440-52af-8e5b-b8f8293b675e with identifier: 1875035
2026-01-27 20:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d98b09bf-5440-52af-8e5b-b8f8293b675e with identifier: 1875035
2026-01-27 20:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d98b09bf-5440-52af-8e5b-b8f8293b675e with identifier: 1875035 to the API
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/591/f9032409f21344189222220f16a0766f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd98b09bf-5440-52af-8e5b-b8f8293b675e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 91284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98b09bf-5440-52af-8e5b-b8f8293b675e/d98b09bf-5440-52af-8e5b-b8f8293b675e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/591/f9032409f21344189222220f16a0766f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875035%27 HTTP/1.1" 200 None
2026-01-27 20:00:58 [ayvens.es] INFO: Saving data for 1875035: {'created_time': 1769544058.340003, 'last_price_update_time': 1769544058.340017, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875035') HTTP/1.1" 204 0
2026-01-27 20:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8d4bff54-0714-51f4-acad-dc0220cdf7bc with identifier: 1875036
2026-01-27 20:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8d4bff54-0714-51f4-acad-dc0220cdf7bc with identifier: 1875036
2026-01-27 20:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8d4bff54-0714-51f4-acad-dc0220cdf7bc with identifier: 1875036 to the API
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/738/85f9071fbfcc450ab95a230cfba3be01/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8d4bff54-0714-51f4-acad-dc0220cdf7bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 80862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d4bff54-0714-51f4-acad-dc0220cdf7bc/8d4bff54-0714-51f4-acad-dc0220cdf7bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/738/85f9071fbfcc450ab95a230cfba3be01/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875036%27 HTTP/1.1" 200 None
2026-01-27 20:00:58 [ayvens.es] INFO: Saving data for 1875036: {'created_time': 1769544058.665701, 'last_price_update_time': 1769544058.665715, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875036') HTTP/1.1" 204 0
2026-01-27 20:00:58 [ayvens.es] INFO: Found listing with ID: 1875057
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875057%27 HTTP/1.1" 200 None
2026-01-27 20:00:58 [ayvens.es] INFO: Scrape type for 1875057: 1
2026-01-27 20:00:58 [ayvens.es] INFO: Extracting data for car ID: 1875057
2026-01-27 20:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f657ec-6428-570d-b685-eb88f2060162 with identifier: 1875057
2026-01-27 20:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f657ec-6428-570d-b685-eb88f2060162 with scrape type 1
2026-01-27 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 30f657ec-6428-570d-b685-eb88f2060162
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252F0432b414b5564b068cab8352a0eac02f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/0432b414b5564b068cab8352a0eac02f/images/large/1.jpg not downloaded yet
2026-01-27 20:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570946a50>
2026-01-27 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_901a9f62-eb54-5e54-a39d-ba0c8754569b/901a9f62-eb54-5e54-a39d-ba0c8754569b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252F60971a7529cd4fde95bf15540ffdb174%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/60971a7529cd4fde95bf15540ffdb174/images/large/1.jpg saved to cache
2026-01-27 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 901a9f62-eb54-5e54-a39d-ba0c8754569b
2026-01-27 20:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 901a9f62-eb54-5e54-a39d-ba0c8754569b, skipping ID generation
2026-01-27 20:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901a9f62-eb54-5e54-a39d-ba0c8754569b with scrape type 1
2026-01-27 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 901a9f62-eb54-5e54-a39d-ba0c8754569b from tracking dictionaries
2026-01-27 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 901a9f62-eb54-5e54-a39d-ba0c8754569b sending to next pipeline
2026-01-27 20:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 901a9f62-eb54-5e54-a39d-ba0c8754569b, identifier: 1875032
2026-01-27 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/615/63fef69f10f24d7b8a963d491795af11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 901a9f62-eb54-5e54-a39d-ba0c8754569b with identifier: 1875032
2026-01-27 20:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 901a9f62-eb54-5e54-a39d-ba0c8754569b with identifier: 1875032
2026-01-27 20:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 901a9f62-eb54-5e54-a39d-ba0c8754569b with identifier: 1875032 to the API
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/382/60971a7529cd4fde95bf15540ffdb174/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '901a9f62-eb54-5e54-a39d-ba0c8754569b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 71120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_901a9f62-eb54-5e54-a39d-ba0c8754569b/901a9f62-eb54-5e54-a39d-ba0c8754569b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/382/60971a7529cd4fde95bf15540ffdb174/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875032%27 HTTP/1.1" 200 None
2026-01-27 20:00:59 [ayvens.es] INFO: Saving data for 1875032: {'created_time': 1769544059.638803, 'last_price_update_time': 1769544059.638814, 'auction_closing_time': 1769601600.0}
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875032') HTTP/1.1" 204 0
2026-01-27 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/720/4adb216bfb9e4f2f98582852c452640e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/762/99ac287eb20c43d78c94fbf4510dd123/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:00:59 [ayvens.es] INFO: Found listing with ID: 1875058
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875058%27 HTTP/1.1" 200 None
2026-01-27 20:00:59 [ayvens.es] INFO: Scrape type for 1875058: 1
2026-01-27 20:00:59 [ayvens.es] INFO: Extracting data for car ID: 1875058
2026-01-27 20:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8613d806-2f73-517d-8a2d-6978d649c25c with identifier: 1875058
2026-01-27 20:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8613d806-2f73-517d-8a2d-6978d649c25c with scrape type 1
2026-01-27 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8613d806-2f73-517d-8a2d-6978d649c25c
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F246%252F9310208026cc49279a6ab57ec8c6250d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/246/9310208026cc49279a6ab57ec8c6250d/images/large/1.jpg not downloaded yet
2026-01-27 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570944c50>
2026-01-27 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73821dfe-a64f-5aec-bf88-5a7a108ebfbe/73821dfe-a64f-5aec-bf88-5a7a108ebfbe_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F116%252Fd0c48b8c3bfb47509603863991ce4cca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/116/d0c48b8c3bfb47509603863991ce4cca/images/large/1.jpg saved to cache
2026-01-27 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73821dfe-a64f-5aec-bf88-5a7a108ebfbe
2026-01-27 20:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73821dfe-a64f-5aec-bf88-5a7a108ebfbe, skipping ID generation
2026-01-27 20:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73821dfe-a64f-5aec-bf88-5a7a108ebfbe with scrape type 1
2026-01-27 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 73821dfe-a64f-5aec-bf88-5a7a108ebfbe from tracking dictionaries
2026-01-27 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73821dfe-a64f-5aec-bf88-5a7a108ebfbe sending to next pipeline
2026-01-27 20:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 73821dfe-a64f-5aec-bf88-5a7a108ebfbe, identifier: 1875038
2026-01-27 20:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f1a8d0>
2026-01-27 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10951fad-9f0c-5474-80e5-510ad22464bb/10951fad-9f0c-5474-80e5-510ad22464bb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252F9d5c6721807a47cf915487fbc419b45f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/9d5c6721807a47cf915487fbc419b45f/images/large/1.jpg saved to cache
2026-01-27 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10951fad-9f0c-5474-80e5-510ad22464bb
2026-01-27 20:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10951fad-9f0c-5474-80e5-510ad22464bb, skipping ID generation
2026-01-27 20:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10951fad-9f0c-5474-80e5-510ad22464bb with scrape type 1
2026-01-27 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 10951fad-9f0c-5474-80e5-510ad22464bb from tracking dictionaries
2026-01-27 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10951fad-9f0c-5474-80e5-510ad22464bb sending to next pipeline
2026-01-27 20:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 10951fad-9f0c-5474-80e5-510ad22464bb, identifier: 1875037
2026-01-27 20:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 73821dfe-a64f-5aec-bf88-5a7a108ebfbe with identifier: 1875038
2026-01-27 20:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 73821dfe-a64f-5aec-bf88-5a7a108ebfbe with identifier: 1875038
2026-01-27 20:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167573 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167573
2026-01-27 20:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 73821dfe-a64f-5aec-bf88-5a7a108ebfbe spider: ayvens.es
2026-01-27 20:01:00 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 73821dfe-a64f-5aec-bf88-5a7a108ebfbe due to rule: high_mileage_for_country.json, error: 167573 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167573
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '73821dfe-a64f-5aec-bf88-5a7a108ebfbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 167573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73821dfe-a64f-5aec-bf88-5a7a108ebfbe/73821dfe-a64f-5aec-bf88-5a7a108ebfbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/116/d0c48b8c3bfb47509603863991ce4cca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 2.0 TFSI quattro S tronic',
 'transmission': 'manual',
 'trim': '2.0 TFSI quattro S tronic',
 'vin': None,
 'year': 2017}
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875038%27 HTTP/1.1" 200 None
2026-01-27 20:01:00 [ayvens.es] INFO: Saving data for 1875038: {'created_time': 1769544060.799115, 'last_price_update_time': 1769544060.799127, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875038') HTTP/1.1" 204 0
2026-01-27 20:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 10951fad-9f0c-5474-80e5-510ad22464bb with identifier: 1875037
2026-01-27 20:01:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 10951fad-9f0c-5474-80e5-510ad22464bb with identifier: 1875037
2026-01-27 20:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 10951fad-9f0c-5474-80e5-510ad22464bb with identifier: 1875037 to the API
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/557/9d5c6721807a47cf915487fbc419b45f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '10951fad-9f0c-5474-80e5-510ad22464bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 71784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10951fad-9f0c-5474-80e5-510ad22464bb/10951fad-9f0c-5474-80e5-510ad22464bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/557/9d5c6721807a47cf915487fbc419b45f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875037%27 HTTP/1.1" 200 None
2026-01-27 20:01:01 [ayvens.es] INFO: Saving data for 1875037: {'created_time': 1769544061.303967, 'last_price_update_time': 1769544061.303981, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875037') HTTP/1.1" 204 0
2026-01-27 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/051/309df8edec7f402e8b59e298a7ea8900/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:01 [ayvens.es] INFO: Found listing with ID: 1875059
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875059%27 HTTP/1.1" 200 None
2026-01-27 20:01:01 [ayvens.es] INFO: Scrape type for 1875059: 1
2026-01-27 20:01:01 [ayvens.es] INFO: Extracting data for car ID: 1875059
2026-01-27 20:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50835b5d-ee71-53ed-92f7-1c9540eec9ea with identifier: 1875059
2026-01-27 20:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50835b5d-ee71-53ed-92f7-1c9540eec9ea with scrape type 1
2026-01-27 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 50835b5d-ee71-53ed-92f7-1c9540eec9ea
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F284%252F1af96e017b41470bb9e3213541c8b25f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/284/1af96e017b41470bb9e3213541c8b25f/images/large/1.jpg not downloaded yet
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722e0c10>
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_855338b6-30b3-516d-8232-5b6c760c0af3/855338b6-30b3-516d-8232-5b6c760c0af3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F63fef69f10f24d7b8a963d491795af11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/63fef69f10f24d7b8a963d491795af11/images/large/1.jpg saved to cache
2026-01-27 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 855338b6-30b3-516d-8232-5b6c760c0af3
2026-01-27 20:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 855338b6-30b3-516d-8232-5b6c760c0af3, skipping ID generation
2026-01-27 20:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 855338b6-30b3-516d-8232-5b6c760c0af3 with scrape type 1
2026-01-27 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 855338b6-30b3-516d-8232-5b6c760c0af3 from tracking dictionaries
2026-01-27 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 855338b6-30b3-516d-8232-5b6c760c0af3 sending to next pipeline
2026-01-27 20:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 855338b6-30b3-516d-8232-5b6c760c0af3, identifier: 1875039
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722e1b50>
2026-01-27 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df836029-26c1-53c4-9fdd-f48982147aca/df836029-26c1-53c4-9fdd-f48982147aca_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F720%252F4adb216bfb9e4f2f98582852c452640e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/720/4adb216bfb9e4f2f98582852c452640e/images/large/1.jpg saved to cache
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df836029-26c1-53c4-9fdd-f48982147aca
2026-01-27 20:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df836029-26c1-53c4-9fdd-f48982147aca, skipping ID generation
2026-01-27 20:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df836029-26c1-53c4-9fdd-f48982147aca with scrape type 1
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item df836029-26c1-53c4-9fdd-f48982147aca from tracking dictionaries
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df836029-26c1-53c4-9fdd-f48982147aca sending to next pipeline
2026-01-27 20:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: df836029-26c1-53c4-9fdd-f48982147aca, identifier: 1875040
2026-01-27 20:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b5ba90>
2026-01-27 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f/efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F762%252F99ac287eb20c43d78c94fbf4510dd123%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/762/99ac287eb20c43d78c94fbf4510dd123/images/large/1.jpg saved to cache
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f
2026-01-27 20:01:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f, skipping ID generation
2026-01-27 20:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f with scrape type 1
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f from tracking dictionaries
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f sending to next pipeline
2026-01-27 20:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f, identifier: 1875045
2026-01-27 20:01:02 [ayvens.es] INFO: Found listing with ID: 1875060
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875060%27 HTTP/1.1" 200 None
2026-01-27 20:01:02 [ayvens.es] INFO: Scrape type for 1875060: 1
2026-01-27 20:01:02 [ayvens.es] INFO: Extracting data for car ID: 1875060
2026-01-27 20:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5 with identifier: 1875060
2026-01-27 20:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5 with scrape type 1
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F991%252F4d19e44265b24ef485ddc2fa359003f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/991/4d19e44265b24ef485ddc2fa359003f8/images/large/1.jpg not downloaded yet
2026-01-27 20:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 855338b6-30b3-516d-8232-5b6c760c0af3 with identifier: 1875039
2026-01-27 20:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 855338b6-30b3-516d-8232-5b6c760c0af3 with identifier: 1875039
2026-01-27 20:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 855338b6-30b3-516d-8232-5b6c760c0af3 with identifier: 1875039 to the API
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/615/63fef69f10f24d7b8a963d491795af11/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '855338b6-30b3-516d-8232-5b6c760c0af3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 71636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855338b6-30b3-516d-8232-5b6c760c0af3/855338b6-30b3-516d-8232-5b6c760c0af3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/615/63fef69f10f24d7b8a963d491795af11/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875039%27 HTTP/1.1" 200 None
2026-01-27 20:01:03 [ayvens.es] INFO: Saving data for 1875039: {'created_time': 1769544063.275665, 'last_price_update_time': 1769544063.275677, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875039') HTTP/1.1" 204 0
2026-01-27 20:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: df836029-26c1-53c4-9fdd-f48982147aca with identifier: 1875040
2026-01-27 20:01:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: df836029-26c1-53c4-9fdd-f48982147aca with identifier: 1875040
2026-01-27 20:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: df836029-26c1-53c4-9fdd-f48982147aca with identifier: 1875040 to the API
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/720/4adb216bfb9e4f2f98582852c452640e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'df836029-26c1-53c4-9fdd-f48982147aca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 106108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df836029-26c1-53c4-9fdd-f48982147aca/df836029-26c1-53c4-9fdd-f48982147aca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/720/4adb216bfb9e4f2f98582852c452640e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.6 TDI 85kW St&Sp Style Edit. Nav Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW St&Sp Style Edit. Nav Eco',
 'vin': None,
 'year': 2019}
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875040%27 HTTP/1.1" 200 None
2026-01-27 20:01:03 [ayvens.es] INFO: Saving data for 1875040: {'created_time': 1769544063.639725, 'last_price_update_time': 1769544063.639735, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875040') HTTP/1.1" 204 0
2026-01-27 20:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f with identifier: 1875045
2026-01-27 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f with identifier: 1875045
2026-01-27 20:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f with identifier: 1875045 to the API
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/762/99ac287eb20c43d78c94fbf4510dd123/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 SPORTBACK',
 'odometer': 47471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f/efb8c9e6-f8fc-5c5c-8abc-d929a0e1bb5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/762/99ac287eb20c43d78c94fbf4510dd123/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 SPORTBACK Advanced 35 TDI 120kW S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 120kW S tronic',
 'vin': None,
 'year': 2023}
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875045%27 HTTP/1.1" 200 None
2026-01-27 20:01:03 [ayvens.es] INFO: Saving data for 1875045: {'created_time': 1769544063.974117, 'last_price_update_time': 1769544063.974127, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875045') HTTP/1.1" 204 0
2026-01-27 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/513/e19f65399d9c4d2c90b3c3e73c56e25d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572153b90>
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f36bddb-dbe5-5a92-a0bf-56e25850ac39/2f36bddb-dbe5-5a92-a0bf-56e25850ac39_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252F309df8edec7f402e8b59e298a7ea8900%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/309df8edec7f402e8b59e298a7ea8900/images/large/1.jpg saved to cache
2026-01-27 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f36bddb-dbe5-5a92-a0bf-56e25850ac39
2026-01-27 20:01:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f36bddb-dbe5-5a92-a0bf-56e25850ac39, skipping ID generation
2026-01-27 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f36bddb-dbe5-5a92-a0bf-56e25850ac39 with scrape type 1
2026-01-27 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2f36bddb-dbe5-5a92-a0bf-56e25850ac39 from tracking dictionaries
2026-01-27 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f36bddb-dbe5-5a92-a0bf-56e25850ac39 sending to next pipeline
2026-01-27 20:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2f36bddb-dbe5-5a92-a0bf-56e25850ac39, identifier: 1875042
2026-01-27 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/041/945578a83e6c4e0f8b45c73f0766e071/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:04 [ayvens.es] INFO: Found listing with ID: 1875061
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875061%27 HTTP/1.1" 200 None
2026-01-27 20:01:04 [ayvens.es] INFO: Scrape type for 1875061: 1
2026-01-27 20:01:04 [ayvens.es] INFO: Extracting data for car ID: 1875061
2026-01-27 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e244c63a-aa82-5b48-91bd-3761d94732eb with identifier: 1875061
2026-01-27 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e244c63a-aa82-5b48-91bd-3761d94732eb with scrape type 1
2026-01-27 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e244c63a-aa82-5b48-91bd-3761d94732eb
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F542%252F3550c2bf7e2b40179761cf0ec819e586%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/542/3550c2bf7e2b40179761cf0ec819e586/images/large/1.jpg not downloaded yet
2026-01-27 20:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2f36bddb-dbe5-5a92-a0bf-56e25850ac39 with identifier: 1875042
2026-01-27 20:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2f36bddb-dbe5-5a92-a0bf-56e25850ac39 with identifier: 1875042
2026-01-27 20:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2f36bddb-dbe5-5a92-a0bf-56e25850ac39 with identifier: 1875042 to the API
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/051/309df8edec7f402e8b59e298a7ea8900/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2f36bddb-dbe5-5a92-a0bf-56e25850ac39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 64231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f36bddb-dbe5-5a92-a0bf-56e25850ac39/2f36bddb-dbe5-5a92-a0bf-56e25850ac39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/051/309df8edec7f402e8b59e298a7ea8900/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW Titanium HEV AT SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW Titanium HEV AT SB',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875042%27 HTTP/1.1" 200 None
2026-01-27 20:01:04 [ayvens.es] INFO: Saving data for 1875042: {'created_time': 1769544064.85371, 'last_price_update_time': 1769544064.853726, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875042') HTTP/1.1" 204 0
2026-01-27 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/142/9944eb55c045423a91ce34cb892b8108/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/123/fa6f7631a29049688de1957abe5d77ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:04 [ayvens.es] INFO: Found listing with ID: 1875062
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875062%27 HTTP/1.1" 200 None
2026-01-27 20:01:04 [ayvens.es] INFO: Scrape type for 1875062: 1
2026-01-27 20:01:04 [ayvens.es] INFO: Extracting data for car ID: 1875062
2026-01-27 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef with identifier: 1875062
2026-01-27 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef with scrape type 1
2026-01-27 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F789%252F02e87b2fbcd74b91a8b0db951d4751cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/789/02e87b2fbcd74b91a8b0db951d4751cb/images/large/1.jpg not downloaded yet
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d6ed0>
2026-01-27 20:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2477195e-f4bb-57d1-8001-d177b548f041/2477195e-f4bb-57d1-8001-d177b548f041_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F513%252Fe19f65399d9c4d2c90b3c3e73c56e25d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/513/e19f65399d9c4d2c90b3c3e73c56e25d/images/large/1.jpg saved to cache
2026-01-27 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2477195e-f4bb-57d1-8001-d177b548f041
2026-01-27 20:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2477195e-f4bb-57d1-8001-d177b548f041, skipping ID generation
2026-01-27 20:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2477195e-f4bb-57d1-8001-d177b548f041 with scrape type 1
2026-01-27 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2477195e-f4bb-57d1-8001-d177b548f041 from tracking dictionaries
2026-01-27 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2477195e-f4bb-57d1-8001-d177b548f041 sending to next pipeline
2026-01-27 20:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2477195e-f4bb-57d1-8001-d177b548f041, identifier: 1875047
2026-01-27 20:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2477195e-f4bb-57d1-8001-d177b548f041 with identifier: 1875047
2026-01-27 20:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2477195e-f4bb-57d1-8001-d177b548f041 with identifier: 1875047
2026-01-27 20:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'rojo', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3 aircross', 'trim': 'puretech 81kw (110cv) s&s 6v live pack', 'title': 'citroën c3 aircross puretech 81kw (110cv) s&s 6v live pack', 'price': 0, 'odometer': 76622, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-30', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 141, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '2477195e-f4bb-57d1-8001-d177b548f041', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2477195e-f4bb-57d1-8001-d177b548f041/2477195e-f4bb-57d1-8001-d177b548f041_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/513/e19f65399d9c4d2c90b3c3e73c56e25d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 603891}], 'current_year_diff': 5, 'age_in_months': 48, 'make_model': 'citroën c3 aircross', 'sanitized_make': 'citron', 'odometer_in_km': 76622}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 141,
     'color': 'rojo',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '2477195e-f4bb-57d1-8001-d177b548f041',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c3 aircross',
     'model': 'c3 aircross',
     'odometer': 76622,
     'odometer_in_km': 76622,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2477195e-f4bb-57d1-8001-d177b548f041/2477195e-f4bb-57d1-8001-d177b548f041_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 603891,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/513/e19f65399d9c4d2c90b3c3e73c56e25d/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-30',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c3 aircross puretech 81kw (110cv) s&s 6v live pack',
     'transmission': 'manual',
     'trim': 'puretech 81kw (110cv) s&s 6v live pack',
     'vin': None,
     'year': 2021}
2026-01-27 20:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2477195e-f4bb-57d1-8001-d177b548f041 spider: ayvens.es
2026-01-27 20:01:05 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 2477195e-f4bb-57d1-8001-d177b548f041 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'rojo', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3 aircross', 'trim': 'puretech 81kw (110cv) s&s 6v live pack', 'title': 'citroën c3 aircross puretech 81kw (110cv) s&s 6v live pack', 'price': 0, 'odometer': 76622, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-30', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 141, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '2477195e-f4bb-57d1-8001-d177b548f041', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2477195e-f4bb-57d1-8001-d177b548f041/2477195e-f4bb-57d1-8001-d177b548f041_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/513/e19f65399d9c4d2c90b3c3e73c56e25d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 603891}], 'current_year_diff': 5, 'age_in_months': 48, 'make_model': 'citroën c3 aircross', 'sanitized_make': 'citron', 'odometer_in_km': 76622}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 141,
     'color': 'rojo',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '2477195e-f4bb-57d1-8001-d177b548f041',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c3 aircross',
     'model': 'c3 aircross',
     'odometer': 76622,
     'odometer_in_km': 76622,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2477195e-f4bb-57d1-8001-d177b548f041/2477195e-f4bb-57d1-8001-d177b548f041_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 603891,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/513/e19f65399d9c4d2c90b3c3e73c56e25d/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-30',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c3 aircross puretech 81kw (110cv) s&s 6v live pack',
     'transmission': 'manual',
     'trim': 'puretech 81kw (110cv) s&s 6v live pack',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2477195e-f4bb-57d1-8001-d177b548f041',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 76622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2477195e-f4bb-57d1-8001-d177b548f041/2477195e-f4bb-57d1-8001-d177b548f041_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/513/e19f65399d9c4d2c90b3c3e73c56e25d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS PureTech 81kW (110CV) S&S 6v Live Pack',
 'transmission': 'manual',
 'trim': 'PureTech 81kW (110CV) S&S 6v Live Pack',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875047%27 HTTP/1.1" 200 None
2026-01-27 20:01:05 [ayvens.es] INFO: Saving data for 1875047: {'created_time': 1769544065.584696, 'last_price_update_time': 1769544065.584706, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875047') HTTP/1.1" 204 0
2026-01-27 20:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/564/205fb9c038f547ba9e7001244a1ece40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/034/03637b70379c445c943ad6ddb545b69b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:05 [ayvens.es] INFO: Found listing with ID: 1875063
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875063%27 HTTP/1.1" 200 None
2026-01-27 20:01:05 [ayvens.es] INFO: Scrape type for 1875063: 1
2026-01-27 20:01:05 [ayvens.es] INFO: Extracting data for car ID: 1875063
2026-01-27 20:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a05ef645-e81b-58e8-978d-d99ac0a8476c with identifier: 1875063
2026-01-27 20:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a05ef645-e81b-58e8-978d-d99ac0a8476c with scrape type 1
2026-01-27 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a05ef645-e81b-58e8-978d-d99ac0a8476c
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F891%252F0e6f24d05a224e84bbdffddf12317994%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/891/0e6f24d05a224e84bbdffddf12317994/images/large/1.jpg not downloaded yet
2026-01-27 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570935bd0>
2026-01-27 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b854bb58-2c4c-5fa6-9f51-a7d210602116/b854bb58-2c4c-5fa6-9f51-a7d210602116_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F041%252F945578a83e6c4e0f8b45c73f0766e071%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/041/945578a83e6c4e0f8b45c73f0766e071/images/large/1.jpg saved to cache
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b854bb58-2c4c-5fa6-9f51-a7d210602116
2026-01-27 20:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b854bb58-2c4c-5fa6-9f51-a7d210602116, skipping ID generation
2026-01-27 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b854bb58-2c4c-5fa6-9f51-a7d210602116 with scrape type 1
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b854bb58-2c4c-5fa6-9f51-a7d210602116 from tracking dictionaries
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b854bb58-2c4c-5fa6-9f51-a7d210602116 sending to next pipeline
2026-01-27 20:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b854bb58-2c4c-5fa6-9f51-a7d210602116, identifier: 1875050
2026-01-27 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b854bb58-2c4c-5fa6-9f51-a7d210602116 with identifier: 1875050
2026-01-27 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b854bb58-2c4c-5fa6-9f51-a7d210602116 with identifier: 1875050
2026-01-27 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169503 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169503
2026-01-27 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b854bb58-2c4c-5fa6-9f51-a7d210602116 spider: ayvens.es
2026-01-27 20:01:06 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b854bb58-2c4c-5fa6-9f51-a7d210602116 due to rule: high_mileage_for_country.json, error: 169503 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169503
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b854bb58-2c4c-5fa6-9f51-a7d210602116',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 169503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b854bb58-2c4c-5fa6-9f51-a7d210602116/b854bb58-2c4c-5fa6-9f51-a7d210602116_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/041/945578a83e6c4e0f8b45c73f0766e071/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5p Business Line BlueHDi 73KW (100CV)',
 'transmission': 'manual',
 'trim': '5p Business Line BlueHDi 73KW (100CV)',
 'vin': None,
 'year': 2016}
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875050%27 HTTP/1.1" 200 None
2026-01-27 20:01:06 [ayvens.es] INFO: Saving data for 1875050: {'created_time': 1769544066.360878, 'last_price_update_time': 1769544066.360888, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875050') HTTP/1.1" 204 0
2026-01-27 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/623/7464c14f416948a2b495b31c92b97d22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/058/143ff137e19542fe9a3f566faaadb995/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:06 [ayvens.es] INFO: Found listing with ID: 1875064
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875064%27 HTTP/1.1" 200 None
2026-01-27 20:01:06 [ayvens.es] INFO: Scrape type for 1875064: 1
2026-01-27 20:01:06 [ayvens.es] INFO: Extracting data for car ID: 1875064
2026-01-27 20:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d37c68e-6f83-5e7e-a567-437453a1c952 with identifier: 1875064
2026-01-27 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d37c68e-6f83-5e7e-a567-437453a1c952 with scrape type 1
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d37c68e-6f83-5e7e-a567-437453a1c952
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F628%252Fa0b2cb428e1147dbbdd5c23d15f030cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/628/a0b2cb428e1147dbbdd5c23d15f030cf/images/large/1.jpg not downloaded yet
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d3710>
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baea1663-1a12-5577-b404-1b0355751e28/baea1663-1a12-5577-b404-1b0355751e28_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F9944eb55c045423a91ce34cb892b8108%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/9944eb55c045423a91ce34cb892b8108/images/large/1.jpg saved to cache
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baea1663-1a12-5577-b404-1b0355751e28
2026-01-27 20:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baea1663-1a12-5577-b404-1b0355751e28, skipping ID generation
2026-01-27 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baea1663-1a12-5577-b404-1b0355751e28 with scrape type 1
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item baea1663-1a12-5577-b404-1b0355751e28 from tracking dictionaries
2026-01-27 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baea1663-1a12-5577-b404-1b0355751e28 sending to next pipeline
2026-01-27 20:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: baea1663-1a12-5577-b404-1b0355751e28, identifier: 1875049
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572103c10>
2026-01-27 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c323ed6-d850-5928-95fc-babd5c35951e/5c323ed6-d850-5928-95fc-babd5c35951e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F123%252Ffa6f7631a29049688de1957abe5d77ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/123/fa6f7631a29049688de1957abe5d77ff/images/large/1.jpg saved to cache
2026-01-27 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c323ed6-d850-5928-95fc-babd5c35951e
2026-01-27 20:01:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c323ed6-d850-5928-95fc-babd5c35951e, skipping ID generation
2026-01-27 20:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c323ed6-d850-5928-95fc-babd5c35951e with scrape type 1
2026-01-27 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5c323ed6-d850-5928-95fc-babd5c35951e from tracking dictionaries
2026-01-27 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c323ed6-d850-5928-95fc-babd5c35951e sending to next pipeline
2026-01-27 20:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5c323ed6-d850-5928-95fc-babd5c35951e, identifier: 1875048
2026-01-27 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/688/fab0a99eb7f24248b06d01003c159251/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: baea1663-1a12-5577-b404-1b0355751e28 with identifier: 1875049
2026-01-27 20:01:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: baea1663-1a12-5577-b404-1b0355751e28 with identifier: 1875049
2026-01-27 20:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: baea1663-1a12-5577-b404-1b0355751e28 with identifier: 1875049 to the API
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/142/9944eb55c045423a91ce34cb892b8108/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'baea1663-1a12-5577-b404-1b0355751e28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 60608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baea1663-1a12-5577-b404-1b0355751e28/baea1663-1a12-5577-b404-1b0355751e28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/142/9944eb55c045423a91ce34cb892b8108/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875049%27 HTTP/1.1" 200 None
2026-01-27 20:01:07 [ayvens.es] INFO: Saving data for 1875049: {'created_time': 1769544067.828918, 'last_price_update_time': 1769544067.82893, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875049') HTTP/1.1" 204 0
2026-01-27 20:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5c323ed6-d850-5928-95fc-babd5c35951e with identifier: 1875048
2026-01-27 20:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5c323ed6-d850-5928-95fc-babd5c35951e with identifier: 1875048
2026-01-27 20:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5c323ed6-d850-5928-95fc-babd5c35951e with identifier: 1875048 to the API
2026-01-27 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/123/fa6f7631a29049688de1957abe5d77ff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5c323ed6-d850-5928-95fc-babd5c35951e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 41579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c323ed6-d850-5928-95fc-babd5c35951e/5c323ed6-d850-5928-95fc-babd5c35951e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/123/fa6f7631a29049688de1957abe5d77ff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875048%27 HTTP/1.1" 200 None
2026-01-27 20:01:08 [ayvens.es] INFO: Saving data for 1875048: {'created_time': 1769544068.173058, 'last_price_update_time': 1769544068.173069, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875048') HTTP/1.1" 204 0
2026-01-27 20:01:08 [ayvens.es] INFO: Found listing with ID: 1875065
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875065%27 HTTP/1.1" 200 None
2026-01-27 20:01:08 [ayvens.es] INFO: Scrape type for 1875065: 1
2026-01-27 20:01:08 [ayvens.es] INFO: Extracting data for car ID: 1875065
2026-01-27 20:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5326201f-5c32-5aa8-93b4-78f78487973d with identifier: 1875065
2026-01-27 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5326201f-5c32-5aa8-93b4-78f78487973d with scrape type 1
2026-01-27 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5326201f-5c32-5aa8-93b4-78f78487973d
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F5715b2510ddb498e9c5ca94127a512ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/5715b2510ddb498e9c5ca94127a512ae/images/large/1.jpg not downloaded yet
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a9c790>
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490ffc4c-c34d-5960-9b7c-1158d831774c/490ffc4c-c34d-5960-9b7c-1158d831774c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F564%252F205fb9c038f547ba9e7001244a1ece40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/564/205fb9c038f547ba9e7001244a1ece40/images/large/1.jpg saved to cache
2026-01-27 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 490ffc4c-c34d-5960-9b7c-1158d831774c
2026-01-27 20:01:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 490ffc4c-c34d-5960-9b7c-1158d831774c, skipping ID generation
2026-01-27 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490ffc4c-c34d-5960-9b7c-1158d831774c with scrape type 1
2026-01-27 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 490ffc4c-c34d-5960-9b7c-1158d831774c from tracking dictionaries
2026-01-27 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 490ffc4c-c34d-5960-9b7c-1158d831774c sending to next pipeline
2026-01-27 20:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 490ffc4c-c34d-5960-9b7c-1158d831774c, identifier: 1875046
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57228bb50>
2026-01-27 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31e03e4-129a-527d-9a43-b752d5627d58/b31e03e4-129a-527d-9a43-b752d5627d58_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F03637b70379c445c943ad6ddb545b69b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/03637b70379c445c943ad6ddb545b69b/images/large/1.jpg saved to cache
2026-01-27 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b31e03e4-129a-527d-9a43-b752d5627d58
2026-01-27 20:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b31e03e4-129a-527d-9a43-b752d5627d58, skipping ID generation
2026-01-27 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31e03e4-129a-527d-9a43-b752d5627d58 with scrape type 1
2026-01-27 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b31e03e4-129a-527d-9a43-b752d5627d58 from tracking dictionaries
2026-01-27 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b31e03e4-129a-527d-9a43-b752d5627d58 sending to next pipeline
2026-01-27 20:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b31e03e4-129a-527d-9a43-b752d5627d58, identifier: 1875052
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a9e950>
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2674345-9f9f-519c-afb1-8f95da7388a7/b2674345-9f9f-519c-afb1-8f95da7388a7_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F623%252F7464c14f416948a2b495b31c92b97d22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/623/7464c14f416948a2b495b31c92b97d22/images/large/1.jpg saved to cache
2026-01-27 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2674345-9f9f-519c-afb1-8f95da7388a7
2026-01-27 20:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2674345-9f9f-519c-afb1-8f95da7388a7, skipping ID generation
2026-01-27 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2674345-9f9f-519c-afb1-8f95da7388a7 with scrape type 1
2026-01-27 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2674345-9f9f-519c-afb1-8f95da7388a7 from tracking dictionaries
2026-01-27 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2674345-9f9f-519c-afb1-8f95da7388a7 sending to next pipeline
2026-01-27 20:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2674345-9f9f-519c-afb1-8f95da7388a7, identifier: 1875051
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a7e590>
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9082ff7-6cac-5efb-89d5-083c94297770/d9082ff7-6cac-5efb-89d5-083c94297770_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F058%252F143ff137e19542fe9a3f566faaadb995%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/058/143ff137e19542fe9a3f566faaadb995/images/large/1.jpg saved to cache
2026-01-27 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9082ff7-6cac-5efb-89d5-083c94297770
2026-01-27 20:01:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9082ff7-6cac-5efb-89d5-083c94297770, skipping ID generation
2026-01-27 20:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9082ff7-6cac-5efb-89d5-083c94297770 with scrape type 1
2026-01-27 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d9082ff7-6cac-5efb-89d5-083c94297770 from tracking dictionaries
2026-01-27 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9082ff7-6cac-5efb-89d5-083c94297770 sending to next pipeline
2026-01-27 20:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d9082ff7-6cac-5efb-89d5-083c94297770, identifier: 1875053
2026-01-27 20:01:10 [ayvens.es] INFO: Found listing with ID: 1875066
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875066%27 HTTP/1.1" 200 None
2026-01-27 20:01:10 [ayvens.es] INFO: Scrape type for 1875066: 1
2026-01-27 20:01:10 [ayvens.es] INFO: Extracting data for car ID: 1875066
2026-01-27 20:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e with identifier: 1875066
2026-01-27 20:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e with scrape type 1
2026-01-27 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252Ff5ed01387d8142298262b3894634f975%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/f5ed01387d8142298262b3894634f975/images/large/1.jpg not downloaded yet
2026-01-27 20:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 490ffc4c-c34d-5960-9b7c-1158d831774c with identifier: 1875046
2026-01-27 20:01:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 490ffc4c-c34d-5960-9b7c-1158d831774c with identifier: 1875046
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137874 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137874
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 490ffc4c-c34d-5960-9b7c-1158d831774c spider: ayvens.es
2026-01-27 20:01:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 490ffc4c-c34d-5960-9b7c-1158d831774c due to rule: high_mileage_for_make.json, error: 137874 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137874
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '490ffc4c-c34d-5960-9b7c-1158d831774c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 137874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490ffc4c-c34d-5960-9b7c-1158d831774c/490ffc4c-c34d-5960-9b7c-1158d831774c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/564/205fb9c038f547ba9e7001244a1ece40/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 1.2 8v 51kW (69CV) Lounge',
 'transmission': 'manual',
 'trim': '1.2 8v 51kW (69CV) Lounge',
 'vin': None,
 'year': 2017}
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875046%27 HTTP/1.1" 200 None
2026-01-27 20:01:10 [ayvens.es] INFO: Saving data for 1875046: {'created_time': 1769544070.392056, 'last_price_update_time': 1769544070.392067, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875046') HTTP/1.1" 204 0
2026-01-27 20:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b31e03e4-129a-527d-9a43-b752d5627d58 with identifier: 1875052
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b31e03e4-129a-527d-9a43-b752d5627d58 with identifier: 1875052
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174583 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174583
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b31e03e4-129a-527d-9a43-b752d5627d58 spider: ayvens.es
2026-01-27 20:01:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b31e03e4-129a-527d-9a43-b752d5627d58 due to rule: high_mileage_for_country.json, error: 174583 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174583
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b31e03e4-129a-527d-9a43-b752d5627d58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 174583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31e03e4-129a-527d-9a43-b752d5627d58/b31e03e4-129a-527d-9a43-b752d5627d58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/034/03637b70379c445c943ad6ddb545b69b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': '(O) Business Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875052%27 HTTP/1.1" 200 None
2026-01-27 20:01:10 [ayvens.es] INFO: Saving data for 1875052: {'created_time': 1769544070.726582, 'last_price_update_time': 1769544070.726598, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875052') HTTP/1.1" 204 0
2026-01-27 20:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2674345-9f9f-519c-afb1-8f95da7388a7 with identifier: 1875051
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2674345-9f9f-519c-afb1-8f95da7388a7 with identifier: 1875051
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'opel', 'model': 'astra', 'trim': '(o) 1.6 cdti s/s 81kw (110cv) selective pro', 'title': 'opel astra (o) 1.6 cdti s/s 81kw (110cv) selective pro', 'price': 0, 'odometer': 212875, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-12', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.6l', 'c_o_2_emission_value': 107, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'b2674345-9f9f-519c-afb1-8f95da7388a7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2674345-9f9f-519c-afb1-8f95da7388a7/b2674345-9f9f-519c-afb1-8f95da7388a7_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/623/7464c14f416948a2b495b31c92b97d22/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 497533}], 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'opel astra', 'sanitized_make': 'opel', 'odometer_in_km': 212875}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 107,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.6l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'b2674345-9f9f-519c-afb1-8f95da7388a7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'opel',
     'make_model': 'opel astra',
     'model': 'astra',
     'odometer': 212875,
     'odometer_in_km': 212875,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2674345-9f9f-519c-afb1-8f95da7388a7/b2674345-9f9f-519c-afb1-8f95da7388a7_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 497533,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/623/7464c14f416948a2b495b31c92b97d22/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-12',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel astra (o) 1.6 cdti s/s 81kw (110cv) selective pro',
     'transmission': 'manual',
     'trim': '(o) 1.6 cdti s/s 81kw (110cv) selective pro',
     'vin': None,
     'year': 2019}
2026-01-27 20:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: b2674345-9f9f-519c-afb1-8f95da7388a7 spider: ayvens.es
2026-01-27 20:01:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b2674345-9f9f-519c-afb1-8f95da7388a7 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'opel', 'model': 'astra', 'trim': '(o) 1.6 cdti s/s 81kw (110cv) selective pro', 'title': 'opel astra (o) 1.6 cdti s/s 81kw (110cv) selective pro', 'price': 0, 'odometer': 212875, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-12', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.6l', 'c_o_2_emission_value': 107, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'b2674345-9f9f-519c-afb1-8f95da7388a7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2674345-9f9f-519c-afb1-8f95da7388a7/b2674345-9f9f-519c-afb1-8f95da7388a7_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/623/7464c14f416948a2b495b31c92b97d22/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 497533}], 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'opel astra', 'sanitized_make': 'opel', 'odometer_in_km': 212875}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 107,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.6l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'b2674345-9f9f-519c-afb1-8f95da7388a7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'opel',
     'make_model': 'opel astra',
     'model': 'astra',
     'odometer': 212875,
     'odometer_in_km': 212875,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2674345-9f9f-519c-afb1-8f95da7388a7/b2674345-9f9f-519c-afb1-8f95da7388a7_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 497533,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/623/7464c14f416948a2b495b31c92b97d22/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-12',
     'sanitized_make': 'opel',
     'seats_number': 5,
     'seller_name': None,
     'title': 'opel astra (o) 1.6 cdti s/s 81kw (110cv) selective pro',
     'transmission': 'manual',
     'trim': '(o) 1.6 cdti s/s 81kw (110cv) selective pro',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2674345-9f9f-519c-afb1-8f95da7388a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA',
 'odometer': 212875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2674345-9f9f-519c-afb1-8f95da7388a7/b2674345-9f9f-519c-afb1-8f95da7388a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/623/7464c14f416948a2b495b31c92b97d22/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA (O) 1.6 CDTi S/S 81kW (110CV) Selective Pro',
 'transmission': 'manual',
 'trim': '(O) 1.6 CDTi S/S 81kW (110CV) Selective Pro',
 'vin': None,
 'year': 2019}
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875051%27 HTTP/1.1" 200 None
2026-01-27 20:01:11 [ayvens.es] INFO: Saving data for 1875051: {'created_time': 1769544071.04132, 'last_price_update_time': 1769544071.041332, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875051') HTTP/1.1" 204 0
2026-01-27 20:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d9082ff7-6cac-5efb-89d5-083c94297770 with identifier: 1875053
2026-01-27 20:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d9082ff7-6cac-5efb-89d5-083c94297770 with identifier: 1875053
2026-01-27 20:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d9082ff7-6cac-5efb-89d5-083c94297770 with identifier: 1875053 to the API
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/058/143ff137e19542fe9a3f566faaadb995/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd9082ff7-6cac-5efb-89d5-083c94297770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 120176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9082ff7-6cac-5efb-89d5-083c94297770/d9082ff7-6cac-5efb-89d5-083c94297770_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/058/143ff137e19542fe9a3f566faaadb995/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 300 de 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 de 4MATIC',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875053%27 HTTP/1.1" 200 None
2026-01-27 20:01:11 [ayvens.es] INFO: Saving data for 1875053: {'created_time': 1769544071.45946, 'last_price_update_time': 1769544071.459473, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875053') HTTP/1.1" 204 0
2026-01-27 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/077/73f80a8a246040d0a135ea11d4217373/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57092b3d0>
2026-01-27 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a0d771-b4e7-5652-8d78-4f76b6c553b9/67a0d771-b4e7-5652-8d78-4f76b6c553b9_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252Ffab0a99eb7f24248b06d01003c159251%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/fab0a99eb7f24248b06d01003c159251/images/large/1.jpg saved to cache
2026-01-27 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67a0d771-b4e7-5652-8d78-4f76b6c553b9
2026-01-27 20:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67a0d771-b4e7-5652-8d78-4f76b6c553b9, skipping ID generation
2026-01-27 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a0d771-b4e7-5652-8d78-4f76b6c553b9 with scrape type 1
2026-01-27 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67a0d771-b4e7-5652-8d78-4f76b6c553b9 from tracking dictionaries
2026-01-27 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67a0d771-b4e7-5652-8d78-4f76b6c553b9 sending to next pipeline
2026-01-27 20:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 67a0d771-b4e7-5652-8d78-4f76b6c553b9, identifier: 1875044
2026-01-27 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/150/0432b414b5564b068cab8352a0eac02f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:12 [ayvens.es] INFO: Found listing with ID: 1875067
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875067%27 HTTP/1.1" 200 None
2026-01-27 20:01:12 [ayvens.es] INFO: Scrape type for 1875067: 1
2026-01-27 20:01:12 [ayvens.es] INFO: Extracting data for car ID: 1875067
2026-01-27 20:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa with identifier: 1875067
2026-01-27 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa with scrape type 1
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252Fb33a5e47a7cc4138990eb30c1e08296d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/b33a5e47a7cc4138990eb30c1e08296d/images/large/1.jpg not downloaded yet
2026-01-27 20:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 67a0d771-b4e7-5652-8d78-4f76b6c553b9 with identifier: 1875044
2026-01-27 20:01:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 67a0d771-b4e7-5652-8d78-4f76b6c553b9 with identifier: 1875044
2026-01-27 20:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 67a0d771-b4e7-5652-8d78-4f76b6c553b9 with identifier: 1875044 to the API
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/688/fab0a99eb7f24248b06d01003c159251/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '67a0d771-b4e7-5652-8d78-4f76b6c553b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 62010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a0d771-b4e7-5652-8d78-4f76b6c553b9/67a0d771-b4e7-5652-8d78-4f76b6c553b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/688/fab0a99eb7f24248b06d01003c159251/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18i',
 'transmission': 'manual',
 'trim': 'sDrive18i',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875044%27 HTTP/1.1" 200 None
2026-01-27 20:01:12 [ayvens.es] INFO: Saving data for 1875044: {'created_time': 1769544072.387791, 'last_price_update_time': 1769544072.387801, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875044') HTTP/1.1" 204 0
2026-01-27 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/196/d2eb5ecba71c4830af83fc0e7e98749a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/693/9a5bb1ef22ab4948a630b1890b613f61/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:12 [ayvens.es] INFO: Found listing with ID: 1875068
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875068%27 HTTP/1.1" 200 None
2026-01-27 20:01:12 [ayvens.es] INFO: Scrape type for 1875068: 1
2026-01-27 20:01:12 [ayvens.es] INFO: Extracting data for car ID: 1875068
2026-01-27 20:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a with identifier: 1875068
2026-01-27 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a with scrape type 1
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F489%252F0b1d30f71f554b5eb85e77fd34b7c395%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/489/0b1d30f71f554b5eb85e77fd34b7c395/images/large/1.jpg not downloaded yet
2026-01-27 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/074/7c7399fee2b44cccbd555bdb421df597/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/519/09bea7bf803a4717a222e2ea06e07883/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/246/9310208026cc49279a6ab57ec8c6250d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:12 [ayvens.es] INFO: Found listing with ID: 1875069
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875069%27 HTTP/1.1" 200 None
2026-01-27 20:01:12 [ayvens.es] INFO: Scrape type for 1875069: 1
2026-01-27 20:01:12 [ayvens.es] INFO: Extracting data for car ID: 1875069
2026-01-27 20:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e2a97bd-3b87-552e-baf2-4ef6a7695214 with identifier: 1875069
2026-01-27 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e2a97bd-3b87-552e-baf2-4ef6a7695214 with scrape type 1
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5e2a97bd-3b87-552e-baf2-4ef6a7695214
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F413%252Ffd29268166074b61816c2828e397c3ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/413/fd29268166074b61816c2828e397c3ee/images/large/1.jpg not downloaded yet
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722e1ed0>
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33a19977-81b3-56dc-99d7-041c3dc3b0b2/33a19977-81b3-56dc-99d7-041c3dc3b0b2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F077%252F73f80a8a246040d0a135ea11d4217373%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/077/73f80a8a246040d0a135ea11d4217373/images/large/1.jpg saved to cache
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33a19977-81b3-56dc-99d7-041c3dc3b0b2
2026-01-27 20:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33a19977-81b3-56dc-99d7-041c3dc3b0b2, skipping ID generation
2026-01-27 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33a19977-81b3-56dc-99d7-041c3dc3b0b2 with scrape type 1
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 33a19977-81b3-56dc-99d7-041c3dc3b0b2 from tracking dictionaries
2026-01-27 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33a19977-81b3-56dc-99d7-041c3dc3b0b2 sending to next pipeline
2026-01-27 20:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 33a19977-81b3-56dc-99d7-041c3dc3b0b2, identifier: 1875054
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5723f0990>
2026-01-27 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f657ec-6428-570d-b685-eb88f2060162/30f657ec-6428-570d-b685-eb88f2060162_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252F0432b414b5564b068cab8352a0eac02f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/0432b414b5564b068cab8352a0eac02f/images/large/1.jpg saved to cache
2026-01-27 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30f657ec-6428-570d-b685-eb88f2060162
2026-01-27 20:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30f657ec-6428-570d-b685-eb88f2060162, skipping ID generation
2026-01-27 20:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f657ec-6428-570d-b685-eb88f2060162 with scrape type 1
2026-01-27 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30f657ec-6428-570d-b685-eb88f2060162 from tracking dictionaries
2026-01-27 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30f657ec-6428-570d-b685-eb88f2060162 sending to next pipeline
2026-01-27 20:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 30f657ec-6428-570d-b685-eb88f2060162, identifier: 1875057
2026-01-27 20:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 33a19977-81b3-56dc-99d7-041c3dc3b0b2 with identifier: 1875054
2026-01-27 20:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 33a19977-81b3-56dc-99d7-041c3dc3b0b2 with identifier: 1875054
2026-01-27 20:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 33a19977-81b3-56dc-99d7-041c3dc3b0b2 with identifier: 1875054 to the API
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/077/73f80a8a246040d0a135ea11d4217373/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Naranja',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '33a19977-81b3-56dc-99d7-041c3dc3b0b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 35731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33a19977-81b3-56dc-99d7-041c3dc3b0b2/33a19977-81b3-56dc-99d7-041c3dc3b0b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/077/73f80a8a246040d0a135ea11d4217373/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2023}
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875054%27 HTTP/1.1" 200 None
2026-01-27 20:01:13 [ayvens.es] INFO: Saving data for 1875054: {'created_time': 1769544073.789959, 'last_price_update_time': 1769544073.789973, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875054') HTTP/1.1" 204 0
2026-01-27 20:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 30f657ec-6428-570d-b685-eb88f2060162 with identifier: 1875057
2026-01-27 20:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 30f657ec-6428-570d-b685-eb88f2060162 with identifier: 1875057
2026-01-27 20:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 30f657ec-6428-570d-b685-eb88f2060162 with identifier: 1875057 to the API
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/150/0432b414b5564b068cab8352a0eac02f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '30f657ec-6428-570d-b685-eb88f2060162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 66161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f657ec-6428-570d-b685-eb88f2060162/30f657ec-6428-570d-b685-eb88f2060162_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/150/0432b414b5564b068cab8352a0eac02f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875057%27 HTTP/1.1" 200 None
2026-01-27 20:01:14 [ayvens.es] INFO: Saving data for 1875057: {'created_time': 1769544074.316705, 'last_price_update_time': 1769544074.316718, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875057') HTTP/1.1" 204 0
2026-01-27 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/284/1af96e017b41470bb9e3213541c8b25f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:14 [ayvens.es] INFO: Found listing with ID: 1875070
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875070%27 HTTP/1.1" 200 None
2026-01-27 20:01:14 [ayvens.es] INFO: Scrape type for 1875070: 1
2026-01-27 20:01:14 [ayvens.es] INFO: Extracting data for car ID: 1875070
2026-01-27 20:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2eebc9a-dcb5-5dad-88a8-c730b84b1c47 with identifier: 1875070
2026-01-27 20:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2eebc9a-dcb5-5dad-88a8-c730b84b1c47 with scrape type 1
2026-01-27 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2eebc9a-dcb5-5dad-88a8-c730b84b1c47
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252Fcecb8f1d37b1471f921d75780d0c307d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/cecb8f1d37b1471f921d75780d0c307d/images/large/1.jpg not downloaded yet
2026-01-27 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/991/4d19e44265b24ef485ddc2fa359003f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:14 [ayvens.es] INFO: Found listing with ID: 1875071
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875071%27 HTTP/1.1" 200 None
2026-01-27 20:01:14 [ayvens.es] INFO: Scrape type for 1875071: 1
2026-01-27 20:01:14 [ayvens.es] INFO: Extracting data for car ID: 1875071
2026-01-27 20:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a639b275-467f-5964-a125-11ea4007cbf3 with identifier: 1875071
2026-01-27 20:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a639b275-467f-5964-a125-11ea4007cbf3 with scrape type 1
2026-01-27 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a639b275-467f-5964-a125-11ea4007cbf3
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F262%252Ff55ad53a759a4cf6a7332f0b9f812eab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/262/f55ad53a759a4cf6a7332f0b9f812eab/images/large/1.jpg not downloaded yet
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57224e710>
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce42cec7-b3a5-5ed3-9926-69b511008d98/ce42cec7-b3a5-5ed3-9926-69b511008d98_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F196%252Fd2eb5ecba71c4830af83fc0e7e98749a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/196/d2eb5ecba71c4830af83fc0e7e98749a/images/large/1.jpg saved to cache
2026-01-27 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce42cec7-b3a5-5ed3-9926-69b511008d98
2026-01-27 20:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce42cec7-b3a5-5ed3-9926-69b511008d98, skipping ID generation
2026-01-27 20:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce42cec7-b3a5-5ed3-9926-69b511008d98 with scrape type 1
2026-01-27 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ce42cec7-b3a5-5ed3-9926-69b511008d98 from tracking dictionaries
2026-01-27 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce42cec7-b3a5-5ed3-9926-69b511008d98 sending to next pipeline
2026-01-27 20:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce42cec7-b3a5-5ed3-9926-69b511008d98, identifier: 1875055
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721295d0>
2026-01-27 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c0c6025-7cfb-5724-bbb5-78841bd5ce6e/2c0c6025-7cfb-5724-bbb5-78841bd5ce6e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252F9a5bb1ef22ab4948a630b1890b613f61%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/9a5bb1ef22ab4948a630b1890b613f61/images/large/1.jpg saved to cache
2026-01-27 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e
2026-01-27 20:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e, skipping ID generation
2026-01-27 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e with scrape type 1
2026-01-27 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e from tracking dictionaries
2026-01-27 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e sending to next pipeline
2026-01-27 20:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e, identifier: 1875056
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57220c110>
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9225e28-c339-563d-9e9c-337e3d0aae65/f9225e28-c339-563d-9e9c-337e3d0aae65_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F074%252F7c7399fee2b44cccbd555bdb421df597%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/074/7c7399fee2b44cccbd555bdb421df597/images/large/1.jpg saved to cache
2026-01-27 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9225e28-c339-563d-9e9c-337e3d0aae65
2026-01-27 20:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9225e28-c339-563d-9e9c-337e3d0aae65, skipping ID generation
2026-01-27 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9225e28-c339-563d-9e9c-337e3d0aae65 with scrape type 1
2026-01-27 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f9225e28-c339-563d-9e9c-337e3d0aae65 from tracking dictionaries
2026-01-27 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9225e28-c339-563d-9e9c-337e3d0aae65 sending to next pipeline
2026-01-27 20:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f9225e28-c339-563d-9e9c-337e3d0aae65, identifier: 1875043
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57224f690>
2026-01-27 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6579074-acdb-50af-93ea-7737921c125f/e6579074-acdb-50af-93ea-7737921c125f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F519%252F09bea7bf803a4717a222e2ea06e07883%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/519/09bea7bf803a4717a222e2ea06e07883/images/large/1.jpg saved to cache
2026-01-27 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6579074-acdb-50af-93ea-7737921c125f
2026-01-27 20:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6579074-acdb-50af-93ea-7737921c125f, skipping ID generation
2026-01-27 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6579074-acdb-50af-93ea-7737921c125f with scrape type 1
2026-01-27 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e6579074-acdb-50af-93ea-7737921c125f from tracking dictionaries
2026-01-27 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6579074-acdb-50af-93ea-7737921c125f sending to next pipeline
2026-01-27 20:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e6579074-acdb-50af-93ea-7737921c125f, identifier: 1875041
2026-01-27 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572206a90>
2026-01-27 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8613d806-2f73-517d-8a2d-6978d649c25c/8613d806-2f73-517d-8a2d-6978d649c25c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F246%252F9310208026cc49279a6ab57ec8c6250d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/246/9310208026cc49279a6ab57ec8c6250d/images/large/1.jpg saved to cache
2026-01-27 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8613d806-2f73-517d-8a2d-6978d649c25c
2026-01-27 20:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8613d806-2f73-517d-8a2d-6978d649c25c, skipping ID generation
2026-01-27 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8613d806-2f73-517d-8a2d-6978d649c25c with scrape type 1
2026-01-27 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8613d806-2f73-517d-8a2d-6978d649c25c from tracking dictionaries
2026-01-27 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8613d806-2f73-517d-8a2d-6978d649c25c sending to next pipeline
2026-01-27 20:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8613d806-2f73-517d-8a2d-6978d649c25c, identifier: 1875058
2026-01-27 20:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce42cec7-b3a5-5ed3-9926-69b511008d98 with identifier: 1875055
2026-01-27 20:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce42cec7-b3a5-5ed3-9926-69b511008d98 with identifier: 1875055
2026-01-27 20:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce42cec7-b3a5-5ed3-9926-69b511008d98 with identifier: 1875055 to the API
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/196/d2eb5ecba71c4830af83fc0e7e98749a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ce42cec7-b3a5-5ed3-9926-69b511008d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 85398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce42cec7-b3a5-5ed3-9926-69b511008d98/ce42cec7-b3a5-5ed3-9926-69b511008d98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/196/d2eb5ecba71c4830af83fc0e7e98749a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 200',
 'transmission': 'manual',
 'trim': 'C 200',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875055%27 HTTP/1.1" 200 None
2026-01-27 20:01:16 [ayvens.es] INFO: Saving data for 1875055: {'created_time': 1769544076.980624, 'last_price_update_time': 1769544076.980637, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875055') HTTP/1.1" 204 0
2026-01-27 20:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e with identifier: 1875056
2026-01-27 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e with identifier: 1875056
2026-01-27 20:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2c0c6025-7cfb-5724-bbb5-78841bd5ce6e with identifier: 1875056 to the API
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/693/9a5bb1ef22ab4948a630b1890b613f61/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2c0c6025-7cfb-5724-bbb5-78841bd5ce6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 51525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c0c6025-7cfb-5724-bbb5-78841bd5ce6e/2c0c6025-7cfb-5724-bbb5-78841bd5ce6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/693/9a5bb1ef22ab4948a630b1890b613f61/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875056%27 HTTP/1.1" 200 None
2026-01-27 20:01:17 [ayvens.es] INFO: Saving data for 1875056: {'created_time': 1769544077.394561, 'last_price_update_time': 1769544077.394571, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875056') HTTP/1.1" 204 0
2026-01-27 20:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f9225e28-c339-563d-9e9c-337e3d0aae65 with identifier: 1875043
2026-01-27 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f9225e28-c339-563d-9e9c-337e3d0aae65 with identifier: 1875043
2026-01-27 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 37645, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-14', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'f9225e28-c339-563d-9e9c-337e3d0aae65', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9225e28-c339-563d-9e9c-337e3d0aae65/f9225e28-c339-563d-9e9c-337e3d0aae65_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/7c7399fee2b44cccbd555bdb421df597/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 458385}], 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 37645}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'f9225e28-c339-563d-9e9c-337e3d0aae65',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 37645,
     'odometer_in_km': 37645,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9225e28-c339-563d-9e9c-337e3d0aae65/f9225e28-c339-563d-9e9c-337e3d0aae65_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 458385,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/7c7399fee2b44cccbd555bdb421df597/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
2026-01-27 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f9225e28-c339-563d-9e9c-337e3d0aae65 spider: ayvens.es
2026-01-27 20:01:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: f9225e28-c339-563d-9e9c-337e3d0aae65 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 37645, 'odometer_reading_unit': 'km', 'registration_date': '2020-10-14', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'f9225e28-c339-563d-9e9c-337e3d0aae65', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9225e28-c339-563d-9e9c-337e3d0aae65/f9225e28-c339-563d-9e9c-337e3d0aae65_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/7c7399fee2b44cccbd555bdb421df597/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 458385}], 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 37645}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'f9225e28-c339-563d-9e9c-337e3d0aae65',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 37645,
     'odometer_in_km': 37645,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9225e28-c339-563d-9e9c-337e3d0aae65/f9225e28-c339-563d-9e9c-337e3d0aae65_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 458385,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/7c7399fee2b44cccbd555bdb421df597/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-10-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f9225e28-c339-563d-9e9c-337e3d0aae65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 37645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9225e28-c339-563d-9e9c-337e3d0aae65/f9225e28-c339-563d-9e9c-337e3d0aae65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/074/7c7399fee2b44cccbd555bdb421df597/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875043%27 HTTP/1.1" 200 None
2026-01-27 20:01:17 [ayvens.es] INFO: Saving data for 1875043: {'created_time': 1769544077.65047, 'last_price_update_time': 1769544077.650483, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875043') HTTP/1.1" 204 0
2026-01-27 20:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e6579074-acdb-50af-93ea-7737921c125f with identifier: 1875041
2026-01-27 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e6579074-acdb-50af-93ea-7737921c125f with identifier: 1875041
2026-01-27 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '308', 'trim': 'business line 1.2 puretech 81kw (110cv)', 'title': 'peugeot 308 business line 1.2 puretech 81kw (110cv)', 'price': 0, 'odometer': 114992, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-14', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 106, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e6579074-acdb-50af-93ea-7737921c125f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6579074-acdb-50af-93ea-7737921c125f/e6579074-acdb-50af-93ea-7737921c125f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/519/09bea7bf803a4717a222e2ea06e07883/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 325414}], 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 114992}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'e6579074-acdb-50af-93ea-7737921c125f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 114992,
     'odometer_in_km': 114992,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6579074-acdb-50af-93ea-7737921c125f/e6579074-acdb-50af-93ea-7737921c125f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 325414,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/519/09bea7bf803a4717a222e2ea06e07883/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 business line 1.2 puretech 81kw (110cv)',
     'transmission': 'manual',
     'trim': 'business line 1.2 puretech 81kw (110cv)',
     'vin': None,
     'year': 2019}
2026-01-27 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e6579074-acdb-50af-93ea-7737921c125f spider: ayvens.es
2026-01-27 20:01:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e6579074-acdb-50af-93ea-7737921c125f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '308', 'trim': 'business line 1.2 puretech 81kw (110cv)', 'title': 'peugeot 308 business line 1.2 puretech 81kw (110cv)', 'price': 0, 'odometer': 114992, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-14', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 106, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e6579074-acdb-50af-93ea-7737921c125f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6579074-acdb-50af-93ea-7737921c125f/e6579074-acdb-50af-93ea-7737921c125f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/519/09bea7bf803a4717a222e2ea06e07883/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 325414}], 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 114992}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 106,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'e6579074-acdb-50af-93ea-7737921c125f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 114992,
     'odometer_in_km': 114992,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6579074-acdb-50af-93ea-7737921c125f/e6579074-acdb-50af-93ea-7737921c125f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 325414,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/519/09bea7bf803a4717a222e2ea06e07883/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-14',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 business line 1.2 puretech 81kw (110cv)',
     'transmission': 'manual',
     'trim': 'business line 1.2 puretech 81kw (110cv)',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e6579074-acdb-50af-93ea-7737921c125f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 114992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6579074-acdb-50af-93ea-7737921c125f/e6579074-acdb-50af-93ea-7737921c125f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/519/09bea7bf803a4717a222e2ea06e07883/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 Business Line 1.2 PureTech 81KW (110CV)',
 'transmission': 'manual',
 'trim': 'Business Line 1.2 PureTech 81KW (110CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875041%27 HTTP/1.1" 200 None
2026-01-27 20:01:17 [ayvens.es] INFO: Saving data for 1875041: {'created_time': 1769544077.888109, 'last_price_update_time': 1769544077.888121, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875041') HTTP/1.1" 204 0
2026-01-27 20:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8613d806-2f73-517d-8a2d-6978d649c25c with identifier: 1875058
2026-01-27 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8613d806-2f73-517d-8a2d-6978d649c25c with identifier: 1875058
2026-01-27 20:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 196753 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196753
2026-01-27 20:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8613d806-2f73-517d-8a2d-6978d649c25c spider: ayvens.es
2026-01-27 20:01:18 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 8613d806-2f73-517d-8a2d-6978d649c25c due to rule: high_mileage_for_country.json, error: 196753 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196753
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8613d806-2f73-517d-8a2d-6978d649c25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 196753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8613d806-2f73-517d-8a2d-6978d649c25c/8613d806-2f73-517d-8a2d-6978d649c25c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/246/9310208026cc49279a6ab57ec8c6250d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875058%27 HTTP/1.1" 200 None
2026-01-27 20:01:18 [ayvens.es] INFO: Saving data for 1875058: {'created_time': 1769544078.157824, 'last_price_update_time': 1769544078.157836, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875058') HTTP/1.1" 204 0
2026-01-27 20:01:18 [ayvens.es] INFO: Found listing with ID: 1875072
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875072%27 HTTP/1.1" 200 None
2026-01-27 20:01:18 [ayvens.es] INFO: Scrape type for 1875072: 1
2026-01-27 20:01:18 [ayvens.es] INFO: Extracting data for car ID: 1875072
2026-01-27 20:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f5029a5-def8-5329-ba1e-6d5385af7001 with identifier: 1875072
2026-01-27 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f5029a5-def8-5329-ba1e-6d5385af7001 with scrape type 1
2026-01-27 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8f5029a5-def8-5329-ba1e-6d5385af7001
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F332%252F865158d24b26409ebd3f8547b34877af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/332/865158d24b26409ebd3f8547b34877af/images/large/1.jpg not downloaded yet
2026-01-27 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/542/3550c2bf7e2b40179761cf0ec819e586/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722f3b90>
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50835b5d-ee71-53ed-92f7-1c9540eec9ea/50835b5d-ee71-53ed-92f7-1c9540eec9ea_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F284%252F1af96e017b41470bb9e3213541c8b25f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/284/1af96e017b41470bb9e3213541c8b25f/images/large/1.jpg saved to cache
2026-01-27 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50835b5d-ee71-53ed-92f7-1c9540eec9ea
2026-01-27 20:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50835b5d-ee71-53ed-92f7-1c9540eec9ea, skipping ID generation
2026-01-27 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50835b5d-ee71-53ed-92f7-1c9540eec9ea with scrape type 1
2026-01-27 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 50835b5d-ee71-53ed-92f7-1c9540eec9ea from tracking dictionaries
2026-01-27 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50835b5d-ee71-53ed-92f7-1c9540eec9ea sending to next pipeline
2026-01-27 20:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 50835b5d-ee71-53ed-92f7-1c9540eec9ea, identifier: 1875059
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57238ef90>
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5/1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F991%252F4d19e44265b24ef485ddc2fa359003f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/991/4d19e44265b24ef485ddc2fa359003f8/images/large/1.jpg saved to cache
2026-01-27 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5
2026-01-27 20:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5, skipping ID generation
2026-01-27 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5 with scrape type 1
2026-01-27 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5 from tracking dictionaries
2026-01-27 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5 sending to next pipeline
2026-01-27 20:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5, identifier: 1875060
2026-01-27 20:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/891/0e6f24d05a224e84bbdffddf12317994/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:19 [ayvens.es] INFO: Found listing with ID: 1875073
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875073%27 HTTP/1.1" 200 None
2026-01-27 20:01:19 [ayvens.es] INFO: Scrape type for 1875073: 1
2026-01-27 20:01:19 [ayvens.es] INFO: Extracting data for car ID: 1875073
2026-01-27 20:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff9135d-7f71-5b09-ba9d-ef9faa63d2f6 with identifier: 1875073
2026-01-27 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff9135d-7f71-5b09-ba9d-ef9faa63d2f6 with scrape type 1
2026-01-27 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dff9135d-7f71-5b09-ba9d-ef9faa63d2f6
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F230%252F5cf68914ccc24e1bbb46ba13f2e07db5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/230/5cf68914ccc24e1bbb46ba13f2e07db5/images/large/1.jpg not downloaded yet
2026-01-27 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 50835b5d-ee71-53ed-92f7-1c9540eec9ea with identifier: 1875059
2026-01-27 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 50835b5d-ee71-53ed-92f7-1c9540eec9ea with identifier: 1875059
2026-01-27 20:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 50835b5d-ee71-53ed-92f7-1c9540eec9ea with identifier: 1875059 to the API
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/284/1af96e017b41470bb9e3213541c8b25f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '50835b5d-ee71-53ed-92f7-1c9540eec9ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 5256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50835b5d-ee71-53ed-92f7-1c9540eec9ea/50835b5d-ee71-53ed-92f7-1c9540eec9ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/284/1af96e017b41470bb9e3213541c8b25f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 1.5 TSI 110kW (150 CV) DSG',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW (150 CV) DSG',
 'vin': None,
 'year': 2024}
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875059%27 HTTP/1.1" 200 None
2026-01-27 20:01:19 [ayvens.es] INFO: Saving data for 1875059: {'created_time': 1769544079.712745, 'last_price_update_time': 1769544079.712758, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875059') HTTP/1.1" 204 0
2026-01-27 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5 with identifier: 1875060
2026-01-27 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5 with identifier: 1875060
2026-01-27 20:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5 with identifier: 1875060 to the API
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/991/4d19e44265b24ef485ddc2fa359003f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 66661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5/1b0dbd6c-fc1c-50b7-bcac-f52ddd6e01d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/991/4d19e44265b24ef485ddc2fa359003f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A5 Advanced 40 TDI quattro S tro Sportback',
 'transmission': 'manual',
 'trim': 'Advanced 40 TDI quattro S tro Sportback',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875060%27 HTTP/1.1" 200 None
2026-01-27 20:01:20 [ayvens.es] INFO: Saving data for 1875060: {'created_time': 1769544080.104198, 'last_price_update_time': 1769544080.10421, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875060') HTTP/1.1" 204 0
2026-01-27 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/789/02e87b2fbcd74b91a8b0db951d4751cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:20 [ayvens.es] INFO: Found listing with ID: 1875074
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875074%27 HTTP/1.1" 200 None
2026-01-27 20:01:20 [ayvens.es] INFO: Scrape type for 1875074: 1
2026-01-27 20:01:20 [ayvens.es] INFO: Extracting data for car ID: 1875074
2026-01-27 20:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a860c02-8ee2-5731-87e3-a14030cd470c with identifier: 1875074
2026-01-27 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a860c02-8ee2-5731-87e3-a14030cd470c with scrape type 1
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5a860c02-8ee2-5731-87e3-a14030cd470c
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F141%252Fc752646fc7c34eb996a7e8e5cddc38b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/141/c752646fc7c34eb996a7e8e5cddc38b9/images/large/1.jpg not downloaded yet
2026-01-27 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/499/b33a5e47a7cc4138990eb30c1e08296d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/628/a0b2cb428e1147dbbdd5c23d15f030cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57235dfd0>
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e244c63a-aa82-5b48-91bd-3761d94732eb/e244c63a-aa82-5b48-91bd-3761d94732eb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F542%252F3550c2bf7e2b40179761cf0ec819e586%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/542/3550c2bf7e2b40179761cf0ec819e586/images/large/1.jpg saved to cache
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e244c63a-aa82-5b48-91bd-3761d94732eb
2026-01-27 20:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e244c63a-aa82-5b48-91bd-3761d94732eb, skipping ID generation
2026-01-27 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e244c63a-aa82-5b48-91bd-3761d94732eb with scrape type 1
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e244c63a-aa82-5b48-91bd-3761d94732eb from tracking dictionaries
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e244c63a-aa82-5b48-91bd-3761d94732eb sending to next pipeline
2026-01-27 20:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e244c63a-aa82-5b48-91bd-3761d94732eb, identifier: 1875061
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572351390>
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a05ef645-e81b-58e8-978d-d99ac0a8476c/a05ef645-e81b-58e8-978d-d99ac0a8476c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F891%252F0e6f24d05a224e84bbdffddf12317994%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/891/0e6f24d05a224e84bbdffddf12317994/images/large/1.jpg saved to cache
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a05ef645-e81b-58e8-978d-d99ac0a8476c
2026-01-27 20:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a05ef645-e81b-58e8-978d-d99ac0a8476c, skipping ID generation
2026-01-27 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a05ef645-e81b-58e8-978d-d99ac0a8476c with scrape type 1
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a05ef645-e81b-58e8-978d-d99ac0a8476c from tracking dictionaries
2026-01-27 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a05ef645-e81b-58e8-978d-d99ac0a8476c sending to next pipeline
2026-01-27 20:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a05ef645-e81b-58e8-978d-d99ac0a8476c, identifier: 1875063
2026-01-27 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/865/f5ed01387d8142298262b3894634f975/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/489/0b1d30f71f554b5eb85e77fd34b7c395/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:20 [ayvens.es] INFO: Found listing with ID: 1875075
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875075%27 HTTP/1.1" 200 None
2026-01-27 20:01:21 [ayvens.es] INFO: Scrape type for 1875075: 1
2026-01-27 20:01:21 [ayvens.es] INFO: Extracting data for car ID: 1875075
2026-01-27 20:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed03af8-a719-5a78-b372-9805fff740a6 with identifier: 1875075
2026-01-27 20:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed03af8-a719-5a78-b372-9805fff740a6 with scrape type 1
2026-01-27 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ed03af8-a719-5a78-b372-9805fff740a6
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F413%252F9751a18f2ad94162a1efb175d0efedb4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/413/9751a18f2ad94162a1efb175d0efedb4/images/large/1.jpg not downloaded yet
2026-01-27 20:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e244c63a-aa82-5b48-91bd-3761d94732eb with identifier: 1875061
2026-01-27 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e244c63a-aa82-5b48-91bd-3761d94732eb with identifier: 1875061
2026-01-27 20:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e244c63a-aa82-5b48-91bd-3761d94732eb with identifier: 1875061 to the API
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/542/3550c2bf7e2b40179761cf0ec819e586/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e244c63a-aa82-5b48-91bd-3761d94732eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 110565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e244c63a-aa82-5b48-91bd-3761d94732eb/e244c63a-aa82-5b48-91bd-3761d94732eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/542/3550c2bf7e2b40179761cf0ec819e586/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE S.T. Zen TCe 103 kW (140CV)',
 'transmission': 'manual',
 'trim': 'S.T. Zen TCe 103 kW (140CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875061%27 HTTP/1.1" 200 None
2026-01-27 20:01:21 [ayvens.es] INFO: Saving data for 1875061: {'created_time': 1769544081.40906, 'last_price_update_time': 1769544081.409072, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875061') HTTP/1.1" 204 0
2026-01-27 20:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a05ef645-e81b-58e8-978d-d99ac0a8476c with identifier: 1875063
2026-01-27 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a05ef645-e81b-58e8-978d-d99ac0a8476c with identifier: 1875063
2026-01-27 20:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a05ef645-e81b-58e8-978d-d99ac0a8476c with identifier: 1875063 to the API
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/891/0e6f24d05a224e84bbdffddf12317994/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a05ef645-e81b-58e8-978d-d99ac0a8476c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 119681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a05ef645-e81b-58e8-978d-d99ac0a8476c/a05ef645-e81b-58e8-978d-d99ac0a8476c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/891/0e6f24d05a224e84bbdffddf12317994/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 1.5 TDCi 88kW 4x2 A-S-S Titanium',
 'transmission': 'manual',
 'trim': '1.5 TDCi 88kW 4x2 A-S-S Titanium',
 'vin': None,
 'year': 2017}
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875063%27 HTTP/1.1" 200 None
2026-01-27 20:01:21 [ayvens.es] INFO: Saving data for 1875063: {'created_time': 1769544081.805155, 'last_price_update_time': 1769544081.805168, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875063') HTTP/1.1" 204 0
2026-01-27 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/948/5715b2510ddb498e9c5ca94127a512ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:21 [ayvens.es] INFO: Found listing with ID: 1875076
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875076%27 HTTP/1.1" 200 None
2026-01-27 20:01:21 [ayvens.es] INFO: Scrape type for 1875076: 1
2026-01-27 20:01:21 [ayvens.es] INFO: Extracting data for car ID: 1875076
2026-01-27 20:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc with identifier: 1875076
2026-01-27 20:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc with scrape type 1
2026-01-27 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F710%252F279ebb1bdbb2484fa221c26cb5f5ada3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/710/279ebb1bdbb2484fa221c26cb5f5ada3/images/large/1.jpg not downloaded yet
2026-01-27 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57210bad0>
2026-01-27 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef/4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F789%252F02e87b2fbcd74b91a8b0db951d4751cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/789/02e87b2fbcd74b91a8b0db951d4751cb/images/large/1.jpg saved to cache
2026-01-27 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef
2026-01-27 20:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef, skipping ID generation
2026-01-27 20:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef with scrape type 1
2026-01-27 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef from tracking dictionaries
2026-01-27 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef sending to next pipeline
2026-01-27 20:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef, identifier: 1875062
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572377f90>
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f4ed06e-47e0-5c65-bf1c-35285d5a49fa/5f4ed06e-47e0-5c65-bf1c-35285d5a49fa_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252Fb33a5e47a7cc4138990eb30c1e08296d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/b33a5e47a7cc4138990eb30c1e08296d/images/large/1.jpg saved to cache
2026-01-27 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa
2026-01-27 20:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa, skipping ID generation
2026-01-27 20:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa with scrape type 1
2026-01-27 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa from tracking dictionaries
2026-01-27 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa sending to next pipeline
2026-01-27 20:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa, identifier: 1875067
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572161010>
2026-01-27 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d37c68e-6f83-5e7e-a567-437453a1c952/3d37c68e-6f83-5e7e-a567-437453a1c952_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F628%252Fa0b2cb428e1147dbbdd5c23d15f030cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/628/a0b2cb428e1147dbbdd5c23d15f030cf/images/large/1.jpg saved to cache
2026-01-27 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d37c68e-6f83-5e7e-a567-437453a1c952
2026-01-27 20:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d37c68e-6f83-5e7e-a567-437453a1c952, skipping ID generation
2026-01-27 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d37c68e-6f83-5e7e-a567-437453a1c952 with scrape type 1
2026-01-27 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3d37c68e-6f83-5e7e-a567-437453a1c952 from tracking dictionaries
2026-01-27 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d37c68e-6f83-5e7e-a567-437453a1c952 sending to next pipeline
2026-01-27 20:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d37c68e-6f83-5e7e-a567-437453a1c952, identifier: 1875064
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f1bf10>
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e/fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252Ff5ed01387d8142298262b3894634f975%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/f5ed01387d8142298262b3894634f975/images/large/1.jpg saved to cache
2026-01-27 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e
2026-01-27 20:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e, skipping ID generation
2026-01-27 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e with scrape type 1
2026-01-27 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e from tracking dictionaries
2026-01-27 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e sending to next pipeline
2026-01-27 20:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e, identifier: 1875066
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f37010>
2026-01-27 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a/9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F489%252F0b1d30f71f554b5eb85e77fd34b7c395%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/489/0b1d30f71f554b5eb85e77fd34b7c395/images/large/1.jpg saved to cache
2026-01-27 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a
2026-01-27 20:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a, skipping ID generation
2026-01-27 20:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a with scrape type 1
2026-01-27 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a from tracking dictionaries
2026-01-27 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a sending to next pipeline
2026-01-27 20:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a, identifier: 1875068
2026-01-27 20:01:24 [ayvens.es] INFO: Found listing with ID: 1875077
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875077%27 HTTP/1.1" 200 None
2026-01-27 20:01:24 [ayvens.es] INFO: Scrape type for 1875077: 1
2026-01-27 20:01:24 [ayvens.es] INFO: Extracting data for car ID: 1875077
2026-01-27 20:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1557c40b-b3ae-512f-b816-5eec6df467c4 with identifier: 1875077
2026-01-27 20:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1557c40b-b3ae-512f-b816-5eec6df467c4 with scrape type 1
2026-01-27 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1557c40b-b3ae-512f-b816-5eec6df467c4
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F256%252F27b08b01e0b94d3fa9a644a33b24e640%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/256/27b08b01e0b94d3fa9a644a33b24e640/images/large/1.jpg not downloaded yet
2026-01-27 20:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef with identifier: 1875062
2026-01-27 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef with identifier: 1875062
2026-01-27 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2026-01-27 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef spider: ayvens.es
2026-01-27 20:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 134431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef/4ecbb24d-4ef8-55bc-ba3e-ca4e7c4464ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/789/02e87b2fbcd74b91a8b0db951d4751cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS (C) 1.5 TDCi E6 120cv Trend+',
 'transmission': 'manual',
 'trim': '(C) 1.5 TDCi E6 120cv Trend+',
 'vin': None,
 'year': 2016}
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875062%27 HTTP/1.1" 200 None
2026-01-27 20:01:24 [ayvens.es] INFO: Saving data for 1875062: {'created_time': 1769544084.683697, 'last_price_update_time': 1769544084.68371, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875062') HTTP/1.1" 204 0
2026-01-27 20:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa with identifier: 1875067
2026-01-27 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa with identifier: 1875067
2026-01-27 20:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5f4ed06e-47e0-5c65-bf1c-35285d5a49fa with identifier: 1875067 to the API
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/499/b33a5e47a7cc4138990eb30c1e08296d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f4ed06e-47e0-5c65-bf1c-35285d5a49fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 122558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f4ed06e-47e0-5c65-bf1c-35285d5a49fa/5f4ed06e-47e0-5c65-bf1c-35285d5a49fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/499/b33a5e47a7cc4138990eb30c1e08296d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875067%27 HTTP/1.1" 200 None
2026-01-27 20:01:25 [ayvens.es] INFO: Saving data for 1875067: {'created_time': 1769544085.093174, 'last_price_update_time': 1769544085.093186, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875067') HTTP/1.1" 204 0
2026-01-27 20:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d37c68e-6f83-5e7e-a567-437453a1c952 with identifier: 1875064
2026-01-27 20:01:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d37c68e-6f83-5e7e-a567-437453a1c952 with identifier: 1875064
2026-01-27 20:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d37c68e-6f83-5e7e-a567-437453a1c952 with identifier: 1875064 to the API
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/628/a0b2cb428e1147dbbdd5c23d15f030cf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Verde',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3d37c68e-6f83-5e7e-a567-437453a1c952',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 68642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d37c68e-6f83-5e7e-a567-437453a1c952/3d37c68e-6f83-5e7e-a567-437453a1c952_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/628/a0b2cb428e1147dbbdd5c23d15f030cf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875064%27 HTTP/1.1" 200 None
2026-01-27 20:01:25 [ayvens.es] INFO: Saving data for 1875064: {'created_time': 1769544085.500527, 'last_price_update_time': 1769544085.500543, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875064') HTTP/1.1" 204 0
2026-01-27 20:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e with identifier: 1875066
2026-01-27 20:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e with identifier: 1875066
2026-01-27 20:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154441 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154441
2026-01-27 20:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e spider: ayvens.es
2026-01-27 20:01:25 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e due to rule: high_mileage_for_country.json, error: 154441 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154441
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 154441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e/fac2fd4d-d7b0-5b44-872c-aa84cc3ee56e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/865/f5ed01387d8142298262b3894634f975/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875066%27 HTTP/1.1" 200 None
2026-01-27 20:01:25 [ayvens.es] INFO: Saving data for 1875066: {'created_time': 1769544085.744853, 'last_price_update_time': 1769544085.744865, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875066') HTTP/1.1" 204 0
2026-01-27 20:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a with identifier: 1875068
2026-01-27 20:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a with identifier: 1875068
2026-01-27 20:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a with identifier: 1875068 to the API
2026-01-27 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/489/0b1d30f71f554b5eb85e77fd34b7c395/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'gas',
 'id': '9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 25585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a/9dc0a7a1-50a0-52f7-ba2a-c18fa4b30b3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/489/0b1d30f71f554b5eb85e77fd34b7c395/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TGI 66kW (90CV) Style Go2',
 'transmission': 'manual',
 'trim': '1.0 TGI 66kW (90CV) Style Go2',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875068%27 HTTP/1.1" 200 None
2026-01-27 20:01:26 [ayvens.es] INFO: Saving data for 1875068: {'created_time': 1769544086.144564, 'last_price_update_time': 1769544086.144577, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875068') HTTP/1.1" 204 0
2026-01-27 20:01:26 [ayvens.es] INFO: Found listing with ID: 1875078
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875078%27 HTTP/1.1" 200 None
2026-01-27 20:01:26 [ayvens.es] INFO: Scrape type for 1875078: 1
2026-01-27 20:01:26 [ayvens.es] INFO: Extracting data for car ID: 1875078
2026-01-27 20:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dedd5e56-0934-53c8-8a0a-bf91fff29b37 with identifier: 1875078
2026-01-27 20:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dedd5e56-0934-53c8-8a0a-bf91fff29b37 with scrape type 1
2026-01-27 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dedd5e56-0934-53c8-8a0a-bf91fff29b37
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252F266cbd9903994dc394442b4e83cafa23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/266cbd9903994dc394442b4e83cafa23/images/large/1.jpg not downloaded yet
2026-01-27 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/413/fd29268166074b61816c2828e397c3ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/332/865158d24b26409ebd3f8547b34877af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/371/cecb8f1d37b1471f921d75780d0c307d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f86450>
2026-01-27 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5326201f-5c32-5aa8-93b4-78f78487973d/5326201f-5c32-5aa8-93b4-78f78487973d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F5715b2510ddb498e9c5ca94127a512ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/5715b2510ddb498e9c5ca94127a512ae/images/large/1.jpg saved to cache
2026-01-27 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5326201f-5c32-5aa8-93b4-78f78487973d
2026-01-27 20:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5326201f-5c32-5aa8-93b4-78f78487973d, skipping ID generation
2026-01-27 20:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5326201f-5c32-5aa8-93b4-78f78487973d with scrape type 1
2026-01-27 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5326201f-5c32-5aa8-93b4-78f78487973d from tracking dictionaries
2026-01-27 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5326201f-5c32-5aa8-93b4-78f78487973d sending to next pipeline
2026-01-27 20:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5326201f-5c32-5aa8-93b4-78f78487973d, identifier: 1875065
2026-01-27 20:01:26 [ayvens.es] INFO: Found listing with ID: 1875079
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875079%27 HTTP/1.1" 200 None
2026-01-27 20:01:26 [ayvens.es] INFO: Scrape type for 1875079: 1
2026-01-27 20:01:26 [ayvens.es] INFO: Extracting data for car ID: 1875079
2026-01-27 20:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 535a3c57-ce9a-5c30-aa22-49d58463e609 with identifier: 1875079
2026-01-27 20:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 535a3c57-ce9a-5c30-aa22-49d58463e609 with scrape type 1
2026-01-27 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 535a3c57-ce9a-5c30-aa22-49d58463e609
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fb786988fd4d44618b84375da33d19bbb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/b786988fd4d44618b84375da33d19bbb/images/large/1.jpg not downloaded yet
2026-01-27 20:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5326201f-5c32-5aa8-93b4-78f78487973d with identifier: 1875065
2026-01-27 20:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5326201f-5c32-5aa8-93b4-78f78487973d with identifier: 1875065
2026-01-27 20:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5326201f-5c32-5aa8-93b4-78f78487973d with identifier: 1875065 to the API
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/948/5715b2510ddb498e9c5ca94127a512ae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5326201f-5c32-5aa8-93b4-78f78487973d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 49991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5326201f-5c32-5aa8-93b4-78f78487973d/5326201f-5c32-5aa8-93b4-78f78487973d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/948/5715b2510ddb498e9c5ca94127a512ae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875065%27 HTTP/1.1" 200 None
2026-01-27 20:01:27 [ayvens.es] INFO: Saving data for 1875065: {'created_time': 1769544087.083108, 'last_price_update_time': 1769544087.083119, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875065') HTTP/1.1" 204 0
2026-01-27 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/262/f55ad53a759a4cf6a7332f0b9f812eab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/141/c752646fc7c34eb996a7e8e5cddc38b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:27 [ayvens.es] INFO: Found listing with ID: 1875080
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875080%27 HTTP/1.1" 200 None
2026-01-27 20:01:27 [ayvens.es] INFO: Scrape type for 1875080: 1
2026-01-27 20:01:27 [ayvens.es] INFO: Extracting data for car ID: 1875080
2026-01-27 20:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8862827-e240-5473-a98d-7a13e799d4b2 with identifier: 1875080
2026-01-27 20:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8862827-e240-5473-a98d-7a13e799d4b2 with scrape type 1
2026-01-27 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d8862827-e240-5473-a98d-7a13e799d4b2
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252Ffbe596eb7ebf493bb54d1f7c7fb99a32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/fbe596eb7ebf493bb54d1f7c7fb99a32/images/large/1.jpg not downloaded yet
2026-01-27 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/230/5cf68914ccc24e1bbb46ba13f2e07db5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b5a010>
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e2a97bd-3b87-552e-baf2-4ef6a7695214/5e2a97bd-3b87-552e-baf2-4ef6a7695214_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F413%252Ffd29268166074b61816c2828e397c3ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/413/fd29268166074b61816c2828e397c3ee/images/large/1.jpg saved to cache
2026-01-27 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e2a97bd-3b87-552e-baf2-4ef6a7695214
2026-01-27 20:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e2a97bd-3b87-552e-baf2-4ef6a7695214, skipping ID generation
2026-01-27 20:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e2a97bd-3b87-552e-baf2-4ef6a7695214 with scrape type 1
2026-01-27 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5e2a97bd-3b87-552e-baf2-4ef6a7695214 from tracking dictionaries
2026-01-27 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e2a97bd-3b87-552e-baf2-4ef6a7695214 sending to next pipeline
2026-01-27 20:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5e2a97bd-3b87-552e-baf2-4ef6a7695214, identifier: 1875069
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570958390>
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5029a5-def8-5329-ba1e-6d5385af7001/8f5029a5-def8-5329-ba1e-6d5385af7001_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F332%252F865158d24b26409ebd3f8547b34877af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/332/865158d24b26409ebd3f8547b34877af/images/large/1.jpg saved to cache
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f5029a5-def8-5329-ba1e-6d5385af7001
2026-01-27 20:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f5029a5-def8-5329-ba1e-6d5385af7001, skipping ID generation
2026-01-27 20:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f5029a5-def8-5329-ba1e-6d5385af7001 with scrape type 1
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8f5029a5-def8-5329-ba1e-6d5385af7001 from tracking dictionaries
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f5029a5-def8-5329-ba1e-6d5385af7001 sending to next pipeline
2026-01-27 20:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8f5029a5-def8-5329-ba1e-6d5385af7001, identifier: 1875072
2026-01-27 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a90c90>
2026-01-27 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2eebc9a-dcb5-5dad-88a8-c730b84b1c47/b2eebc9a-dcb5-5dad-88a8-c730b84b1c47_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252Fcecb8f1d37b1471f921d75780d0c307d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/cecb8f1d37b1471f921d75780d0c307d/images/large/1.jpg saved to cache
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2eebc9a-dcb5-5dad-88a8-c730b84b1c47
2026-01-27 20:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2eebc9a-dcb5-5dad-88a8-c730b84b1c47, skipping ID generation
2026-01-27 20:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2eebc9a-dcb5-5dad-88a8-c730b84b1c47 with scrape type 1
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2eebc9a-dcb5-5dad-88a8-c730b84b1c47 from tracking dictionaries
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2eebc9a-dcb5-5dad-88a8-c730b84b1c47 sending to next pipeline
2026-01-27 20:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2eebc9a-dcb5-5dad-88a8-c730b84b1c47, identifier: 1875070
2026-01-27 20:01:28 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 5 pages/min), scraped 28 items (at 28 items/min)
2026-01-27 20:01:28 [ayvens.es] INFO: Found listing with ID: 1875081
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875081%27 HTTP/1.1" 200 None
2026-01-27 20:01:28 [ayvens.es] INFO: Scrape type for 1875081: 1
2026-01-27 20:01:28 [ayvens.es] INFO: Extracting data for car ID: 1875081
2026-01-27 20:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca005a3-1146-5512-8525-f9203fa66c0d with identifier: 1875081
2026-01-27 20:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca005a3-1146-5512-8525-f9203fa66c0d with scrape type 1
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eca005a3-1146-5512-8525-f9203fa66c0d
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F935%252Fae2418e67f8a41c79cd1afd7f4a0f4bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/935/ae2418e67f8a41c79cd1afd7f4a0f4bb/images/large/1.jpg not downloaded yet
2026-01-27 20:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5e2a97bd-3b87-552e-baf2-4ef6a7695214 with identifier: 1875069
2026-01-27 20:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5e2a97bd-3b87-552e-baf2-4ef6a7695214 with identifier: 1875069
2026-01-27 20:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5e2a97bd-3b87-552e-baf2-4ef6a7695214 with identifier: 1875069 to the API
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/413/fd29268166074b61816c2828e397c3ee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5e2a97bd-3b87-552e-baf2-4ef6a7695214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 121542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e2a97bd-3b87-552e-baf2-4ef6a7695214/5e2a97bd-3b87-552e-baf2-4ef6a7695214_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/413/fd29268166074b61816c2828e397c3ee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.6 TDI 85kW (116CV) Sportback',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW (116CV) Sportback',
 'vin': None,
 'year': 2017}
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875069%27 HTTP/1.1" 200 None
2026-01-27 20:01:29 [ayvens.es] INFO: Saving data for 1875069: {'created_time': 1769544089.029331, 'last_price_update_time': 1769544089.029341, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875069') HTTP/1.1" 204 0
2026-01-27 20:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8f5029a5-def8-5329-ba1e-6d5385af7001 with identifier: 1875072
2026-01-27 20:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8f5029a5-def8-5329-ba1e-6d5385af7001 with identifier: 1875072
2026-01-27 20:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8f5029a5-def8-5329-ba1e-6d5385af7001 with identifier: 1875072 to the API
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/332/865158d24b26409ebd3f8547b34877af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8f5029a5-def8-5329-ba1e-6d5385af7001',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 27244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f5029a5-def8-5329-ba1e-6d5385af7001/8f5029a5-def8-5329-ba1e-6d5385af7001_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/332/865158d24b26409ebd3f8547b34877af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Black Edition 100kW (136CV) 4x2',
 'transmission': 'manual',
 'trim': '1.6 MHEV Black Edition 100kW (136CV) 4x2',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875072%27 HTTP/1.1" 200 None
2026-01-27 20:01:29 [ayvens.es] INFO: Saving data for 1875072: {'created_time': 1769544089.489835, 'last_price_update_time': 1769544089.489847, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875072') HTTP/1.1" 204 0
2026-01-27 20:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2eebc9a-dcb5-5dad-88a8-c730b84b1c47 with identifier: 1875070
2026-01-27 20:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2eebc9a-dcb5-5dad-88a8-c730b84b1c47 with identifier: 1875070
2026-01-27 20:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2eebc9a-dcb5-5dad-88a8-c730b84b1c47 with identifier: 1875070 to the API
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/371/cecb8f1d37b1471f921d75780d0c307d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2eebc9a-dcb5-5dad-88a8-c730b84b1c47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 100032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2eebc9a-dcb5-5dad-88a8-c730b84b1c47/b2eebc9a-dcb5-5dad-88a8-c730b84b1c47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/371/cecb8f1d37b1471f921d75780d0c307d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) DSG AMBITION',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) DSG AMBITION',
 'vin': None,
 'year': 2022}
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875070%27 HTTP/1.1" 200 None
2026-01-27 20:01:29 [ayvens.es] INFO: Saving data for 1875070: {'created_time': 1769544089.894923, 'last_price_update_time': 1769544089.894932, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875070') HTTP/1.1" 204 0
2026-01-27 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/413/9751a18f2ad94162a1efb175d0efedb4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:29 [ayvens.es] INFO: Found listing with ID: 1875082
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875082%27 HTTP/1.1" 200 None
2026-01-27 20:01:29 [ayvens.es] INFO: Scrape type for 1875082: 1
2026-01-27 20:01:29 [ayvens.es] INFO: Extracting data for car ID: 1875082
2026-01-27 20:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a0c748-8fd9-5471-a481-883c4d2d92bb with identifier: 1875082
2026-01-27 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a0c748-8fd9-5471-a481-883c4d2d92bb with scrape type 1
2026-01-27 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81a0c748-8fd9-5471-a481-883c4d2d92bb
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F723%252F7f01065c04fc4dd1b6e0c2ee480b0936%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/723/7f01065c04fc4dd1b6e0c2ee480b0936/images/large/1.jpg not downloaded yet
2026-01-27 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722aee50>
2026-01-27 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a639b275-467f-5964-a125-11ea4007cbf3/a639b275-467f-5964-a125-11ea4007cbf3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F262%252Ff55ad53a759a4cf6a7332f0b9f812eab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/262/f55ad53a759a4cf6a7332f0b9f812eab/images/large/1.jpg saved to cache
2026-01-27 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a639b275-467f-5964-a125-11ea4007cbf3
2026-01-27 20:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a639b275-467f-5964-a125-11ea4007cbf3, skipping ID generation
2026-01-27 20:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a639b275-467f-5964-a125-11ea4007cbf3 with scrape type 1
2026-01-27 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a639b275-467f-5964-a125-11ea4007cbf3 from tracking dictionaries
2026-01-27 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a639b275-467f-5964-a125-11ea4007cbf3 sending to next pipeline
2026-01-27 20:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a639b275-467f-5964-a125-11ea4007cbf3, identifier: 1875071
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572167190>
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a860c02-8ee2-5731-87e3-a14030cd470c/5a860c02-8ee2-5731-87e3-a14030cd470c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F141%252Fc752646fc7c34eb996a7e8e5cddc38b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/141/c752646fc7c34eb996a7e8e5cddc38b9/images/large/1.jpg saved to cache
2026-01-27 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a860c02-8ee2-5731-87e3-a14030cd470c
2026-01-27 20:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a860c02-8ee2-5731-87e3-a14030cd470c, skipping ID generation
2026-01-27 20:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a860c02-8ee2-5731-87e3-a14030cd470c with scrape type 1
2026-01-27 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5a860c02-8ee2-5731-87e3-a14030cd470c from tracking dictionaries
2026-01-27 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a860c02-8ee2-5731-87e3-a14030cd470c sending to next pipeline
2026-01-27 20:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5a860c02-8ee2-5731-87e3-a14030cd470c, identifier: 1875074
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572288e50>
2026-01-27 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff9135d-7f71-5b09-ba9d-ef9faa63d2f6/dff9135d-7f71-5b09-ba9d-ef9faa63d2f6_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F230%252F5cf68914ccc24e1bbb46ba13f2e07db5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/230/5cf68914ccc24e1bbb46ba13f2e07db5/images/large/1.jpg saved to cache
2026-01-27 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dff9135d-7f71-5b09-ba9d-ef9faa63d2f6
2026-01-27 20:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dff9135d-7f71-5b09-ba9d-ef9faa63d2f6, skipping ID generation
2026-01-27 20:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff9135d-7f71-5b09-ba9d-ef9faa63d2f6 with scrape type 1
2026-01-27 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dff9135d-7f71-5b09-ba9d-ef9faa63d2f6 from tracking dictionaries
2026-01-27 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dff9135d-7f71-5b09-ba9d-ef9faa63d2f6 sending to next pipeline
2026-01-27 20:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dff9135d-7f71-5b09-ba9d-ef9faa63d2f6, identifier: 1875073
2026-01-27 20:01:31 [ayvens.es] INFO: Found listing with ID: 1875083
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875083%27 HTTP/1.1" 200 None
2026-01-27 20:01:31 [ayvens.es] INFO: Scrape type for 1875083: 1
2026-01-27 20:01:31 [ayvens.es] INFO: Extracting data for car ID: 1875083
2026-01-27 20:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f with identifier: 1875083
2026-01-27 20:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f with scrape type 1
2026-01-27 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252Ff0e6c9e5e9714f898163ee58a1bacfe3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/f0e6c9e5e9714f898163ee58a1bacfe3/images/large/1.jpg not downloaded yet
2026-01-27 20:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a639b275-467f-5964-a125-11ea4007cbf3 with identifier: 1875071
2026-01-27 20:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a639b275-467f-5964-a125-11ea4007cbf3 with identifier: 1875071
2026-01-27 20:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a639b275-467f-5964-a125-11ea4007cbf3 with identifier: 1875071 to the API
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/262/f55ad53a759a4cf6a7332f0b9f812eab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a639b275-467f-5964-a125-11ea4007cbf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 52812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a639b275-467f-5964-a125-11ea4007cbf3/a639b275-467f-5964-a125-11ea4007cbf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/262/f55ad53a759a4cf6a7332f0b9f812eab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D DCT 110KW (150CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875071%27 HTTP/1.1" 200 None
2026-01-27 20:01:31 [ayvens.es] INFO: Saving data for 1875071: {'created_time': 1769544091.847682, 'last_price_update_time': 1769544091.847699, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875071') HTTP/1.1" 204 0
2026-01-27 20:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5a860c02-8ee2-5731-87e3-a14030cd470c with identifier: 1875074
2026-01-27 20:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5a860c02-8ee2-5731-87e3-a14030cd470c with identifier: 1875074
2026-01-27 20:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5a860c02-8ee2-5731-87e3-a14030cd470c with identifier: 1875074 to the API
2026-01-27 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/141/c752646fc7c34eb996a7e8e5cddc38b9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5a860c02-8ee2-5731-87e3-a14030cd470c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 71619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a860c02-8ee2-5731-87e3-a14030cd470c/5a860c02-8ee2-5731-87e3-a14030cd470c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/141/c752646fc7c34eb996a7e8e5cddc38b9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875074%27 HTTP/1.1" 200 None
2026-01-27 20:01:32 [ayvens.es] INFO: Saving data for 1875074: {'created_time': 1769544092.262073, 'last_price_update_time': 1769544092.262086, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875074') HTTP/1.1" 204 0
2026-01-27 20:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dff9135d-7f71-5b09-ba9d-ef9faa63d2f6 with identifier: 1875073
2026-01-27 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dff9135d-7f71-5b09-ba9d-ef9faa63d2f6 with identifier: 1875073
2026-01-27 20:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dff9135d-7f71-5b09-ba9d-ef9faa63d2f6 with identifier: 1875073 to the API
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/230/5cf68914ccc24e1bbb46ba13f2e07db5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dff9135d-7f71-5b09-ba9d-ef9faa63d2f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 111353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff9135d-7f71-5b09-ba9d-ef9faa63d2f6/dff9135d-7f71-5b09-ba9d-ef9faa63d2f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/230/5cf68914ccc24e1bbb46ba13f2e07db5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875073%27 HTTP/1.1" 200 None
2026-01-27 20:01:32 [ayvens.es] INFO: Saving data for 1875073: {'created_time': 1769544092.711908, 'last_price_update_time': 1769544092.711922, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875073') HTTP/1.1" 204 0
2026-01-27 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/710/279ebb1bdbb2484fa221c26cb5f5ada3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/256/27b08b01e0b94d3fa9a644a33b24e640/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:32 [ayvens.es] INFO: Found listing with ID: 1875084
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875084%27 HTTP/1.1" 200 None
2026-01-27 20:01:32 [ayvens.es] INFO: Scrape type for 1875084: 1
2026-01-27 20:01:32 [ayvens.es] INFO: Extracting data for car ID: 1875084
2026-01-27 20:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a375f4e1-18aa-5488-b7c8-acac0cfc090e with identifier: 1875084
2026-01-27 20:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a375f4e1-18aa-5488-b7c8-acac0cfc090e with scrape type 1
2026-01-27 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a375f4e1-18aa-5488-b7c8-acac0cfc090e
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F986%252Fc45016f7e2a84a12a219c4c985455665%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/986/c45016f7e2a84a12a219c4c985455665/images/large/1.jpg not downloaded yet
2026-01-27 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/596/266cbd9903994dc394442b4e83cafa23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724f8210>
2026-01-27 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed03af8-a719-5a78-b372-9805fff740a6/8ed03af8-a719-5a78-b372-9805fff740a6_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F413%252F9751a18f2ad94162a1efb175d0efedb4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/413/9751a18f2ad94162a1efb175d0efedb4/images/large/1.jpg saved to cache
2026-01-27 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ed03af8-a719-5a78-b372-9805fff740a6
2026-01-27 20:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ed03af8-a719-5a78-b372-9805fff740a6, skipping ID generation
2026-01-27 20:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed03af8-a719-5a78-b372-9805fff740a6 with scrape type 1
2026-01-27 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ed03af8-a719-5a78-b372-9805fff740a6 from tracking dictionaries
2026-01-27 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ed03af8-a719-5a78-b372-9805fff740a6 sending to next pipeline
2026-01-27 20:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ed03af8-a719-5a78-b372-9805fff740a6, identifier: 1875075
2026-01-27 20:01:33 [ayvens.es] INFO: Found listing with ID: 1875085
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875085%27 HTTP/1.1" 200 None
2026-01-27 20:01:33 [ayvens.es] INFO: Scrape type for 1875085: 1
2026-01-27 20:01:33 [ayvens.es] INFO: Extracting data for car ID: 1875085
2026-01-27 20:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd9ee8b-c658-5398-b526-2148aeebe24b with identifier: 1875085
2026-01-27 20:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd9ee8b-c658-5398-b526-2148aeebe24b with scrape type 1
2026-01-27 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffd9ee8b-c658-5398-b526-2148aeebe24b
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F902%252Fa2259e881f374b2a86691cae213c4375%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/902/a2259e881f374b2a86691cae213c4375/images/large/1.jpg not downloaded yet
2026-01-27 20:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ed03af8-a719-5a78-b372-9805fff740a6 with identifier: 1875075
2026-01-27 20:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ed03af8-a719-5a78-b372-9805fff740a6 with identifier: 1875075
2026-01-27 20:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ed03af8-a719-5a78-b372-9805fff740a6 with identifier: 1875075 to the API
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/413/9751a18f2ad94162a1efb175d0efedb4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ed03af8-a719-5a78-b372-9805fff740a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 80830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed03af8-a719-5a78-b372-9805fff740a6/8ed03af8-a719-5a78-b372-9805fff740a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/413/9751a18f2ad94162a1efb175d0efedb4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2023}
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875075%27 HTTP/1.1" 200 None
2026-01-27 20:01:33 [ayvens.es] INFO: Saving data for 1875075: {'created_time': 1769544093.813379, 'last_price_update_time': 1769544093.813392, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875075') HTTP/1.1" 204 0
2026-01-27 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/469/fbe596eb7ebf493bb54d1f7c7fb99a32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:33 [ayvens.es] INFO: Found listing with ID: 1875086
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875086%27 HTTP/1.1" 200 None
2026-01-27 20:01:33 [ayvens.es] INFO: Scrape type for 1875086: 1
2026-01-27 20:01:33 [ayvens.es] INFO: Extracting data for car ID: 1875086
2026-01-27 20:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3fd7d49-4c80-55e6-a217-024792af23f2 with identifier: 1875086
2026-01-27 20:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3fd7d49-4c80-55e6-a217-024792af23f2 with scrape type 1
2026-01-27 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a3fd7d49-4c80-55e6-a217-024792af23f2
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F214%252F447c3b7dc83c4f73858a7b402540b972%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/214/447c3b7dc83c4f73858a7b402540b972/images/large/1.jpg not downloaded yet
2026-01-27 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f78650>
2026-01-27 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc/db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F710%252F279ebb1bdbb2484fa221c26cb5f5ada3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/710/279ebb1bdbb2484fa221c26cb5f5ada3/images/large/1.jpg saved to cache
2026-01-27 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc
2026-01-27 20:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc, skipping ID generation
2026-01-27 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc with scrape type 1
2026-01-27 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc from tracking dictionaries
2026-01-27 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc sending to next pipeline
2026-01-27 20:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc, identifier: 1875076
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57095ac90>
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1557c40b-b3ae-512f-b816-5eec6df467c4/1557c40b-b3ae-512f-b816-5eec6df467c4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F256%252F27b08b01e0b94d3fa9a644a33b24e640%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/256/27b08b01e0b94d3fa9a644a33b24e640/images/large/1.jpg saved to cache
2026-01-27 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1557c40b-b3ae-512f-b816-5eec6df467c4
2026-01-27 20:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1557c40b-b3ae-512f-b816-5eec6df467c4, skipping ID generation
2026-01-27 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1557c40b-b3ae-512f-b816-5eec6df467c4 with scrape type 1
2026-01-27 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1557c40b-b3ae-512f-b816-5eec6df467c4 from tracking dictionaries
2026-01-27 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1557c40b-b3ae-512f-b816-5eec6df467c4 sending to next pipeline
2026-01-27 20:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1557c40b-b3ae-512f-b816-5eec6df467c4, identifier: 1875077
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a8ded0>
2026-01-27 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedd5e56-0934-53c8-8a0a-bf91fff29b37/dedd5e56-0934-53c8-8a0a-bf91fff29b37_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252F266cbd9903994dc394442b4e83cafa23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/266cbd9903994dc394442b4e83cafa23/images/large/1.jpg saved to cache
2026-01-27 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dedd5e56-0934-53c8-8a0a-bf91fff29b37
2026-01-27 20:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dedd5e56-0934-53c8-8a0a-bf91fff29b37, skipping ID generation
2026-01-27 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dedd5e56-0934-53c8-8a0a-bf91fff29b37 with scrape type 1
2026-01-27 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dedd5e56-0934-53c8-8a0a-bf91fff29b37 from tracking dictionaries
2026-01-27 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dedd5e56-0934-53c8-8a0a-bf91fff29b37 sending to next pipeline
2026-01-27 20:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dedd5e56-0934-53c8-8a0a-bf91fff29b37, identifier: 1875078
2026-01-27 20:01:35 [ayvens.es] INFO: Found listing with ID: 1875087
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875087%27 HTTP/1.1" 200 None
2026-01-27 20:01:35 [ayvens.es] INFO: Scrape type for 1875087: 1
2026-01-27 20:01:35 [ayvens.es] INFO: Extracting data for car ID: 1875087
2026-01-27 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61bf0a1b-1120-5812-811a-cd0923378d0a with identifier: 1875087
2026-01-27 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61bf0a1b-1120-5812-811a-cd0923378d0a with scrape type 1
2026-01-27 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 61bf0a1b-1120-5812-811a-cd0923378d0a
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F217%252F924fea631b5b476aadb6979718ca682f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/217/924fea631b5b476aadb6979718ca682f/images/large/1.jpg not downloaded yet
2026-01-27 20:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc with identifier: 1875076
2026-01-27 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc with identifier: 1875076
2026-01-27 20:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc with identifier: 1875076 to the API
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/710/279ebb1bdbb2484fa221c26cb5f5ada3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2',
 'odometer': 112197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc/db82bd4e-9f7b-5c2a-9f28-0a817a79a4dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/710/279ebb1bdbb2484fa221c26cb5f5ada3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 218dA Gran Coupe',
 'transmission': 'manual',
 'trim': '218dA Gran Coupe',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875076%27 HTTP/1.1" 200 None
2026-01-27 20:01:35 [ayvens.es] INFO: Saving data for 1875076: {'created_time': 1769544095.650645, 'last_price_update_time': 1769544095.650658, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875076') HTTP/1.1" 204 0
2026-01-27 20:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1557c40b-b3ae-512f-b816-5eec6df467c4 with identifier: 1875077
2026-01-27 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1557c40b-b3ae-512f-b816-5eec6df467c4 with identifier: 1875077
2026-01-27 20:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1557c40b-b3ae-512f-b816-5eec6df467c4 with identifier: 1875077 to the API
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/256/27b08b01e0b94d3fa9a644a33b24e640/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1557c40b-b3ae-512f-b816-5eec6df467c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 57658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1557c40b-b3ae-512f-b816-5eec6df467c4/1557c40b-b3ae-512f-b816-5eec6df467c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/256/27b08b01e0b94d3fa9a644a33b24e640/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.5 Ecoblue 88kW (120cv) Titanium',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW (120cv) Titanium',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875077%27 HTTP/1.1" 200 None
2026-01-27 20:01:36 [ayvens.es] INFO: Saving data for 1875077: {'created_time': 1769544096.019288, 'last_price_update_time': 1769544096.019301, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875077') HTTP/1.1" 204 0
2026-01-27 20:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dedd5e56-0934-53c8-8a0a-bf91fff29b37 with identifier: 1875078
2026-01-27 20:01:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dedd5e56-0934-53c8-8a0a-bf91fff29b37 with identifier: 1875078
2026-01-27 20:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dedd5e56-0934-53c8-8a0a-bf91fff29b37 with identifier: 1875078 to the API
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/596/266cbd9903994dc394442b4e83cafa23/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Clear',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dedd5e56-0934-53c8-8a0a-bf91fff29b37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 113219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedd5e56-0934-53c8-8a0a-bf91fff29b37/dedd5e56-0934-53c8-8a0a-bf91fff29b37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/596/266cbd9903994dc394442b4e83cafa23/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875078%27 HTTP/1.1" 200 None
2026-01-27 20:01:36 [ayvens.es] INFO: Saving data for 1875078: {'created_time': 1769544096.40654, 'last_price_update_time': 1769544096.406553, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875078') HTTP/1.1" 204 0
2026-01-27 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/150/b786988fd4d44618b84375da33d19bbb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:36 [ayvens.es] INFO: Found listing with ID: 1875088
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875088%27 HTTP/1.1" 200 None
2026-01-27 20:01:36 [ayvens.es] INFO: Scrape type for 1875088: 1
2026-01-27 20:01:36 [ayvens.es] INFO: Extracting data for car ID: 1875088
2026-01-27 20:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e25c506-17be-5b75-855c-5f422f5eeb0e with identifier: 1875088
2026-01-27 20:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e25c506-17be-5b75-855c-5f422f5eeb0e with scrape type 1
2026-01-27 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e25c506-17be-5b75-855c-5f422f5eeb0e
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F783%252F29d67895dd9f401da7b1107048fdf814%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/783/29d67895dd9f401da7b1107048fdf814/images/large/1.jpg not downloaded yet
2026-01-27 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57232da50>
2026-01-27 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8862827-e240-5473-a98d-7a13e799d4b2/d8862827-e240-5473-a98d-7a13e799d4b2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252Ffbe596eb7ebf493bb54d1f7c7fb99a32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/fbe596eb7ebf493bb54d1f7c7fb99a32/images/large/1.jpg saved to cache
2026-01-27 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8862827-e240-5473-a98d-7a13e799d4b2
2026-01-27 20:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8862827-e240-5473-a98d-7a13e799d4b2, skipping ID generation
2026-01-27 20:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8862827-e240-5473-a98d-7a13e799d4b2 with scrape type 1
2026-01-27 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d8862827-e240-5473-a98d-7a13e799d4b2 from tracking dictionaries
2026-01-27 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8862827-e240-5473-a98d-7a13e799d4b2 sending to next pipeline
2026-01-27 20:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d8862827-e240-5473-a98d-7a13e799d4b2, identifier: 1875080
2026-01-27 20:01:36 [ayvens.es] INFO: Found listing with ID: 1875089
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875089%27 HTTP/1.1" 200 None
2026-01-27 20:01:36 [ayvens.es] INFO: Scrape type for 1875089: 1
2026-01-27 20:01:36 [ayvens.es] INFO: Extracting data for car ID: 1875089
2026-01-27 20:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a6ed08-327e-55bc-87aa-6443e1b528ca with identifier: 1875089
2026-01-27 20:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a6ed08-327e-55bc-87aa-6443e1b528ca with scrape type 1
2026-01-27 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a0a6ed08-327e-55bc-87aa-6443e1b528ca
2026-01-27 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252Ff5607608bde94550824255c55af77114%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/f5607608bde94550824255c55af77114/images/large/1.jpg not downloaded yet
2026-01-27 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d8862827-e240-5473-a98d-7a13e799d4b2 with identifier: 1875080
2026-01-27 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d8862827-e240-5473-a98d-7a13e799d4b2 with identifier: 1875080
2026-01-27 20:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d8862827-e240-5473-a98d-7a13e799d4b2 with identifier: 1875080 to the API
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/469/fbe596eb7ebf493bb54d1f7c7fb99a32/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd8862827-e240-5473-a98d-7a13e799d4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 19592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8862827-e240-5473-a98d-7a13e799d4b2/d8862827-e240-5473-a98d-7a13e799d4b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/469/fbe596eb7ebf493bb54d1f7c7fb99a32/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875080%27 HTTP/1.1" 200 None
2026-01-27 20:01:37 [ayvens.es] INFO: Saving data for 1875080: {'created_time': 1769544097.334906, 'last_price_update_time': 1769544097.33492, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875080') HTTP/1.1" 204 0
2026-01-27 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/957/f0e6c9e5e9714f898163ee58a1bacfe3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/723/7f01065c04fc4dd1b6e0c2ee480b0936/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:37 [ayvens.es] INFO: Found listing with ID: 1875090
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875090%27 HTTP/1.1" 200 None
2026-01-27 20:01:37 [ayvens.es] INFO: Scrape type for 1875090: 1
2026-01-27 20:01:37 [ayvens.es] INFO: Extracting data for car ID: 1875090
2026-01-27 20:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbeaf60b-9b10-5a83-9937-f544d1984f8a with identifier: 1875090
2026-01-27 20:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbeaf60b-9b10-5a83-9937-f544d1984f8a with scrape type 1
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bbeaf60b-9b10-5a83-9937-f544d1984f8a
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252Fdd1f8307abc34c019929cf4e3807d77b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/dd1f8307abc34c019929cf4e3807d77b/images/large/1.jpg not downloaded yet
2026-01-27 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/986/c45016f7e2a84a12a219c4c985455665/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571baae50>
2026-01-27 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_535a3c57-ce9a-5c30-aa22-49d58463e609/535a3c57-ce9a-5c30-aa22-49d58463e609_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fb786988fd4d44618b84375da33d19bbb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/b786988fd4d44618b84375da33d19bbb/images/large/1.jpg saved to cache
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 535a3c57-ce9a-5c30-aa22-49d58463e609
2026-01-27 20:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 535a3c57-ce9a-5c30-aa22-49d58463e609, skipping ID generation
2026-01-27 20:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 535a3c57-ce9a-5c30-aa22-49d58463e609 with scrape type 1
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 535a3c57-ce9a-5c30-aa22-49d58463e609 from tracking dictionaries
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 535a3c57-ce9a-5c30-aa22-49d58463e609 sending to next pipeline
2026-01-27 20:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 535a3c57-ce9a-5c30-aa22-49d58463e609, identifier: 1875079
2026-01-27 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/935/ae2418e67f8a41c79cd1afd7f4a0f4bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:37 [ayvens.es] INFO: Found listing with ID: 1875091
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875091%27 HTTP/1.1" 200 None
2026-01-27 20:01:37 [ayvens.es] INFO: Scrape type for 1875091: 1
2026-01-27 20:01:37 [ayvens.es] INFO: Extracting data for car ID: 1875091
2026-01-27 20:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121aaa5b-8320-5911-aa8b-c8adb49221b1 with identifier: 1875091
2026-01-27 20:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121aaa5b-8320-5911-aa8b-c8adb49221b1 with scrape type 1
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 121aaa5b-8320-5911-aa8b-c8adb49221b1
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F977%252F8f0dc9ae28414ca991af2e3d9e88f7ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/977/8f0dc9ae28414ca991af2e3d9e88f7ad/images/large/1.jpg not downloaded yet
2026-01-27 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 535a3c57-ce9a-5c30-aa22-49d58463e609 with identifier: 1875079
2026-01-27 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 535a3c57-ce9a-5c30-aa22-49d58463e609 with identifier: 1875079
2026-01-27 20:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 535a3c57-ce9a-5c30-aa22-49d58463e609 with identifier: 1875079 to the API
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/150/b786988fd4d44618b84375da33d19bbb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '535a3c57-ce9a-5c30-aa22-49d58463e609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 55202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_535a3c57-ce9a-5c30-aa22-49d58463e609/535a3c57-ce9a-5c30-aa22-49d58463e609_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/150/b786988fd4d44618b84375da33d19bbb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 200 d',
 'transmission': 'manual',
 'trim': 'C 200 d',
 'vin': None,
 'year': 2023}
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875079%27 HTTP/1.1" 200 None
2026-01-27 20:01:38 [ayvens.es] INFO: Saving data for 1875079: {'created_time': 1769544098.321137, 'last_price_update_time': 1769544098.321152, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875079') HTTP/1.1" 204 0
2026-01-27 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/902/a2259e881f374b2a86691cae213c4375/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/214/447c3b7dc83c4f73858a7b402540b972/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:38 [ayvens.es] INFO: Found listing with ID: 1875092
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875092%27 HTTP/1.1" 200 None
2026-01-27 20:01:38 [ayvens.es] INFO: Scrape type for 1875092: 1
2026-01-27 20:01:38 [ayvens.es] INFO: Extracting data for car ID: 1875092
2026-01-27 20:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9269fcd-7540-5d75-9435-e32a2c20d127 with identifier: 1875092
2026-01-27 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9269fcd-7540-5d75-9435-e32a2c20d127 with scrape type 1
2026-01-27 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d9269fcd-7540-5d75-9435-e32a2c20d127
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F777%252F81689720413e4c3989d1aa575777321c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/777/81689720413e4c3989d1aa575777321c/images/large/1.jpg not downloaded yet
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571ebc050>
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f44b6fd-f8f3-5baf-98fb-b52e407bde9f/1f44b6fd-f8f3-5baf-98fb-b52e407bde9f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252Ff0e6c9e5e9714f898163ee58a1bacfe3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/f0e6c9e5e9714f898163ee58a1bacfe3/images/large/1.jpg saved to cache
2026-01-27 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f
2026-01-27 20:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f, skipping ID generation
2026-01-27 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f with scrape type 1
2026-01-27 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f from tracking dictionaries
2026-01-27 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f sending to next pipeline
2026-01-27 20:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f, identifier: 1875083
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57091a750>
2026-01-27 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a0c748-8fd9-5471-a481-883c4d2d92bb/81a0c748-8fd9-5471-a481-883c4d2d92bb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F723%252F7f01065c04fc4dd1b6e0c2ee480b0936%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/723/7f01065c04fc4dd1b6e0c2ee480b0936/images/large/1.jpg saved to cache
2026-01-27 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81a0c748-8fd9-5471-a481-883c4d2d92bb
2026-01-27 20:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81a0c748-8fd9-5471-a481-883c4d2d92bb, skipping ID generation
2026-01-27 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a0c748-8fd9-5471-a481-883c4d2d92bb with scrape type 1
2026-01-27 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 81a0c748-8fd9-5471-a481-883c4d2d92bb from tracking dictionaries
2026-01-27 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81a0c748-8fd9-5471-a481-883c4d2d92bb sending to next pipeline
2026-01-27 20:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 81a0c748-8fd9-5471-a481-883c4d2d92bb, identifier: 1875082
2026-01-27 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57227ab10>
2026-01-27 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a375f4e1-18aa-5488-b7c8-acac0cfc090e/a375f4e1-18aa-5488-b7c8-acac0cfc090e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F986%252Fc45016f7e2a84a12a219c4c985455665%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/986/c45016f7e2a84a12a219c4c985455665/images/large/1.jpg saved to cache
2026-01-27 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a375f4e1-18aa-5488-b7c8-acac0cfc090e
2026-01-27 20:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a375f4e1-18aa-5488-b7c8-acac0cfc090e, skipping ID generation
2026-01-27 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a375f4e1-18aa-5488-b7c8-acac0cfc090e with scrape type 1
2026-01-27 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a375f4e1-18aa-5488-b7c8-acac0cfc090e from tracking dictionaries
2026-01-27 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a375f4e1-18aa-5488-b7c8-acac0cfc090e sending to next pipeline
2026-01-27 20:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a375f4e1-18aa-5488-b7c8-acac0cfc090e, identifier: 1875084
2026-01-27 20:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f with identifier: 1875083
2026-01-27 20:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f with identifier: 1875083
2026-01-27 20:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f44b6fd-f8f3-5baf-98fb-b52e407bde9f with identifier: 1875083 to the API
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/957/f0e6c9e5e9714f898163ee58a1bacfe3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 83,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1f44b6fd-f8f3-5baf-98fb-b52e407bde9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 92246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f44b6fd-f8f3-5baf-98fb-b52e407bde9f/1f44b6fd-f8f3-5baf-98fb-b52e407bde9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/957/f0e6c9e5e9714f898163ee58a1bacfe3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 (O) BlueHDi 55KW (75CV) S&S 83g BUSINESS',
 'transmission': 'manual',
 'trim': '(O) BlueHDi 55KW (75CV) S&S 83g BUSINESS',
 'vin': None,
 'year': 2018}
2026-01-27 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875083%27 HTTP/1.1" 200 None
2026-01-27 20:01:40 [ayvens.es] INFO: Saving data for 1875083: {'created_time': 1769544100.111409, 'last_price_update_time': 1769544100.111423, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875083') HTTP/1.1" 204 0
2026-01-27 20:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 81a0c748-8fd9-5471-a481-883c4d2d92bb with identifier: 1875082
2026-01-27 20:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 81a0c748-8fd9-5471-a481-883c4d2d92bb with identifier: 1875082
2026-01-27 20:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 81a0c748-8fd9-5471-a481-883c4d2d92bb with identifier: 1875082 to the API
2026-01-27 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/723/7f01065c04fc4dd1b6e0c2ee480b0936/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '81a0c748-8fd9-5471-a481-883c4d2d92bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 90365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a0c748-8fd9-5471-a481-883c4d2d92bb/81a0c748-8fd9-5471-a481-883c4d2d92bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/723/7f01065c04fc4dd1b6e0c2ee480b0936/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 73KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': 'BlueHDi 73KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2019}
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875082%27 HTTP/1.1" 200 None
2026-01-27 20:01:42 [ayvens.es] INFO: Saving data for 1875082: {'created_time': 1769544102.083356, 'last_price_update_time': 1769544102.083369, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875082') HTTP/1.1" 204 0
2026-01-27 20:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a375f4e1-18aa-5488-b7c8-acac0cfc090e with identifier: 1875084
2026-01-27 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a375f4e1-18aa-5488-b7c8-acac0cfc090e with identifier: 1875084
2026-01-27 20:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a375f4e1-18aa-5488-b7c8-acac0cfc090e with identifier: 1875084 to the API
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/986/c45016f7e2a84a12a219c4c985455665/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a375f4e1-18aa-5488-b7c8-acac0cfc090e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 25934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a375f4e1-18aa-5488-b7c8-acac0cfc090e/a375f4e1-18aa-5488-b7c8-acac0cfc090e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/986/c45016f7e2a84a12a219c4c985455665/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875084%27 HTTP/1.1" 200 None
2026-01-27 20:01:42 [ayvens.es] INFO: Saving data for 1875084: {'created_time': 1769544102.414538, 'last_price_update_time': 1769544102.414551, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875084') HTTP/1.1" 204 0
2026-01-27 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57212a350>
2026-01-27 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca005a3-1146-5512-8525-f9203fa66c0d/eca005a3-1146-5512-8525-f9203fa66c0d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F935%252Fae2418e67f8a41c79cd1afd7f4a0f4bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/935/ae2418e67f8a41c79cd1afd7f4a0f4bb/images/large/1.jpg saved to cache
2026-01-27 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eca005a3-1146-5512-8525-f9203fa66c0d
2026-01-27 20:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eca005a3-1146-5512-8525-f9203fa66c0d, skipping ID generation
2026-01-27 20:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca005a3-1146-5512-8525-f9203fa66c0d with scrape type 1
2026-01-27 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eca005a3-1146-5512-8525-f9203fa66c0d from tracking dictionaries
2026-01-27 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eca005a3-1146-5512-8525-f9203fa66c0d sending to next pipeline
2026-01-27 20:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eca005a3-1146-5512-8525-f9203fa66c0d, identifier: 1875081
2026-01-27 20:01:42 [ayvens.es] INFO: Found listing with ID: 1875093
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875093%27 HTTP/1.1" 200 None
2026-01-27 20:01:42 [ayvens.es] INFO: Scrape type for 1875093: 1
2026-01-27 20:01:42 [ayvens.es] INFO: Extracting data for car ID: 1875093
2026-01-27 20:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 with identifier: 1875093
2026-01-27 20:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 with scrape type 1
2026-01-27 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b0fe9e54-3366-5c0b-88ec-bbe8d1667c05
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Fd7d15b1e76664e42b9288698ebeb78d2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/d7d15b1e76664e42b9288698ebeb78d2/images/large/1.jpg not downloaded yet
2026-01-27 20:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eca005a3-1146-5512-8525-f9203fa66c0d with identifier: 1875081
2026-01-27 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eca005a3-1146-5512-8525-f9203fa66c0d with identifier: 1875081
2026-01-27 20:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eca005a3-1146-5512-8525-f9203fa66c0d with identifier: 1875081 to the API
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/935/ae2418e67f8a41c79cd1afd7f4a0f4bb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eca005a3-1146-5512-8525-f9203fa66c0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 114169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca005a3-1146-5512-8525-f9203fa66c0d/eca005a3-1146-5512-8525-f9203fa66c0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/935/ae2418e67f8a41c79cd1afd7f4a0f4bb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW Reference Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW Reference Eco',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875081%27 HTTP/1.1" 200 None
2026-01-27 20:01:43 [ayvens.es] INFO: Saving data for 1875081: {'created_time': 1769544103.33303, 'last_price_update_time': 1769544103.333043, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875081') HTTP/1.1" 204 0
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57220e150>
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffd9ee8b-c658-5398-b526-2148aeebe24b/ffd9ee8b-c658-5398-b526-2148aeebe24b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F902%252Fa2259e881f374b2a86691cae213c4375%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/902/a2259e881f374b2a86691cae213c4375/images/large/1.jpg saved to cache
2026-01-27 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffd9ee8b-c658-5398-b526-2148aeebe24b
2026-01-27 20:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffd9ee8b-c658-5398-b526-2148aeebe24b, skipping ID generation
2026-01-27 20:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd9ee8b-c658-5398-b526-2148aeebe24b with scrape type 1
2026-01-27 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ffd9ee8b-c658-5398-b526-2148aeebe24b from tracking dictionaries
2026-01-27 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffd9ee8b-c658-5398-b526-2148aeebe24b sending to next pipeline
2026-01-27 20:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ffd9ee8b-c658-5398-b526-2148aeebe24b, identifier: 1875085
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f033d0>
2026-01-27 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3fd7d49-4c80-55e6-a217-024792af23f2/a3fd7d49-4c80-55e6-a217-024792af23f2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F214%252F447c3b7dc83c4f73858a7b402540b972%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/214/447c3b7dc83c4f73858a7b402540b972/images/large/1.jpg saved to cache
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3fd7d49-4c80-55e6-a217-024792af23f2
2026-01-27 20:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3fd7d49-4c80-55e6-a217-024792af23f2, skipping ID generation
2026-01-27 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3fd7d49-4c80-55e6-a217-024792af23f2 with scrape type 1
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a3fd7d49-4c80-55e6-a217-024792af23f2 from tracking dictionaries
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3fd7d49-4c80-55e6-a217-024792af23f2 sending to next pipeline
2026-01-27 20:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a3fd7d49-4c80-55e6-a217-024792af23f2, identifier: 1875086
2026-01-27 20:01:44 [ayvens.es] INFO: Found listing with ID: 1875094
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875094%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [ayvens.es] INFO: Scrape type for 1875094: 1
2026-01-27 20:01:44 [ayvens.es] INFO: Extracting data for car ID: 1875094
2026-01-27 20:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca1dc1e9-a3f0-5159-80cc-491e1469097d with identifier: 1875094
2026-01-27 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca1dc1e9-a3f0-5159-80cc-491e1469097d with scrape type 1
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca1dc1e9-a3f0-5159-80cc-491e1469097d
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F827%252F7915e5b22dc04fa1b0f26e0a641d384f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/827/7915e5b22dc04fa1b0f26e0a641d384f/images/large/1.jpg not downloaded yet
2026-01-27 20:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ffd9ee8b-c658-5398-b526-2148aeebe24b with identifier: 1875085
2026-01-27 20:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ffd9ee8b-c658-5398-b526-2148aeebe24b with identifier: 1875085
2026-01-27 20:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'mineralgrau', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'bmw', 'model': 'series 3', 'trim': '330e', 'title': 'bmw series 3 330e', 'price': 0, 'odometer': 217976, 'odometer_reading_unit': 'km', 'registration_date': '2020-03-12', 'year': 2020, 'fuel_type': 'hybrid', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 37, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ffd9ee8b-c658-5398-b526-2148aeebe24b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffd9ee8b-c658-5398-b526-2148aeebe24b/ffd9ee8b-c658-5398-b526-2148aeebe24b_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/902/a2259e881f374b2a86691cae213c4375/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 368533}], 'current_year_diff': 6, 'age_in_months': 70, 'make_model': 'bmw series 3', 'sanitized_make': 'bmw', 'odometer_in_km': 217976}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': 37,
     'color': 'mineralgrau',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 4,
     'engine': '2.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'hybrid',
     'id': 'ffd9ee8b-c658-5398-b526-2148aeebe24b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'bmw',
     'make_model': 'bmw series 3',
     'model': 'series 3',
     'odometer': 217976,
     'odometer_in_km': 217976,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffd9ee8b-c658-5398-b526-2148aeebe24b/ffd9ee8b-c658-5398-b526-2148aeebe24b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 368533,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/902/a2259e881f374b2a86691cae213c4375/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-03-12',
     'sanitized_make': 'bmw',
     'seats_number': 5,
     'seller_name': None,
     'title': 'bmw series 3 330e',
     'transmission': 'manual',
     'trim': '330e',
     'vin': None,
     'year': 2020}
2026-01-27 20:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ffd9ee8b-c658-5398-b526-2148aeebe24b spider: ayvens.es
2026-01-27 20:01:44 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ffd9ee8b-c658-5398-b526-2148aeebe24b due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'mineralgrau', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'bmw', 'model': 'series 3', 'trim': '330e', 'title': 'bmw series 3 330e', 'price': 0, 'odometer': 217976, 'odometer_reading_unit': 'km', 'registration_date': '2020-03-12', 'year': 2020, 'fuel_type': 'hybrid', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 37, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ffd9ee8b-c658-5398-b526-2148aeebe24b', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffd9ee8b-c658-5398-b526-2148aeebe24b/ffd9ee8b-c658-5398-b526-2148aeebe24b_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/902/a2259e881f374b2a86691cae213c4375/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 368533}], 'current_year_diff': 6, 'age_in_months': 70, 'make_model': 'bmw series 3', 'sanitized_make': 'bmw', 'odometer_in_km': 217976}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': 37,
     'color': 'mineralgrau',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 4,
     'engine': '2.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'hybrid',
     'id': 'ffd9ee8b-c658-5398-b526-2148aeebe24b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'bmw',
     'make_model': 'bmw series 3',
     'model': 'series 3',
     'odometer': 217976,
     'odometer_in_km': 217976,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffd9ee8b-c658-5398-b526-2148aeebe24b/ffd9ee8b-c658-5398-b526-2148aeebe24b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 368533,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/902/a2259e881f374b2a86691cae213c4375/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-03-12',
     'sanitized_make': 'bmw',
     'seats_number': 5,
     'seller_name': None,
     'title': 'bmw series 3 330e',
     'transmission': 'manual',
     'trim': '330e',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ffd9ee8b-c658-5398-b526-2148aeebe24b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 217976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffd9ee8b-c658-5398-b526-2148aeebe24b/ffd9ee8b-c658-5398-b526-2148aeebe24b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/902/a2259e881f374b2a86691cae213c4375/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 330e',
 'transmission': 'manual',
 'trim': '330e',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875085%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [ayvens.es] INFO: Saving data for 1875085: {'created_time': 1769544104.502954, 'last_price_update_time': 1769544104.502966, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875085') HTTP/1.1" 204 0
2026-01-27 20:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a3fd7d49-4c80-55e6-a217-024792af23f2 with identifier: 1875086
2026-01-27 20:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a3fd7d49-4c80-55e6-a217-024792af23f2 with identifier: 1875086
2026-01-27 20:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155044 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155044
2026-01-27 20:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a3fd7d49-4c80-55e6-a217-024792af23f2 spider: ayvens.es
2026-01-27 20:01:44 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: a3fd7d49-4c80-55e6-a217-024792af23f2 due to rule: high_mileage_for_country.json, error: 155044 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155044
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a3fd7d49-4c80-55e6-a217-024792af23f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 155044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3fd7d49-4c80-55e6-a217-024792af23f2/a3fd7d49-4c80-55e6-a217-024792af23f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/214/447c3b7dc83c4f73858a7b402540b972/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROËN GRAND C4 SPACETOURER BlueHDi 96KW (130CV) EAT8 Shine Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 96KW (130CV) EAT8 Shine Pack',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875086%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [ayvens.es] INFO: Saving data for 1875086: {'created_time': 1769544104.767665, 'last_price_update_time': 1769544104.767678, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875086') HTTP/1.1" 204 0
2026-01-27 20:01:44 [ayvens.es] INFO: Found listing with ID: 1875095
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875095%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [ayvens.es] INFO: Scrape type for 1875095: 1
2026-01-27 20:01:44 [ayvens.es] INFO: Extracting data for car ID: 1875095
2026-01-27 20:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3349dbc6-4637-5230-bf1b-3cf4edba5042 with identifier: 1875095
2026-01-27 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3349dbc6-4637-5230-bf1b-3cf4edba5042 with scrape type 1
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3349dbc6-4637-5230-bf1b-3cf4edba5042
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F258%252F6bec0cc45d0d4522b1ac87461cd3cf35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/258/6bec0cc45d0d4522b1ac87461cd3cf35/images/large/1.jpg not downloaded yet
2026-01-27 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/783/29d67895dd9f401da7b1107048fdf814/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/217/924fea631b5b476aadb6979718ca682f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:44 [ayvens.es] INFO: Found listing with ID: 1875096
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875096%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [ayvens.es] INFO: Scrape type for 1875096: 1
2026-01-27 20:01:44 [ayvens.es] INFO: Extracting data for car ID: 1875096
2026-01-27 20:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13977592-e03f-5429-baf2-e9c938710086 with identifier: 1875096
2026-01-27 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13977592-e03f-5429-baf2-e9c938710086 with scrape type 1
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13977592-e03f-5429-baf2-e9c938710086
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F020%252F5d3c360108da47b4b76d9baac91f6928%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/020/5d3c360108da47b4b76d9baac91f6928/images/large/1.jpg not downloaded yet
2026-01-27 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/351/f5607608bde94550824255c55af77114/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:44 [ayvens.es] INFO: Found listing with ID: 1875097
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875097%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [ayvens.es] INFO: Scrape type for 1875097: 1
2026-01-27 20:01:44 [ayvens.es] INFO: Extracting data for car ID: 1875097
2026-01-27 20:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baf9ef33-103a-5725-8cb2-88bc7a5dcb8a with identifier: 1875097
2026-01-27 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baf9ef33-103a-5725-8cb2-88bc7a5dcb8a with scrape type 1
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item baf9ef33-103a-5725-8cb2-88bc7a5dcb8a
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F1adf57ccddb7418da707a9f60c0d41ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/1adf57ccddb7418da707a9f60c0d41ea/images/large/1.jpg not downloaded yet
2026-01-27 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/760/dd1f8307abc34c019929cf4e3807d77b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/977/8f0dc9ae28414ca991af2e3d9e88f7ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:44 [ayvens.es] INFO: Found listing with ID: 1875098
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875098%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [ayvens.es] INFO: Scrape type for 1875098: 1
2026-01-27 20:01:44 [ayvens.es] INFO: Extracting data for car ID: 1875098
2026-01-27 20:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a710a3fe-b3ae-5958-9ed3-d26d0ecba242 with identifier: 1875098
2026-01-27 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a710a3fe-b3ae-5958-9ed3-d26d0ecba242 with scrape type 1
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a710a3fe-b3ae-5958-9ed3-d26d0ecba242
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F690%252F1e129e4d0355460893061ff348613173%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/690/1e129e4d0355460893061ff348613173/images/large/1.jpg not downloaded yet
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57090ce50>
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e25c506-17be-5b75-855c-5f422f5eeb0e/0e25c506-17be-5b75-855c-5f422f5eeb0e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F783%252F29d67895dd9f401da7b1107048fdf814%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/783/29d67895dd9f401da7b1107048fdf814/images/large/1.jpg saved to cache
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e25c506-17be-5b75-855c-5f422f5eeb0e
2026-01-27 20:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e25c506-17be-5b75-855c-5f422f5eeb0e, skipping ID generation
2026-01-27 20:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e25c506-17be-5b75-855c-5f422f5eeb0e with scrape type 1
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0e25c506-17be-5b75-855c-5f422f5eeb0e from tracking dictionaries
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e25c506-17be-5b75-855c-5f422f5eeb0e sending to next pipeline
2026-01-27 20:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e25c506-17be-5b75-855c-5f422f5eeb0e, identifier: 1875088
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57229ac90>
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61bf0a1b-1120-5812-811a-cd0923378d0a/61bf0a1b-1120-5812-811a-cd0923378d0a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F217%252F924fea631b5b476aadb6979718ca682f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/217/924fea631b5b476aadb6979718ca682f/images/large/1.jpg saved to cache
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61bf0a1b-1120-5812-811a-cd0923378d0a
2026-01-27 20:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61bf0a1b-1120-5812-811a-cd0923378d0a, skipping ID generation
2026-01-27 20:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61bf0a1b-1120-5812-811a-cd0923378d0a with scrape type 1
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 61bf0a1b-1120-5812-811a-cd0923378d0a from tracking dictionaries
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61bf0a1b-1120-5812-811a-cd0923378d0a sending to next pipeline
2026-01-27 20:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 61bf0a1b-1120-5812-811a-cd0923378d0a, identifier: 1875087
2026-01-27 20:01:45 [ayvens.es] INFO: Found listing with ID: 1875099
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875099%27 HTTP/1.1" 200 None
2026-01-27 20:01:45 [ayvens.es] INFO: Scrape type for 1875099: 1
2026-01-27 20:01:45 [ayvens.es] INFO: Extracting data for car ID: 1875099
2026-01-27 20:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f with identifier: 1875099
2026-01-27 20:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f with scrape type 1
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252F5c5bded27f844f46b810097c2c130430%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/5c5bded27f844f46b810097c2c130430/images/large/1.jpg not downloaded yet
2026-01-27 20:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e25c506-17be-5b75-855c-5f422f5eeb0e with identifier: 1875088
2026-01-27 20:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e25c506-17be-5b75-855c-5f422f5eeb0e with identifier: 1875088
2026-01-27 20:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0e25c506-17be-5b75-855c-5f422f5eeb0e with identifier: 1875088 to the API
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/783/29d67895dd9f401da7b1107048fdf814/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0e25c506-17be-5b75-855c-5f422f5eeb0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 86916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e25c506-17be-5b75-855c-5f422f5eeb0e/0e25c506-17be-5b75-855c-5f422f5eeb0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/783/29d67895dd9f401da7b1107048fdf814/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN 2.0TDI 110KW EDITION BMT',
 'transmission': 'manual',
 'trim': '2.0TDI 110KW EDITION BMT',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875088%27 HTTP/1.1" 200 None
2026-01-27 20:01:46 [ayvens.es] INFO: Saving data for 1875088: {'created_time': 1769544106.241186, 'last_price_update_time': 1769544106.241195, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875088') HTTP/1.1" 204 0
2026-01-27 20:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 61bf0a1b-1120-5812-811a-cd0923378d0a with identifier: 1875087
2026-01-27 20:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 61bf0a1b-1120-5812-811a-cd0923378d0a with identifier: 1875087
2026-01-27 20:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184576 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184576
2026-01-27 20:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 61bf0a1b-1120-5812-811a-cd0923378d0a spider: ayvens.es
2026-01-27 20:01:46 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 61bf0a1b-1120-5812-811a-cd0923378d0a due to rule: high_mileage_for_country.json, error: 184576 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184576
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '61bf0a1b-1120-5812-811a-cd0923378d0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 184576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61bf0a1b-1120-5812-811a-cd0923378d0a/61bf0a1b-1120-5812-811a-cd0923378d0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/217/924fea631b5b476aadb6979718ca682f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Business Line BlueHDi 130 EAT8',
 'transmission': 'manual',
 'trim': '5P Business Line BlueHDi 130 EAT8',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875087%27 HTTP/1.1" 200 None
2026-01-27 20:01:46 [ayvens.es] INFO: Saving data for 1875087: {'created_time': 1769544106.473699, 'last_price_update_time': 1769544106.473709, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875087') HTTP/1.1" 204 0
2026-01-27 20:01:46 [ayvens.es] INFO: Found listing with ID: 1875100
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875100%27 HTTP/1.1" 200 None
2026-01-27 20:01:46 [ayvens.es] INFO: Scrape type for 1875100: 1
2026-01-27 20:01:46 [ayvens.es] INFO: Extracting data for car ID: 1875100
2026-01-27 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53958918-7f74-5187-babc-5bf6d310993a with identifier: 1875100
2026-01-27 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53958918-7f74-5187-babc-5bf6d310993a with scrape type 1
2026-01-27 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 53958918-7f74-5187-babc-5bf6d310993a
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F175%252Fe6a90612960b4775a5f2e49b45244827%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/175/e6a90612960b4775a5f2e49b45244827/images/large/1.jpg not downloaded yet
2026-01-27 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/827/7915e5b22dc04fa1b0f26e0a641d384f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572293b90>
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a6ed08-327e-55bc-87aa-6443e1b528ca/a0a6ed08-327e-55bc-87aa-6443e1b528ca_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252Ff5607608bde94550824255c55af77114%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/f5607608bde94550824255c55af77114/images/large/1.jpg saved to cache
2026-01-27 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0a6ed08-327e-55bc-87aa-6443e1b528ca
2026-01-27 20:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0a6ed08-327e-55bc-87aa-6443e1b528ca, skipping ID generation
2026-01-27 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a6ed08-327e-55bc-87aa-6443e1b528ca with scrape type 1
2026-01-27 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a0a6ed08-327e-55bc-87aa-6443e1b528ca from tracking dictionaries
2026-01-27 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0a6ed08-327e-55bc-87aa-6443e1b528ca sending to next pipeline
2026-01-27 20:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a0a6ed08-327e-55bc-87aa-6443e1b528ca, identifier: 1875089
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724f8150>
2026-01-27 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbeaf60b-9b10-5a83-9937-f544d1984f8a/bbeaf60b-9b10-5a83-9937-f544d1984f8a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252Fdd1f8307abc34c019929cf4e3807d77b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/dd1f8307abc34c019929cf4e3807d77b/images/large/1.jpg saved to cache
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbeaf60b-9b10-5a83-9937-f544d1984f8a
2026-01-27 20:01:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbeaf60b-9b10-5a83-9937-f544d1984f8a, skipping ID generation
2026-01-27 20:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbeaf60b-9b10-5a83-9937-f544d1984f8a with scrape type 1
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bbeaf60b-9b10-5a83-9937-f544d1984f8a from tracking dictionaries
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbeaf60b-9b10-5a83-9937-f544d1984f8a sending to next pipeline
2026-01-27 20:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bbeaf60b-9b10-5a83-9937-f544d1984f8a, identifier: 1875090
2026-01-27 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572340ed0>
2026-01-27 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121aaa5b-8320-5911-aa8b-c8adb49221b1/121aaa5b-8320-5911-aa8b-c8adb49221b1_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F977%252F8f0dc9ae28414ca991af2e3d9e88f7ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/977/8f0dc9ae28414ca991af2e3d9e88f7ad/images/large/1.jpg saved to cache
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 121aaa5b-8320-5911-aa8b-c8adb49221b1
2026-01-27 20:01:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 121aaa5b-8320-5911-aa8b-c8adb49221b1, skipping ID generation
2026-01-27 20:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121aaa5b-8320-5911-aa8b-c8adb49221b1 with scrape type 1
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 121aaa5b-8320-5911-aa8b-c8adb49221b1 from tracking dictionaries
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 121aaa5b-8320-5911-aa8b-c8adb49221b1 sending to next pipeline
2026-01-27 20:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 121aaa5b-8320-5911-aa8b-c8adb49221b1, identifier: 1875091
2026-01-27 20:01:47 [ayvens.es] INFO: Found listing with ID: 1875101
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875101%27 HTTP/1.1" 200 None
2026-01-27 20:01:47 [ayvens.es] INFO: Scrape type for 1875101: 1
2026-01-27 20:01:47 [ayvens.es] INFO: Extracting data for car ID: 1875101
2026-01-27 20:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c40f8e61-8449-589f-acca-a3eafd774ffa with identifier: 1875101
2026-01-27 20:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c40f8e61-8449-589f-acca-a3eafd774ffa with scrape type 1
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c40f8e61-8449-589f-acca-a3eafd774ffa
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F111%252F906923c951f041eda904586be23de134%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/111/906923c951f041eda904586be23de134/images/large/1.jpg not downloaded yet
2026-01-27 20:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a0a6ed08-327e-55bc-87aa-6443e1b528ca with identifier: 1875089
2026-01-27 20:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a0a6ed08-327e-55bc-87aa-6443e1b528ca with identifier: 1875089
2026-01-27 20:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a0a6ed08-327e-55bc-87aa-6443e1b528ca with identifier: 1875089 to the API
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/351/f5607608bde94550824255c55af77114/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a0a6ed08-327e-55bc-87aa-6443e1b528ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 121924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a6ed08-327e-55bc-87aa-6443e1b528ca/a0a6ed08-327e-55bc-87aa-6443e1b528ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/351/f5607608bde94550824255c55af77114/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875089%27 HTTP/1.1" 200 None
2026-01-27 20:01:48 [ayvens.es] INFO: Saving data for 1875089: {'created_time': 1769544108.31065, 'last_price_update_time': 1769544108.31066, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875089') HTTP/1.1" 204 0
2026-01-27 20:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bbeaf60b-9b10-5a83-9937-f544d1984f8a with identifier: 1875090
2026-01-27 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bbeaf60b-9b10-5a83-9937-f544d1984f8a with identifier: 1875090
2026-01-27 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162356 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162356
2026-01-27 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bbeaf60b-9b10-5a83-9937-f544d1984f8a spider: ayvens.es
2026-01-27 20:01:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: bbeaf60b-9b10-5a83-9937-f544d1984f8a due to rule: high_mileage_for_country.json, error: 162356 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162356
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bbeaf60b-9b10-5a83-9937-f544d1984f8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 162356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbeaf60b-9b10-5a83-9937-f544d1984f8a/bbeaf60b-9b10-5a83-9937-f544d1984f8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/760/dd1f8307abc34c019929cf4e3807d77b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875090%27 HTTP/1.1" 200 None
2026-01-27 20:01:48 [ayvens.es] INFO: Saving data for 1875090: {'created_time': 1769544108.561491, 'last_price_update_time': 1769544108.561504, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875090') HTTP/1.1" 204 0
2026-01-27 20:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 121aaa5b-8320-5911-aa8b-c8adb49221b1 with identifier: 1875091
2026-01-27 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 121aaa5b-8320-5911-aa8b-c8adb49221b1 with identifier: 1875091
2026-01-27 20:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 121aaa5b-8320-5911-aa8b-c8adb49221b1 with identifier: 1875091 to the API
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/977/8f0dc9ae28414ca991af2e3d9e88f7ad/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '121aaa5b-8320-5911-aa8b-c8adb49221b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 95446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121aaa5b-8320-5911-aa8b-c8adb49221b1/121aaa5b-8320-5911-aa8b-c8adb49221b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/977/8f0dc9ae28414ca991af2e3d9e88f7ad/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875091%27 HTTP/1.1" 200 None
2026-01-27 20:01:48 [ayvens.es] INFO: Saving data for 1875091: {'created_time': 1769544108.95842, 'last_price_update_time': 1769544108.958434, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875091') HTTP/1.1" 204 0
2026-01-27 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/567/d7d15b1e76664e42b9288698ebeb78d2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/777/81689720413e4c3989d1aa575777321c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:49 [ayvens.es] INFO: Found listing with ID: 1875102
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875102%27 HTTP/1.1" 200 None
2026-01-27 20:01:49 [ayvens.es] INFO: Scrape type for 1875102: 1
2026-01-27 20:01:49 [ayvens.es] INFO: Extracting data for car ID: 1875102
2026-01-27 20:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ea731f-f9de-5c04-9e84-275d3f5f3947 with identifier: 1875102
2026-01-27 20:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ea731f-f9de-5c04-9e84-275d3f5f3947 with scrape type 1
2026-01-27 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 85ea731f-f9de-5c04-9e84-275d3f5f3947
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F624%252Fed72ac1397ce495fb36fc9889df99d77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/624/ed72ac1397ce495fb36fc9889df99d77/images/large/1.jpg not downloaded yet
2026-01-27 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57220cdd0>
2026-01-27 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca1dc1e9-a3f0-5159-80cc-491e1469097d/ca1dc1e9-a3f0-5159-80cc-491e1469097d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F827%252F7915e5b22dc04fa1b0f26e0a641d384f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/827/7915e5b22dc04fa1b0f26e0a641d384f/images/large/1.jpg saved to cache
2026-01-27 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca1dc1e9-a3f0-5159-80cc-491e1469097d
2026-01-27 20:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca1dc1e9-a3f0-5159-80cc-491e1469097d, skipping ID generation
2026-01-27 20:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca1dc1e9-a3f0-5159-80cc-491e1469097d with scrape type 1
2026-01-27 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ca1dc1e9-a3f0-5159-80cc-491e1469097d from tracking dictionaries
2026-01-27 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca1dc1e9-a3f0-5159-80cc-491e1469097d sending to next pipeline
2026-01-27 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca1dc1e9-a3f0-5159-80cc-491e1469097d, identifier: 1875094
2026-01-27 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/020/5d3c360108da47b4b76d9baac91f6928/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca1dc1e9-a3f0-5159-80cc-491e1469097d with identifier: 1875094
2026-01-27 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca1dc1e9-a3f0-5159-80cc-491e1469097d with identifier: 1875094
2026-01-27 20:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca1dc1e9-a3f0-5159-80cc-491e1469097d with identifier: 1875094 to the API
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/827/7915e5b22dc04fa1b0f26e0a641d384f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ca1dc1e9-a3f0-5159-80cc-491e1469097d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 47621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca1dc1e9-a3f0-5159-80cc-491e1469097d/ca1dc1e9-a3f0-5159-80cc-491e1469097d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/827/7915e5b22dc04fa1b0f26e0a641d384f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103 kW (140 CV) E6D N-STYLE',
 'transmission': 'manual',
 'trim': 'DIG-T 103 kW (140 CV) E6D N-STYLE',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875094%27 HTTP/1.1" 200 None
2026-01-27 20:01:49 [ayvens.es] INFO: Saving data for 1875094: {'created_time': 1769544109.976747, 'last_price_update_time': 1769544109.976763, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875094') HTTP/1.1" 204 0
2026-01-27 20:01:49 [ayvens.es] INFO: Found listing with ID: 1875103
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875103%27 HTTP/1.1" 200 None
2026-01-27 20:01:50 [ayvens.es] INFO: Scrape type for 1875103: 1
2026-01-27 20:01:50 [ayvens.es] INFO: Extracting data for car ID: 1875103
2026-01-27 20:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3ce0123-baec-533a-8c2f-b3d2550d0683 with identifier: 1875103
2026-01-27 20:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ce0123-baec-533a-8c2f-b3d2550d0683 with scrape type 1
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3ce0123-baec-533a-8c2f-b3d2550d0683
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F476%252Faf17ec2a78e34cf19213f8237101b62e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/476/af17ec2a78e34cf19213f8237101b62e/images/large/1.jpg not downloaded yet
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b58950>
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0fe9e54-3366-5c0b-88ec-bbe8d1667c05/b0fe9e54-3366-5c0b-88ec-bbe8d1667c05_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Fd7d15b1e76664e42b9288698ebeb78d2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/d7d15b1e76664e42b9288698ebeb78d2/images/large/1.jpg saved to cache
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0fe9e54-3366-5c0b-88ec-bbe8d1667c05
2026-01-27 20:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0fe9e54-3366-5c0b-88ec-bbe8d1667c05, skipping ID generation
2026-01-27 20:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 with scrape type 1
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 from tracking dictionaries
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 sending to next pipeline
2026-01-27 20:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b0fe9e54-3366-5c0b-88ec-bbe8d1667c05, identifier: 1875093
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572387cd0>
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9269fcd-7540-5d75-9435-e32a2c20d127/d9269fcd-7540-5d75-9435-e32a2c20d127_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F777%252F81689720413e4c3989d1aa575777321c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/777/81689720413e4c3989d1aa575777321c/images/large/1.jpg saved to cache
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9269fcd-7540-5d75-9435-e32a2c20d127
2026-01-27 20:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9269fcd-7540-5d75-9435-e32a2c20d127, skipping ID generation
2026-01-27 20:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9269fcd-7540-5d75-9435-e32a2c20d127 with scrape type 1
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d9269fcd-7540-5d75-9435-e32a2c20d127 from tracking dictionaries
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9269fcd-7540-5d75-9435-e32a2c20d127 sending to next pipeline
2026-01-27 20:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d9269fcd-7540-5d75-9435-e32a2c20d127, identifier: 1875092
2026-01-27 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/258/6bec0cc45d0d4522b1ac87461cd3cf35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:50 [ayvens.es] INFO: Found listing with ID: 1875104
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875104%27 HTTP/1.1" 200 None
2026-01-27 20:01:50 [ayvens.es] INFO: Scrape type for 1875104: 1
2026-01-27 20:01:50 [ayvens.es] INFO: Extracting data for car ID: 1875104
2026-01-27 20:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c with identifier: 1875104
2026-01-27 20:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c with scrape type 1
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F881%252Fdd25395d7d5a41d6a90cacab62f28149%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/881/dd25395d7d5a41d6a90cacab62f28149/images/large/1.jpg not downloaded yet
2026-01-27 20:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 with identifier: 1875093
2026-01-27 20:01:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 with identifier: 1875093
2026-01-27 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'pintura', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'lynk & co', 'model': '1', 'trim': '1.5 phev 6.6kw', 'title': 'lynk & co 1 1.5 phev 6.6kw', 'price': 0, 'odometer': 29626, 'odometer_reading_unit': 'km', 'registration_date': '2024-11-18', 'year': 2024, 'fuel_type': 'hybrid', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 24, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'b0fe9e54-3366-5c0b-88ec-bbe8d1667c05', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0fe9e54-3366-5c0b-88ec-bbe8d1667c05/b0fe9e54-3366-5c0b-88ec-bbe8d1667c05_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/d7d15b1e76664e42b9288698ebeb78d2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 415580}], 'current_year_diff': 2, 'age_in_months': 14, 'make_model': 'lynk & co 1', 'sanitized_make': 'lynkco', 'odometer_in_km': 29626}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 14,
     'auction_title': '',
     'c_o_2_emission_value': 24,
     'color': 'pintura',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'hybrid',
     'id': 'b0fe9e54-3366-5c0b-88ec-bbe8d1667c05',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'lynk & co',
     'make_model': 'lynk & co 1',
     'model': '1',
     'odometer': 29626,
     'odometer_in_km': 29626,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0fe9e54-3366-5c0b-88ec-bbe8d1667c05/b0fe9e54-3366-5c0b-88ec-bbe8d1667c05_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 415580,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/d7d15b1e76664e42b9288698ebeb78d2/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-11-18',
     'sanitized_make': 'lynkco',
     'seats_number': 5,
     'seller_name': None,
     'title': 'lynk & co 1 1.5 phev 6.6kw',
     'transmission': 'manual',
     'trim': '1.5 phev 6.6kw',
     'vin': None,
     'year': 2024}
2026-01-27 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 spider: ayvens.es
2026-01-27 20:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b0fe9e54-3366-5c0b-88ec-bbe8d1667c05 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'pintura', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'lynk & co', 'model': '1', 'trim': '1.5 phev 6.6kw', 'title': 'lynk & co 1 1.5 phev 6.6kw', 'price': 0, 'odometer': 29626, 'odometer_reading_unit': 'km', 'registration_date': '2024-11-18', 'year': 2024, 'fuel_type': 'hybrid', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 24, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'b0fe9e54-3366-5c0b-88ec-bbe8d1667c05', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0fe9e54-3366-5c0b-88ec-bbe8d1667c05/b0fe9e54-3366-5c0b-88ec-bbe8d1667c05_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/d7d15b1e76664e42b9288698ebeb78d2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 415580}], 'current_year_diff': 2, 'age_in_months': 14, 'make_model': 'lynk & co 1', 'sanitized_make': 'lynkco', 'odometer_in_km': 29626}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 14,
     'auction_title': '',
     'c_o_2_emission_value': 24,
     'color': 'pintura',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'hybrid',
     'id': 'b0fe9e54-3366-5c0b-88ec-bbe8d1667c05',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'lynk & co',
     'make_model': 'lynk & co 1',
     'model': '1',
     'odometer': 29626,
     'odometer_in_km': 29626,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0fe9e54-3366-5c0b-88ec-bbe8d1667c05/b0fe9e54-3366-5c0b-88ec-bbe8d1667c05_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 415580,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/d7d15b1e76664e42b9288698ebeb78d2/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-11-18',
     'sanitized_make': 'lynkco',
     'seats_number': 5,
     'seller_name': None,
     'title': 'lynk & co 1 1.5 phev 6.6kw',
     'transmission': 'manual',
     'trim': '1.5 phev 6.6kw',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b0fe9e54-3366-5c0b-88ec-bbe8d1667c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'LYNK & CO',
 'model': '1',
 'odometer': 29626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0fe9e54-3366-5c0b-88ec-bbe8d1667c05/b0fe9e54-3366-5c0b-88ec-bbe8d1667c05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/d7d15b1e76664e42b9288698ebeb78d2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LYNK & CO 1 1.5 PHEV 6.6kW',
 'transmission': 'manual',
 'trim': '1.5 PHEV 6.6kW',
 'vin': None,
 'year': 2024}
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875093%27 HTTP/1.1" 200 None
2026-01-27 20:01:51 [ayvens.es] INFO: Saving data for 1875093: {'created_time': 1769544111.209331, 'last_price_update_time': 1769544111.209345, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875093') HTTP/1.1" 204 0
2026-01-27 20:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d9269fcd-7540-5d75-9435-e32a2c20d127 with identifier: 1875092
2026-01-27 20:01:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d9269fcd-7540-5d75-9435-e32a2c20d127 with identifier: 1875092
2026-01-27 20:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d9269fcd-7540-5d75-9435-e32a2c20d127 with identifier: 1875092 to the API
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/777/81689720413e4c3989d1aa575777321c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Sapporo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd9269fcd-7540-5d75-9435-e32a2c20d127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 30044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9269fcd-7540-5d75-9435-e32a2c20d127/d9269fcd-7540-5d75-9435-e32a2c20d127_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/777/81689720413e4c3989d1aa575777321c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI E-POWER 140 KW (190 CV) N-Connecta',
 'transmission': 'manual',
 'trim': 'E-POWER 140 KW (190 CV) N-Connecta',
 'vin': None,
 'year': 2023}
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875092%27 HTTP/1.1" 200 None
2026-01-27 20:01:51 [ayvens.es] INFO: Saving data for 1875092: {'created_time': 1769544111.825799, 'last_price_update_time': 1769544111.825811, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875092') HTTP/1.1" 204 0
2026-01-27 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/308/1adf57ccddb7418da707a9f60c0d41ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570946b50>
2026-01-27 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13977592-e03f-5429-baf2-e9c938710086/13977592-e03f-5429-baf2-e9c938710086_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F020%252F5d3c360108da47b4b76d9baac91f6928%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/020/5d3c360108da47b4b76d9baac91f6928/images/large/1.jpg saved to cache
2026-01-27 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13977592-e03f-5429-baf2-e9c938710086
2026-01-27 20:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13977592-e03f-5429-baf2-e9c938710086, skipping ID generation
2026-01-27 20:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13977592-e03f-5429-baf2-e9c938710086 with scrape type 1
2026-01-27 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 13977592-e03f-5429-baf2-e9c938710086 from tracking dictionaries
2026-01-27 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13977592-e03f-5429-baf2-e9c938710086 sending to next pipeline
2026-01-27 20:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13977592-e03f-5429-baf2-e9c938710086, identifier: 1875096
2026-01-27 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/690/1e129e4d0355460893061ff348613173/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:52 [ayvens.es] INFO: Found listing with ID: 1875105
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875105%27 HTTP/1.1" 200 None
2026-01-27 20:01:52 [ayvens.es] INFO: Scrape type for 1875105: 1
2026-01-27 20:01:52 [ayvens.es] INFO: Extracting data for car ID: 1875105
2026-01-27 20:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d62587a1-1dc5-545a-bd8b-fea7d6760191 with identifier: 1875105
2026-01-27 20:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62587a1-1dc5-545a-bd8b-fea7d6760191 with scrape type 1
2026-01-27 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d62587a1-1dc5-545a-bd8b-fea7d6760191
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F675%252Fadcb7b6d52344d3298b1c30d95c0851e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/675/adcb7b6d52344d3298b1c30d95c0851e/images/large/1.jpg not downloaded yet
2026-01-27 20:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13977592-e03f-5429-baf2-e9c938710086 with identifier: 1875096
2026-01-27 20:01:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13977592-e03f-5429-baf2-e9c938710086 with identifier: 1875096
2026-01-27 20:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13977592-e03f-5429-baf2-e9c938710086 with identifier: 1875096 to the API
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/020/5d3c360108da47b4b76d9baac91f6928/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Skyline',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '13977592-e03f-5429-baf2-e9c938710086',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 12790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13977592-e03f-5429-baf2-e9c938710086/13977592-e03f-5429-baf2-e9c938710086_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/020/5d3c360108da47b4b76d9baac91f6928/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI E-POWER 140 KW (190 CV) N-Connecta',
 'transmission': 'manual',
 'trim': 'E-POWER 140 KW (190 CV) N-Connecta',
 'vin': None,
 'year': 2025}
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875096%27 HTTP/1.1" 200 None
2026-01-27 20:01:52 [ayvens.es] INFO: Saving data for 1875096: {'created_time': 1769544112.793517, 'last_price_update_time': 1769544112.793533, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875096') HTTP/1.1" 204 0
2026-01-27 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/175/e6a90612960b4775a5f2e49b45244827/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57090be50>
2026-01-27 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3349dbc6-4637-5230-bf1b-3cf4edba5042/3349dbc6-4637-5230-bf1b-3cf4edba5042_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F258%252F6bec0cc45d0d4522b1ac87461cd3cf35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/258/6bec0cc45d0d4522b1ac87461cd3cf35/images/large/1.jpg saved to cache
2026-01-27 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3349dbc6-4637-5230-bf1b-3cf4edba5042
2026-01-27 20:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3349dbc6-4637-5230-bf1b-3cf4edba5042, skipping ID generation
2026-01-27 20:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3349dbc6-4637-5230-bf1b-3cf4edba5042 with scrape type 1
2026-01-27 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3349dbc6-4637-5230-bf1b-3cf4edba5042 from tracking dictionaries
2026-01-27 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3349dbc6-4637-5230-bf1b-3cf4edba5042 sending to next pipeline
2026-01-27 20:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3349dbc6-4637-5230-bf1b-3cf4edba5042, identifier: 1875095
2026-01-27 20:01:53 [ayvens.es] INFO: Found listing with ID: 1875106
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875106%27 HTTP/1.1" 200 None
2026-01-27 20:01:53 [ayvens.es] INFO: Scrape type for 1875106: 1
2026-01-27 20:01:53 [ayvens.es] INFO: Extracting data for car ID: 1875106
2026-01-27 20:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78bbac7a-4772-5006-bfff-2536c03103d7 with identifier: 1875106
2026-01-27 20:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78bbac7a-4772-5006-bfff-2536c03103d7 with scrape type 1
2026-01-27 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 78bbac7a-4772-5006-bfff-2536c03103d7
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252F6e6de61dd7294b0aaa13c6875cdae375%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/6e6de61dd7294b0aaa13c6875cdae375/images/large/1.jpg not downloaded yet
2026-01-27 20:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3349dbc6-4637-5230-bf1b-3cf4edba5042 with identifier: 1875095
2026-01-27 20:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3349dbc6-4637-5230-bf1b-3cf4edba5042 with identifier: 1875095
2026-01-27 20:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3349dbc6-4637-5230-bf1b-3cf4edba5042 with identifier: 1875095 to the API
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/258/6bec0cc45d0d4522b1ac87461cd3cf35/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3349dbc6-4637-5230-bf1b-3cf4edba5042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 93856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3349dbc6-4637-5230-bf1b-3cf4edba5042/3349dbc6-4637-5230-bf1b-3cf4edba5042_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/258/6bec0cc45d0d4522b1ac87461cd3cf35/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875095%27 HTTP/1.1" 200 None
2026-01-27 20:01:53 [ayvens.es] INFO: Saving data for 1875095: {'created_time': 1769544113.797624, 'last_price_update_time': 1769544113.797634, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875095') HTTP/1.1" 204 0
2026-01-27 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f5bb90>
2026-01-27 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baf9ef33-103a-5725-8cb2-88bc7a5dcb8a/baf9ef33-103a-5725-8cb2-88bc7a5dcb8a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F1adf57ccddb7418da707a9f60c0d41ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/1adf57ccddb7418da707a9f60c0d41ea/images/large/1.jpg saved to cache
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baf9ef33-103a-5725-8cb2-88bc7a5dcb8a
2026-01-27 20:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baf9ef33-103a-5725-8cb2-88bc7a5dcb8a, skipping ID generation
2026-01-27 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baf9ef33-103a-5725-8cb2-88bc7a5dcb8a with scrape type 1
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item baf9ef33-103a-5725-8cb2-88bc7a5dcb8a from tracking dictionaries
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baf9ef33-103a-5725-8cb2-88bc7a5dcb8a sending to next pipeline
2026-01-27 20:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: baf9ef33-103a-5725-8cb2-88bc7a5dcb8a, identifier: 1875097
2026-01-27 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572327e50>
2026-01-27 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a710a3fe-b3ae-5958-9ed3-d26d0ecba242/a710a3fe-b3ae-5958-9ed3-d26d0ecba242_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F690%252F1e129e4d0355460893061ff348613173%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/690/1e129e4d0355460893061ff348613173/images/large/1.jpg saved to cache
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a710a3fe-b3ae-5958-9ed3-d26d0ecba242
2026-01-27 20:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a710a3fe-b3ae-5958-9ed3-d26d0ecba242, skipping ID generation
2026-01-27 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a710a3fe-b3ae-5958-9ed3-d26d0ecba242 with scrape type 1
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a710a3fe-b3ae-5958-9ed3-d26d0ecba242 from tracking dictionaries
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a710a3fe-b3ae-5958-9ed3-d26d0ecba242 sending to next pipeline
2026-01-27 20:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a710a3fe-b3ae-5958-9ed3-d26d0ecba242, identifier: 1875098
2026-01-27 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/111/906923c951f041eda904586be23de134/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:54 [ayvens.es] INFO: Found listing with ID: 1875107
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875107%27 HTTP/1.1" 200 None
2026-01-27 20:01:54 [ayvens.es] INFO: Scrape type for 1875107: 1
2026-01-27 20:01:54 [ayvens.es] INFO: Extracting data for car ID: 1875107
2026-01-27 20:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f88e5e-a328-58db-803f-3e85f91f8575 with identifier: 1875107
2026-01-27 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f88e5e-a328-58db-803f-3e85f91f8575 with scrape type 1
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 95f88e5e-a328-58db-803f-3e85f91f8575
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F726%252F1448e62a560c4f0f9ad12dfc3433bd34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/726/1448e62a560c4f0f9ad12dfc3433bd34/images/large/1.jpg not downloaded yet
2026-01-27 20:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: baf9ef33-103a-5725-8cb2-88bc7a5dcb8a with identifier: 1875097
2026-01-27 20:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: baf9ef33-103a-5725-8cb2-88bc7a5dcb8a with identifier: 1875097
2026-01-27 20:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: baf9ef33-103a-5725-8cb2-88bc7a5dcb8a with identifier: 1875097 to the API
2026-01-27 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/308/1adf57ccddb7418da707a9f60c0d41ea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'baf9ef33-103a-5725-8cb2-88bc7a5dcb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 82990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baf9ef33-103a-5725-8cb2-88bc7a5dcb8a/baf9ef33-103a-5725-8cb2-88bc7a5dcb8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/1adf57ccddb7418da707a9f60c0d41ea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.4 66kW (90CV) Selective Pro',
 'transmission': 'manual',
 'trim': '1.4 66kW (90CV) Selective Pro',
 'vin': None,
 'year': 2019}
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875097%27 HTTP/1.1" 200 None
2026-01-27 20:01:58 [ayvens.es] INFO: Saving data for 1875097: {'created_time': 1769544118.231101, 'last_price_update_time': 1769544118.231113, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875097') HTTP/1.1" 204 0
2026-01-27 20:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a710a3fe-b3ae-5958-9ed3-d26d0ecba242 with identifier: 1875098
2026-01-27 20:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a710a3fe-b3ae-5958-9ed3-d26d0ecba242 with identifier: 1875098
2026-01-27 20:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a710a3fe-b3ae-5958-9ed3-d26d0ecba242 with identifier: 1875098 to the API
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/690/1e129e4d0355460893061ff348613173/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a710a3fe-b3ae-5958-9ed3-d26d0ecba242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 44165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a710a3fe-b3ae-5958-9ed3-d26d0ecba242/a710a3fe-b3ae-5958-9ed3-d26d0ecba242_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/690/1e129e4d0355460893061ff348613173/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l PLUG-IN 300PH (e-CVT) Advance',
 'transmission': 'manual',
 'trim': '2.5l PLUG-IN 300PH (e-CVT) Advance',
 'vin': None,
 'year': 2021}
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875098%27 HTTP/1.1" 200 None
2026-01-27 20:01:58 [ayvens.es] INFO: Saving data for 1875098: {'created_time': 1769544118.733581, 'last_price_update_time': 1769544118.733596, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875098') HTTP/1.1" 204 0
2026-01-27 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570949250>
2026-01-27 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53958918-7f74-5187-babc-5bf6d310993a/53958918-7f74-5187-babc-5bf6d310993a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F175%252Fe6a90612960b4775a5f2e49b45244827%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/175/e6a90612960b4775a5f2e49b45244827/images/large/1.jpg saved to cache
2026-01-27 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53958918-7f74-5187-babc-5bf6d310993a
2026-01-27 20:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53958918-7f74-5187-babc-5bf6d310993a, skipping ID generation
2026-01-27 20:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53958918-7f74-5187-babc-5bf6d310993a with scrape type 1
2026-01-27 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 53958918-7f74-5187-babc-5bf6d310993a from tracking dictionaries
2026-01-27 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53958918-7f74-5187-babc-5bf6d310993a sending to next pipeline
2026-01-27 20:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 53958918-7f74-5187-babc-5bf6d310993a, identifier: 1875100
2026-01-27 20:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 53958918-7f74-5187-babc-5bf6d310993a with identifier: 1875100
2026-01-27 20:01:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 53958918-7f74-5187-babc-5bf6d310993a with identifier: 1875100
2026-01-27 20:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 53958918-7f74-5187-babc-5bf6d310993a with identifier: 1875100 to the API
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/175/e6a90612960b4775a5f2e49b45244827/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'color': 'Cristal',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '53958918-7f74-5187-babc-5bf6d310993a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 9',
 'odometer': 31205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53958918-7f74-5187-babc-5bf6d310993a/53958918-7f74-5187-babc-5bf6d310993a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/175/e6a90612960b4775a5f2e49b45244827/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 9 E-TENSE 225 RIVOLI +',
 'transmission': 'manual',
 'trim': 'E-TENSE 225 RIVOLI +',
 'vin': None,
 'year': 2022}
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875100%27 HTTP/1.1" 200 None
2026-01-27 20:01:59 [ayvens.es] INFO: Saving data for 1875100: {'created_time': 1769544119.668996, 'last_price_update_time': 1769544119.669006, 'auction_closing_time': 1769601600.0}
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875100') HTTP/1.1" 204 0
2026-01-27 20:01:59 [ayvens.es] INFO: Found listing with ID: 1875108
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875108%27 HTTP/1.1" 200 None
2026-01-27 20:01:59 [ayvens.es] INFO: Scrape type for 1875108: 1
2026-01-27 20:01:59 [ayvens.es] INFO: Extracting data for car ID: 1875108
2026-01-27 20:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca06c6a-bb41-560f-bcc1-d07c306c72c3 with identifier: 1875108
2026-01-27 20:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca06c6a-bb41-560f-bcc1-d07c306c72c3 with scrape type 1
2026-01-27 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3ca06c6a-bb41-560f-bcc1-d07c306c72c3
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F337%252F7cc36cf7274b4c489be06480731cbf81%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/337/7cc36cf7274b4c489be06480731cbf81/images/large/1.jpg not downloaded yet
2026-01-27 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/962/5c5bded27f844f46b810097c2c130430/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572350950>
2026-01-27 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c40f8e61-8449-589f-acca-a3eafd774ffa/c40f8e61-8449-589f-acca-a3eafd774ffa_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F111%252F906923c951f041eda904586be23de134%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/111/906923c951f041eda904586be23de134/images/large/1.jpg saved to cache
2026-01-27 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c40f8e61-8449-589f-acca-a3eafd774ffa
2026-01-27 20:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c40f8e61-8449-589f-acca-a3eafd774ffa, skipping ID generation
2026-01-27 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c40f8e61-8449-589f-acca-a3eafd774ffa with scrape type 1
2026-01-27 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c40f8e61-8449-589f-acca-a3eafd774ffa from tracking dictionaries
2026-01-27 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c40f8e61-8449-589f-acca-a3eafd774ffa sending to next pipeline
2026-01-27 20:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c40f8e61-8449-589f-acca-a3eafd774ffa, identifier: 1875101
2026-01-27 20:02:00 [ayvens.es] INFO: Found listing with ID: 1875109
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875109%27 HTTP/1.1" 200 None
2026-01-27 20:02:00 [ayvens.es] INFO: Scrape type for 1875109: 1
2026-01-27 20:02:00 [ayvens.es] INFO: Extracting data for car ID: 1875109
2026-01-27 20:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9670abe6-0c12-5245-9286-bfae1490d6ce with identifier: 1875109
2026-01-27 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9670abe6-0c12-5245-9286-bfae1490d6ce with scrape type 1
2026-01-27 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9670abe6-0c12-5245-9286-bfae1490d6ce
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252F7a57b841052c42efaa1a2e23c56059d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/7a57b841052c42efaa1a2e23c56059d0/images/large/1.jpg not downloaded yet
2026-01-27 20:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c40f8e61-8449-589f-acca-a3eafd774ffa with identifier: 1875101
2026-01-27 20:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c40f8e61-8449-589f-acca-a3eafd774ffa with identifier: 1875101
2026-01-27 20:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c40f8e61-8449-589f-acca-a3eafd774ffa with identifier: 1875101 to the API
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/111/906923c951f041eda904586be23de134/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c40f8e61-8449-589f-acca-a3eafd774ffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 48770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c40f8e61-8449-589f-acca-a3eafd774ffa/c40f8e61-8449-589f-acca-a3eafd774ffa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/111/906923c951f041eda904586be23de134/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875101%27 HTTP/1.1" 200 None
2026-01-27 20:02:00 [ayvens.es] INFO: Saving data for 1875101: {'created_time': 1769544120.725808, 'last_price_update_time': 1769544120.725822, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875101') HTTP/1.1" 204 0
2026-01-27 20:02:00 [ayvens.es] INFO: Found listing with ID: 1875110
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875110%27 HTTP/1.1" 200 None
2026-01-27 20:02:00 [ayvens.es] INFO: Scrape type for 1875110: 1
2026-01-27 20:02:00 [ayvens.es] INFO: Extracting data for car ID: 1875110
2026-01-27 20:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1bd14af-81f7-5ea0-84dc-8c6ec079715e with identifier: 1875110
2026-01-27 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bd14af-81f7-5ea0-84dc-8c6ec079715e with scrape type 1
2026-01-27 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a1bd14af-81f7-5ea0-84dc-8c6ec079715e
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F500%252F13ab790bc1a9445b8bc1b7c84fd1bec5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/500/13ab790bc1a9445b8bc1b7c84fd1bec5/images/large/1.jpg not downloaded yet
2026-01-27 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572137810>
2026-01-27 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f/8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252F5c5bded27f844f46b810097c2c130430%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/5c5bded27f844f46b810097c2c130430/images/large/1.jpg saved to cache
2026-01-27 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f
2026-01-27 20:02:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f, skipping ID generation
2026-01-27 20:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f with scrape type 1
2026-01-27 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f from tracking dictionaries
2026-01-27 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f sending to next pipeline
2026-01-27 20:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f, identifier: 1875099
2026-01-27 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/881/dd25395d7d5a41d6a90cacab62f28149/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:01 [ayvens.es] INFO: Found listing with ID: 1875111
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875111%27 HTTP/1.1" 200 None
2026-01-27 20:02:01 [ayvens.es] INFO: Scrape type for 1875111: 1
2026-01-27 20:02:01 [ayvens.es] INFO: Extracting data for car ID: 1875111
2026-01-27 20:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5dcf5a5-5dda-5c60-88df-693c5fd20f46 with identifier: 1875111
2026-01-27 20:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5dcf5a5-5dda-5c60-88df-693c5fd20f46 with scrape type 1
2026-01-27 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5dcf5a5-5dda-5c60-88df-693c5fd20f46
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F290%252Fed6c397b1f04467e822197b50e1cd524%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/290/ed6c397b1f04467e822197b50e1cd524/images/large/1.jpg not downloaded yet
2026-01-27 20:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f with identifier: 1875099
2026-01-27 20:02:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f with identifier: 1875099
2026-01-27 20:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f with identifier: 1875099 to the API
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/962/5c5bded27f844f46b810097c2c130430/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Midnight',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 27473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f/8df7fc9d-3d88-5e75-a91e-7b8df34c7b6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/962/5c5bded27f844f46b810097c2c130430/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI E-POWER 140 KW (190 CV) N-Connecta',
 'transmission': 'manual',
 'trim': 'E-POWER 140 KW (190 CV) N-Connecta',
 'vin': None,
 'year': 2024}
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875099%27 HTTP/1.1" 200 None
2026-01-27 20:02:01 [ayvens.es] INFO: Saving data for 1875099: {'created_time': 1769544121.771161, 'last_price_update_time': 1769544121.771177, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875099') HTTP/1.1" 204 0
2026-01-27 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/624/ed72ac1397ce495fb36fc9889df99d77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/476/af17ec2a78e34cf19213f8237101b62e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:01 [ayvens.es] INFO: Found listing with ID: 1875112
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875112%27 HTTP/1.1" 200 None
2026-01-27 20:02:01 [ayvens.es] INFO: Scrape type for 1875112: 1
2026-01-27 20:02:01 [ayvens.es] INFO: Extracting data for car ID: 1875112
2026-01-27 20:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260ad7c6-7bbf-5474-988e-5c4f11c2dc58 with identifier: 1875112
2026-01-27 20:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260ad7c6-7bbf-5474-988e-5c4f11c2dc58 with scrape type 1
2026-01-27 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 260ad7c6-7bbf-5474-988e-5c4f11c2dc58
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F835%252F72ceb1a956e4426d8117b1ac21aeab02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/835/72ceb1a956e4426d8117b1ac21aeab02/images/large/1.jpg not downloaded yet
2026-01-27 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/726/1448e62a560c4f0f9ad12dfc3433bd34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572299410>
2026-01-27 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c/32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F881%252Fdd25395d7d5a41d6a90cacab62f28149%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/881/dd25395d7d5a41d6a90cacab62f28149/images/large/1.jpg saved to cache
2026-01-27 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c
2026-01-27 20:02:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c, skipping ID generation
2026-01-27 20:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c with scrape type 1
2026-01-27 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c from tracking dictionaries
2026-01-27 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c sending to next pipeline
2026-01-27 20:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c, identifier: 1875104
2026-01-27 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/675/adcb7b6d52344d3298b1c30d95c0851e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:02 [ayvens.es] INFO: Found listing with ID: 1875113
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875113%27 HTTP/1.1" 200 None
2026-01-27 20:02:02 [ayvens.es] INFO: Scrape type for 1875113: 1
2026-01-27 20:02:02 [ayvens.es] INFO: Extracting data for car ID: 1875113
2026-01-27 20:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c with identifier: 1875113
2026-01-27 20:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c with scrape type 1
2026-01-27 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F201%252Fdbc8673203164684848dea764b6b5eb4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/201/dbc8673203164684848dea764b6b5eb4/images/large/1.jpg not downloaded yet
2026-01-27 20:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c with identifier: 1875104
2026-01-27 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c with identifier: 1875104
2026-01-27 20:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c with identifier: 1875104 to the API
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/881/dd25395d7d5a41d6a90cacab62f28149/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO',
 'odometer': 21297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c/32fb2bd0-b2fd-54c3-96e7-41b2380fcf7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/881/dd25395d7d5a41d6a90cacab62f28149/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TAIGO Life 1.0 TSI 81kW (110CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 1.0 TSI 81kW (110CV) DSG',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875104%27 HTTP/1.1" 200 None
2026-01-27 20:02:02 [ayvens.es] INFO: Saving data for 1875104: {'created_time': 1769544122.763362, 'last_price_update_time': 1769544122.763373, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875104') HTTP/1.1" 204 0
2026-01-27 20:02:02 [ayvens.es] INFO: Found listing with ID: 1875114
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875114%27 HTTP/1.1" 200 None
2026-01-27 20:02:02 [ayvens.es] INFO: Scrape type for 1875114: 1
2026-01-27 20:02:02 [ayvens.es] INFO: Extracting data for car ID: 1875114
2026-01-27 20:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e with identifier: 1875114
2026-01-27 20:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e with scrape type 1
2026-01-27 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F500%252Fafc43dd2da794b6ea21aafdccae39477%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/500/afc43dd2da794b6ea21aafdccae39477/images/large/1.jpg not downloaded yet
2026-01-27 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5723160d0>
2026-01-27 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85ea731f-f9de-5c04-9e84-275d3f5f3947/85ea731f-f9de-5c04-9e84-275d3f5f3947_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F624%252Fed72ac1397ce495fb36fc9889df99d77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/624/ed72ac1397ce495fb36fc9889df99d77/images/large/1.jpg saved to cache
2026-01-27 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85ea731f-f9de-5c04-9e84-275d3f5f3947
2026-01-27 20:02:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85ea731f-f9de-5c04-9e84-275d3f5f3947, skipping ID generation
2026-01-27 20:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ea731f-f9de-5c04-9e84-275d3f5f3947 with scrape type 1
2026-01-27 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 85ea731f-f9de-5c04-9e84-275d3f5f3947 from tracking dictionaries
2026-01-27 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85ea731f-f9de-5c04-9e84-275d3f5f3947 sending to next pipeline
2026-01-27 20:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 85ea731f-f9de-5c04-9e84-275d3f5f3947, identifier: 1875102
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722901d0>
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3ce0123-baec-533a-8c2f-b3d2550d0683/c3ce0123-baec-533a-8c2f-b3d2550d0683_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F476%252Faf17ec2a78e34cf19213f8237101b62e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/476/af17ec2a78e34cf19213f8237101b62e/images/large/1.jpg saved to cache
2026-01-27 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3ce0123-baec-533a-8c2f-b3d2550d0683
2026-01-27 20:02:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3ce0123-baec-533a-8c2f-b3d2550d0683, skipping ID generation
2026-01-27 20:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ce0123-baec-533a-8c2f-b3d2550d0683 with scrape type 1
2026-01-27 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c3ce0123-baec-533a-8c2f-b3d2550d0683 from tracking dictionaries
2026-01-27 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3ce0123-baec-533a-8c2f-b3d2550d0683 sending to next pipeline
2026-01-27 20:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3ce0123-baec-533a-8c2f-b3d2550d0683, identifier: 1875103
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f18a50>
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f88e5e-a328-58db-803f-3e85f91f8575/95f88e5e-a328-58db-803f-3e85f91f8575_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F726%252F1448e62a560c4f0f9ad12dfc3433bd34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/726/1448e62a560c4f0f9ad12dfc3433bd34/images/large/1.jpg saved to cache
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95f88e5e-a328-58db-803f-3e85f91f8575
2026-01-27 20:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95f88e5e-a328-58db-803f-3e85f91f8575, skipping ID generation
2026-01-27 20:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f88e5e-a328-58db-803f-3e85f91f8575 with scrape type 1
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 95f88e5e-a328-58db-803f-3e85f91f8575 from tracking dictionaries
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95f88e5e-a328-58db-803f-3e85f91f8575 sending to next pipeline
2026-01-27 20:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 95f88e5e-a328-58db-803f-3e85f91f8575, identifier: 1875107
2026-01-27 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f87590>
2026-01-27 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62587a1-1dc5-545a-bd8b-fea7d6760191/d62587a1-1dc5-545a-bd8b-fea7d6760191_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F675%252Fadcb7b6d52344d3298b1c30d95c0851e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/675/adcb7b6d52344d3298b1c30d95c0851e/images/large/1.jpg saved to cache
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d62587a1-1dc5-545a-bd8b-fea7d6760191
2026-01-27 20:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d62587a1-1dc5-545a-bd8b-fea7d6760191, skipping ID generation
2026-01-27 20:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62587a1-1dc5-545a-bd8b-fea7d6760191 with scrape type 1
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d62587a1-1dc5-545a-bd8b-fea7d6760191 from tracking dictionaries
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d62587a1-1dc5-545a-bd8b-fea7d6760191 sending to next pipeline
2026-01-27 20:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d62587a1-1dc5-545a-bd8b-fea7d6760191, identifier: 1875105
2026-01-27 20:02:04 [ayvens.es] INFO: Found listing with ID: 1875115
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875115%27 HTTP/1.1" 200 None
2026-01-27 20:02:04 [ayvens.es] INFO: Scrape type for 1875115: 1
2026-01-27 20:02:04 [ayvens.es] INFO: Extracting data for car ID: 1875115
2026-01-27 20:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a0b1343-8a89-5572-8cad-0ec5718ac47e with identifier: 1875115
2026-01-27 20:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0b1343-8a89-5572-8cad-0ec5718ac47e with scrape type 1
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4a0b1343-8a89-5572-8cad-0ec5718ac47e
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F598%252F1a25673194aa4cb1bb268496a5aa2639%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/598/1a25673194aa4cb1bb268496a5aa2639/images/large/1.jpg not downloaded yet
2026-01-27 20:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 85ea731f-f9de-5c04-9e84-275d3f5f3947 with identifier: 1875102
2026-01-27 20:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 85ea731f-f9de-5c04-9e84-275d3f5f3947 with identifier: 1875102
2026-01-27 20:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'allure puretech 100 s&s 6 vel. man', 'title': 'peugeot 2008 allure puretech 100 s&s 6 vel. man', 'price': 0, 'odometer': 13639, 'odometer_reading_unit': 'km', 'registration_date': '2024-11-25', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 129, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '85ea731f-f9de-5c04-9e84-275d3f5f3947', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ea731f-f9de-5c04-9e84-275d3f5f3947/85ea731f-f9de-5c04-9e84-275d3f5f3947_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/624/ed72ac1397ce495fb36fc9889df99d77/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 634868}], 'current_year_diff': 2, 'age_in_months': 14, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 13639}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 14,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'color': 'gris',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '85ea731f-f9de-5c04-9e84-275d3f5f3947',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 13639,
     'odometer_in_km': 13639,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ea731f-f9de-5c04-9e84-275d3f5f3947/85ea731f-f9de-5c04-9e84-275d3f5f3947_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 634868,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/624/ed72ac1397ce495fb36fc9889df99d77/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-11-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 allure puretech 100 s&s 6 vel. man',
     'transmission': 'manual',
     'trim': 'allure puretech 100 s&s 6 vel. man',
     'vin': None,
     'year': 2024}
2026-01-27 20:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 85ea731f-f9de-5c04-9e84-275d3f5f3947 spider: ayvens.es
2026-01-27 20:02:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 85ea731f-f9de-5c04-9e84-275d3f5f3947 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'allure puretech 100 s&s 6 vel. man', 'title': 'peugeot 2008 allure puretech 100 s&s 6 vel. man', 'price': 0, 'odometer': 13639, 'odometer_reading_unit': 'km', 'registration_date': '2024-11-25', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 129, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '85ea731f-f9de-5c04-9e84-275d3f5f3947', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ea731f-f9de-5c04-9e84-275d3f5f3947/85ea731f-f9de-5c04-9e84-275d3f5f3947_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/624/ed72ac1397ce495fb36fc9889df99d77/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 634868}], 'current_year_diff': 2, 'age_in_months': 14, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 13639}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 14,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'color': 'gris',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '85ea731f-f9de-5c04-9e84-275d3f5f3947',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 13639,
     'odometer_in_km': 13639,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ea731f-f9de-5c04-9e84-275d3f5f3947/85ea731f-f9de-5c04-9e84-275d3f5f3947_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 634868,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/624/ed72ac1397ce495fb36fc9889df99d77/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-11-25',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 allure puretech 100 s&s 6 vel. man',
     'transmission': 'manual',
     'trim': 'allure puretech 100 s&s 6 vel. man',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '85ea731f-f9de-5c04-9e84-275d3f5f3947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 13639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ea731f-f9de-5c04-9e84-275d3f5f3947/85ea731f-f9de-5c04-9e84-275d3f5f3947_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/624/ed72ac1397ce495fb36fc9889df99d77/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Allure Puretech 100 S&S 6 Vel. MAN',
 'transmission': 'manual',
 'trim': 'Allure Puretech 100 S&S 6 Vel. MAN',
 'vin': None,
 'year': 2024}
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875102%27 HTTP/1.1" 200 None
2026-01-27 20:02:04 [ayvens.es] INFO: Saving data for 1875102: {'created_time': 1769544124.92562, 'last_price_update_time': 1769544124.925633, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875102') HTTP/1.1" 204 0
2026-01-27 20:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3ce0123-baec-533a-8c2f-b3d2550d0683 with identifier: 1875103
2026-01-27 20:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3ce0123-baec-533a-8c2f-b3d2550d0683 with identifier: 1875103
2026-01-27 20:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3ce0123-baec-533a-8c2f-b3d2550d0683 with identifier: 1875103 to the API
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/476/af17ec2a78e34cf19213f8237101b62e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c3ce0123-baec-533a-8c2f-b3d2550d0683',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 79818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ce0123-baec-533a-8c2f-b3d2550d0683/c3ce0123-baec-533a-8c2f-b3d2550d0683_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/476/af17ec2a78e34cf19213f8237101b62e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103 kW (140 CV) E6D N-STYLE',
 'transmission': 'manual',
 'trim': 'DIG-T 103 kW (140 CV) E6D N-STYLE',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875103%27 HTTP/1.1" 200 None
2026-01-27 20:02:05 [ayvens.es] INFO: Saving data for 1875103: {'created_time': 1769544125.441268, 'last_price_update_time': 1769544125.441279, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875103') HTTP/1.1" 204 0
2026-01-27 20:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 95f88e5e-a328-58db-803f-3e85f91f8575 with identifier: 1875107
2026-01-27 20:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 95f88e5e-a328-58db-803f-3e85f91f8575 with identifier: 1875107
2026-01-27 20:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 95f88e5e-a328-58db-803f-3e85f91f8575 with identifier: 1875107 to the API
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/726/1448e62a560c4f0f9ad12dfc3433bd34/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '95f88e5e-a328-58db-803f-3e85f91f8575',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 45181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f88e5e-a328-58db-803f-3e85f91f8575/95f88e5e-a328-58db-803f-3e85f91f8575_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/726/1448e62a560c4f0f9ad12dfc3433bd34/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875107%27 HTTP/1.1" 200 None
2026-01-27 20:02:05 [ayvens.es] INFO: Saving data for 1875107: {'created_time': 1769544125.839884, 'last_price_update_time': 1769544125.839897, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875107') HTTP/1.1" 204 0
2026-01-27 20:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d62587a1-1dc5-545a-bd8b-fea7d6760191 with identifier: 1875105
2026-01-27 20:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d62587a1-1dc5-545a-bd8b-fea7d6760191 with identifier: 1875105
2026-01-27 20:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d62587a1-1dc5-545a-bd8b-fea7d6760191 with identifier: 1875105 to the API
2026-01-27 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/675/adcb7b6d52344d3298b1c30d95c0851e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd62587a1-1dc5-545a-bd8b-fea7d6760191',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 37850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62587a1-1dc5-545a-bd8b-fea7d6760191/d62587a1-1dc5-545a-bd8b-fea7d6760191_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/675/adcb7b6d52344d3298b1c30d95c0851e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875105%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [ayvens.es] INFO: Saving data for 1875105: {'created_time': 1769544126.223538, 'last_price_update_time': 1769544126.223551, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875105') HTTP/1.1" 204 0
2026-01-27 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/875/6e6de61dd7294b0aaa13c6875cdae375/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/337/7cc36cf7274b4c489be06480731cbf81/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:06 [ayvens.es] INFO: Found listing with ID: 1875116
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875116%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [ayvens.es] INFO: Scrape type for 1875116: 1
2026-01-27 20:02:06 [ayvens.es] INFO: Extracting data for car ID: 1875116
2026-01-27 20:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d0f88b-d116-56a2-9c64-347af762e48d with identifier: 1875116
2026-01-27 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d0f88b-d116-56a2-9c64-347af762e48d with scrape type 1
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 01d0f88b-d116-56a2-9c64-347af762e48d
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fb15538d8019d47a2867b8c4b00e39db1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/b15538d8019d47a2867b8c4b00e39db1/images/large/1.jpg not downloaded yet
2026-01-27 20:02:06 [ayvens.es] INFO: Found listing with ID: 1875117
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875117%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [ayvens.es] INFO: Scrape type for 1875117: 1
2026-01-27 20:02:06 [ayvens.es] INFO: Extracting data for car ID: 1875117
2026-01-27 20:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 160b9113-b697-5a19-885f-670c600471f3 with identifier: 1875117
2026-01-27 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 160b9113-b697-5a19-885f-670c600471f3 with scrape type 1
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 160b9113-b697-5a19-885f-670c600471f3
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F679%252F591c76446e984267a288593d5c8670c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/679/591c76446e984267a288593d5c8670c2/images/large/1.jpg not downloaded yet
2026-01-27 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/684/7a57b841052c42efaa1a2e23c56059d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:06 [ayvens.es] INFO: Found listing with ID: 1875118
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875118%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [ayvens.es] INFO: Scrape type for 1875118: 1
2026-01-27 20:02:06 [ayvens.es] INFO: Extracting data for car ID: 1875118
2026-01-27 20:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2360781a-3c0a-5126-8689-e3e4100fa7b5 with identifier: 1875118
2026-01-27 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2360781a-3c0a-5126-8689-e3e4100fa7b5 with scrape type 1
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2360781a-3c0a-5126-8689-e3e4100fa7b5
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F926%252F0d97f1dcb7bf447290fb017e32abfef3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/926/0d97f1dcb7bf447290fb017e32abfef3/images/large/1.jpg not downloaded yet
2026-01-27 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/835/72ceb1a956e4426d8117b1ac21aeab02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:06 [ayvens.es] INFO: Found listing with ID: 1875119
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875119%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [ayvens.es] INFO: Scrape type for 1875119: 1
2026-01-27 20:02:06 [ayvens.es] INFO: Extracting data for car ID: 1875119
2026-01-27 20:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dcd5d0a-af78-5a16-b116-4923fc5df882 with identifier: 1875119
2026-01-27 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcd5d0a-af78-5a16-b116-4923fc5df882 with scrape type 1
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7dcd5d0a-af78-5a16-b116-4923fc5df882
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F907%252Ffe7abb3d37334a009bfe6def32847b4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/907/fe7abb3d37334a009bfe6def32847b4b/images/large/1.jpg not downloaded yet
2026-01-27 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/500/13ab790bc1a9445b8bc1b7c84fd1bec5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/290/ed6c397b1f04467e822197b50e1cd524/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572290550>
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78bbac7a-4772-5006-bfff-2536c03103d7/78bbac7a-4772-5006-bfff-2536c03103d7_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252F6e6de61dd7294b0aaa13c6875cdae375%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/6e6de61dd7294b0aaa13c6875cdae375/images/large/1.jpg saved to cache
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78bbac7a-4772-5006-bfff-2536c03103d7
2026-01-27 20:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78bbac7a-4772-5006-bfff-2536c03103d7, skipping ID generation
2026-01-27 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78bbac7a-4772-5006-bfff-2536c03103d7 with scrape type 1
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 78bbac7a-4772-5006-bfff-2536c03103d7 from tracking dictionaries
2026-01-27 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78bbac7a-4772-5006-bfff-2536c03103d7 sending to next pipeline
2026-01-27 20:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 78bbac7a-4772-5006-bfff-2536c03103d7, identifier: 1875106
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570955290>
2026-01-27 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca06c6a-bb41-560f-bcc1-d07c306c72c3/3ca06c6a-bb41-560f-bcc1-d07c306c72c3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F337%252F7cc36cf7274b4c489be06480731cbf81%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/337/7cc36cf7274b4c489be06480731cbf81/images/large/1.jpg saved to cache
2026-01-27 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ca06c6a-bb41-560f-bcc1-d07c306c72c3
2026-01-27 20:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ca06c6a-bb41-560f-bcc1-d07c306c72c3, skipping ID generation
2026-01-27 20:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca06c6a-bb41-560f-bcc1-d07c306c72c3 with scrape type 1
2026-01-27 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3ca06c6a-bb41-560f-bcc1-d07c306c72c3 from tracking dictionaries
2026-01-27 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ca06c6a-bb41-560f-bcc1-d07c306c72c3 sending to next pipeline
2026-01-27 20:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3ca06c6a-bb41-560f-bcc1-d07c306c72c3, identifier: 1875108
2026-01-27 20:02:07 [ayvens.es] INFO: Found listing with ID: 1875120
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875120%27 HTTP/1.1" 200 None
2026-01-27 20:02:07 [ayvens.es] INFO: Scrape type for 1875120: 1
2026-01-27 20:02:07 [ayvens.es] INFO: Extracting data for car ID: 1875120
2026-01-27 20:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf718185-608f-590b-a8da-140a9adec458 with identifier: 1875120
2026-01-27 20:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf718185-608f-590b-a8da-140a9adec458 with scrape type 1
2026-01-27 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf718185-608f-590b-a8da-140a9adec458
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252Fce9b1e843a554d3d92f6214777541e13%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/ce9b1e843a554d3d92f6214777541e13/images/large/1.jpg not downloaded yet
2026-01-27 20:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 78bbac7a-4772-5006-bfff-2536c03103d7 with identifier: 1875106
2026-01-27 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 78bbac7a-4772-5006-bfff-2536c03103d7 with identifier: 1875106
2026-01-27 20:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 78bbac7a-4772-5006-bfff-2536c03103d7 with identifier: 1875106 to the API
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/875/6e6de61dd7294b0aaa13c6875cdae375/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '78bbac7a-4772-5006-bfff-2536c03103d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 59475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78bbac7a-4772-5006-bfff-2536c03103d7/78bbac7a-4772-5006-bfff-2536c03103d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/875/6e6de61dd7294b0aaa13c6875cdae375/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875106%27 HTTP/1.1" 200 None
2026-01-27 20:02:07 [ayvens.es] INFO: Saving data for 1875106: {'created_time': 1769544127.675038, 'last_price_update_time': 1769544127.675048, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875106') HTTP/1.1" 204 0
2026-01-27 20:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3ca06c6a-bb41-560f-bcc1-d07c306c72c3 with identifier: 1875108
2026-01-27 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3ca06c6a-bb41-560f-bcc1-d07c306c72c3 with identifier: 1875108
2026-01-27 20:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3ca06c6a-bb41-560f-bcc1-d07c306c72c3 with identifier: 1875108 to the API
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/337/7cc36cf7274b4c489be06480731cbf81/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3ca06c6a-bb41-560f-bcc1-d07c306c72c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 68583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca06c6a-bb41-560f-bcc1-d07c306c72c3/3ca06c6a-bb41-560f-bcc1-d07c306c72c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/337/7cc36cf7274b4c489be06480731cbf81/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l PLUG-IN 300PH (e-CVT) Advance',
 'transmission': 'manual',
 'trim': '2.5l PLUG-IN 300PH (e-CVT) Advance',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875108%27 HTTP/1.1" 200 None
2026-01-27 20:02:08 [ayvens.es] INFO: Saving data for 1875108: {'created_time': 1769544128.077204, 'last_price_update_time': 1769544128.077214, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875108') HTTP/1.1" 204 0
2026-01-27 20:02:08 [ayvens.es] INFO: Found listing with ID: 1875121
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875121%27 HTTP/1.1" 200 None
2026-01-27 20:02:08 [ayvens.es] INFO: Scrape type for 1875121: 1
2026-01-27 20:02:08 [ayvens.es] INFO: Extracting data for car ID: 1875121
2026-01-27 20:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 with identifier: 1875121
2026-01-27 20:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 with scrape type 1
2026-01-27 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2fe141f3-c9e6-5fec-a54d-08bb47a56be2
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F719%252F72a3cf9fbc6846e89937291340b616eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/719/72a3cf9fbc6846e89937291340b616eb/images/large/1.jpg not downloaded yet
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57093b090>
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9670abe6-0c12-5245-9286-bfae1490d6ce/9670abe6-0c12-5245-9286-bfae1490d6ce_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252F7a57b841052c42efaa1a2e23c56059d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/7a57b841052c42efaa1a2e23c56059d0/images/large/1.jpg saved to cache
2026-01-27 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9670abe6-0c12-5245-9286-bfae1490d6ce
2026-01-27 20:02:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9670abe6-0c12-5245-9286-bfae1490d6ce, skipping ID generation
2026-01-27 20:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9670abe6-0c12-5245-9286-bfae1490d6ce with scrape type 1
2026-01-27 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9670abe6-0c12-5245-9286-bfae1490d6ce from tracking dictionaries
2026-01-27 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9670abe6-0c12-5245-9286-bfae1490d6ce sending to next pipeline
2026-01-27 20:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9670abe6-0c12-5245-9286-bfae1490d6ce, identifier: 1875109
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572326010>
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_260ad7c6-7bbf-5474-988e-5c4f11c2dc58/260ad7c6-7bbf-5474-988e-5c4f11c2dc58_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F835%252F72ceb1a956e4426d8117b1ac21aeab02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/835/72ceb1a956e4426d8117b1ac21aeab02/images/large/1.jpg saved to cache
2026-01-27 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 260ad7c6-7bbf-5474-988e-5c4f11c2dc58
2026-01-27 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 260ad7c6-7bbf-5474-988e-5c4f11c2dc58, skipping ID generation
2026-01-27 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260ad7c6-7bbf-5474-988e-5c4f11c2dc58 with scrape type 1
2026-01-27 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 260ad7c6-7bbf-5474-988e-5c4f11c2dc58 from tracking dictionaries
2026-01-27 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 260ad7c6-7bbf-5474-988e-5c4f11c2dc58 sending to next pipeline
2026-01-27 20:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 260ad7c6-7bbf-5474-988e-5c4f11c2dc58, identifier: 1875112
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f85fd0>
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1bd14af-81f7-5ea0-84dc-8c6ec079715e/a1bd14af-81f7-5ea0-84dc-8c6ec079715e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F500%252F13ab790bc1a9445b8bc1b7c84fd1bec5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/500/13ab790bc1a9445b8bc1b7c84fd1bec5/images/large/1.jpg saved to cache
2026-01-27 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1bd14af-81f7-5ea0-84dc-8c6ec079715e
2026-01-27 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1bd14af-81f7-5ea0-84dc-8c6ec079715e, skipping ID generation
2026-01-27 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bd14af-81f7-5ea0-84dc-8c6ec079715e with scrape type 1
2026-01-27 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a1bd14af-81f7-5ea0-84dc-8c6ec079715e from tracking dictionaries
2026-01-27 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1bd14af-81f7-5ea0-84dc-8c6ec079715e sending to next pipeline
2026-01-27 20:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a1bd14af-81f7-5ea0-84dc-8c6ec079715e, identifier: 1875110
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b5ed10>
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5dcf5a5-5dda-5c60-88df-693c5fd20f46/b5dcf5a5-5dda-5c60-88df-693c5fd20f46_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F290%252Fed6c397b1f04467e822197b50e1cd524%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/290/ed6c397b1f04467e822197b50e1cd524/images/large/1.jpg saved to cache
2026-01-27 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5dcf5a5-5dda-5c60-88df-693c5fd20f46
2026-01-27 20:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5dcf5a5-5dda-5c60-88df-693c5fd20f46, skipping ID generation
2026-01-27 20:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5dcf5a5-5dda-5c60-88df-693c5fd20f46 with scrape type 1
2026-01-27 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b5dcf5a5-5dda-5c60-88df-693c5fd20f46 from tracking dictionaries
2026-01-27 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5dcf5a5-5dda-5c60-88df-693c5fd20f46 sending to next pipeline
2026-01-27 20:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5dcf5a5-5dda-5c60-88df-693c5fd20f46, identifier: 1875111
2026-01-27 20:02:10 [ayvens.es] INFO: Found listing with ID: 1875122
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875122%27 HTTP/1.1" 200 None
2026-01-27 20:02:10 [ayvens.es] INFO: Scrape type for 1875122: 1
2026-01-27 20:02:10 [ayvens.es] INFO: Extracting data for car ID: 1875122
2026-01-27 20:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce24fb7b-441b-5c69-9289-73cf9d78dbd2 with identifier: 1875122
2026-01-27 20:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce24fb7b-441b-5c69-9289-73cf9d78dbd2 with scrape type 1
2026-01-27 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce24fb7b-441b-5c69-9289-73cf9d78dbd2
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F507%252F8efc34debd3a4bb3bcf5b7f655f6ace8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/507/8efc34debd3a4bb3bcf5b7f655f6ace8/images/large/1.jpg not downloaded yet
2026-01-27 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9670abe6-0c12-5245-9286-bfae1490d6ce with identifier: 1875109
2026-01-27 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9670abe6-0c12-5245-9286-bfae1490d6ce with identifier: 1875109
2026-01-27 20:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9670abe6-0c12-5245-9286-bfae1490d6ce with identifier: 1875109 to the API
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/684/7a57b841052c42efaa1a2e23c56059d0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9670abe6-0c12-5245-9286-bfae1490d6ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 73144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9670abe6-0c12-5245-9286-bfae1490d6ce/9670abe6-0c12-5245-9286-bfae1490d6ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/684/7a57b841052c42efaa1a2e23c56059d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDi HEV 104kW (141CV) Concept',
 'transmission': 'manual',
 'trim': '1.6 GDi HEV 104kW (141CV) Concept',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875109%27 HTTP/1.1" 200 None
2026-01-27 20:02:10 [ayvens.es] INFO: Saving data for 1875109: {'created_time': 1769544130.580303, 'last_price_update_time': 1769544130.580318, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875109') HTTP/1.1" 204 0
2026-01-27 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 260ad7c6-7bbf-5474-988e-5c4f11c2dc58 with identifier: 1875112
2026-01-27 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 260ad7c6-7bbf-5474-988e-5c4f11c2dc58 with identifier: 1875112
2026-01-27 20:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 260ad7c6-7bbf-5474-988e-5c4f11c2dc58 with identifier: 1875112 to the API
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/835/72ceb1a956e4426d8117b1ac21aeab02/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '260ad7c6-7bbf-5474-988e-5c4f11c2dc58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 62088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260ad7c6-7bbf-5474-988e-5c4f11c2dc58/260ad7c6-7bbf-5474-988e-5c4f11c2dc58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/835/72ceb1a956e4426d8117b1ac21aeab02/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l PLUG-IN 300PH (e-CVT) Advance',
 'transmission': 'manual',
 'trim': '2.5l PLUG-IN 300PH (e-CVT) Advance',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875112%27 HTTP/1.1" 200 None
2026-01-27 20:02:11 [ayvens.es] INFO: Saving data for 1875112: {'created_time': 1769544131.049984, 'last_price_update_time': 1769544131.049994, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875112') HTTP/1.1" 204 0
2026-01-27 20:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a1bd14af-81f7-5ea0-84dc-8c6ec079715e with identifier: 1875110
2026-01-27 20:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a1bd14af-81f7-5ea0-84dc-8c6ec079715e with identifier: 1875110
2026-01-27 20:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a1bd14af-81f7-5ea0-84dc-8c6ec079715e with identifier: 1875110 to the API
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/500/13ab790bc1a9445b8bc1b7c84fd1bec5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a1bd14af-81f7-5ea0-84dc-8c6ec079715e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 55650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1bd14af-81f7-5ea0-84dc-8c6ec079715e/a1bd14af-81f7-5ea0-84dc-8c6ec079715e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/500/13ab790bc1a9445b8bc1b7c84fd1bec5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 45 TFSI e 180kW S tronic Advanced',
 'transmission': 'manual',
 'trim': '45 TFSI e 180kW S tronic Advanced',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875110%27 HTTP/1.1" 200 None
2026-01-27 20:02:11 [ayvens.es] INFO: Saving data for 1875110: {'created_time': 1769544131.520273, 'last_price_update_time': 1769544131.520286, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875110') HTTP/1.1" 204 0
2026-01-27 20:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5dcf5a5-5dda-5c60-88df-693c5fd20f46 with identifier: 1875111
2026-01-27 20:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5dcf5a5-5dda-5c60-88df-693c5fd20f46 with identifier: 1875111
2026-01-27 20:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5dcf5a5-5dda-5c60-88df-693c5fd20f46 with identifier: 1875111 to the API
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/290/ed6c397b1f04467e822197b50e1cd524/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Midnight',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b5dcf5a5-5dda-5c60-88df-693c5fd20f46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 22091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5dcf5a5-5dda-5c60-88df-693c5fd20f46/b5dcf5a5-5dda-5c60-88df-693c5fd20f46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/290/ed6c397b1f04467e822197b50e1cd524/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI (O) E-POWER 140 KW (190 CV) N-Connecta',
 'transmission': 'manual',
 'trim': '(O) E-POWER 140 KW (190 CV) N-Connecta',
 'vin': None,
 'year': 2024}
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875111%27 HTTP/1.1" 200 None
2026-01-27 20:02:11 [ayvens.es] INFO: Saving data for 1875111: {'created_time': 1769544131.955218, 'last_price_update_time': 1769544131.955233, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875111') HTTP/1.1" 204 0
2026-01-27 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/500/afc43dd2da794b6ea21aafdccae39477/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/201/dbc8673203164684848dea764b6b5eb4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/056/b15538d8019d47a2867b8c4b00e39db1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:11 [ayvens.es] INFO: Found listing with ID: 1875123
2026-01-27 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875123%27 HTTP/1.1" 200 None
2026-01-27 20:02:12 [ayvens.es] INFO: Scrape type for 1875123: 1
2026-01-27 20:02:12 [ayvens.es] INFO: Extracting data for car ID: 1875123
2026-01-27 20:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfe4cdde-d7d0-50fd-9980-307a21b01c78 with identifier: 1875123
2026-01-27 20:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe4cdde-d7d0-50fd-9980-307a21b01c78 with scrape type 1
2026-01-27 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bfe4cdde-d7d0-50fd-9980-307a21b01c78
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252F045064fe9ae0497fb13db7c40dcdd08e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/045064fe9ae0497fb13db7c40dcdd08e/images/large/1.jpg not downloaded yet
2026-01-27 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/598/1a25673194aa4cb1bb268496a5aa2639/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/679/591c76446e984267a288593d5c8670c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:12 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-01-27 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/907/fe7abb3d37334a009bfe6def32847b4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/926/0d97f1dcb7bf447290fb017e32abfef3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/003/ce9b1e843a554d3d92f6214777541e13/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b29490>
2026-01-27 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e/5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F500%252Fafc43dd2da794b6ea21aafdccae39477%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/500/afc43dd2da794b6ea21aafdccae39477/images/large/1.jpg saved to cache
2026-01-27 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e
2026-01-27 20:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e, skipping ID generation
2026-01-27 20:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e with scrape type 1
2026-01-27 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e from tracking dictionaries
2026-01-27 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e sending to next pipeline
2026-01-27 20:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e, identifier: 1875114
2026-01-27 20:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e with identifier: 1875114
2026-01-27 20:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e with identifier: 1875114
2026-01-27 20:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e with identifier: 1875114 to the API
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/500/afc43dd2da794b6ea21aafdccae39477/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 32758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e/5c87ed9b-0318-59bc-9b0b-d7ef9a8edb3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/500/afc43dd2da794b6ea21aafdccae39477/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 120H Business Plus',
 'transmission': 'manual',
 'trim': '1.5 120H Business Plus',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875114%27 HTTP/1.1" 200 None
2026-01-27 20:02:13 [ayvens.es] INFO: Saving data for 1875114: {'created_time': 1769544133.027755, 'last_price_update_time': 1769544133.027766, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875114') HTTP/1.1" 204 0
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572384c50>
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c/2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F201%252Fdbc8673203164684848dea764b6b5eb4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/201/dbc8673203164684848dea764b6b5eb4/images/large/1.jpg saved to cache
2026-01-27 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c
2026-01-27 20:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c, skipping ID generation
2026-01-27 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c with scrape type 1
2026-01-27 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c from tracking dictionaries
2026-01-27 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c sending to next pipeline
2026-01-27 20:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c, identifier: 1875113
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571baba50>
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d0f88b-d116-56a2-9c64-347af762e48d/01d0f88b-d116-56a2-9c64-347af762e48d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fb15538d8019d47a2867b8c4b00e39db1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/b15538d8019d47a2867b8c4b00e39db1/images/large/1.jpg saved to cache
2026-01-27 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01d0f88b-d116-56a2-9c64-347af762e48d
2026-01-27 20:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01d0f88b-d116-56a2-9c64-347af762e48d, skipping ID generation
2026-01-27 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d0f88b-d116-56a2-9c64-347af762e48d with scrape type 1
2026-01-27 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 01d0f88b-d116-56a2-9c64-347af762e48d from tracking dictionaries
2026-01-27 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01d0f88b-d116-56a2-9c64-347af762e48d sending to next pipeline
2026-01-27 20:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 01d0f88b-d116-56a2-9c64-347af762e48d, identifier: 1875116
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572128a10>
2026-01-27 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a0b1343-8a89-5572-8cad-0ec5718ac47e/4a0b1343-8a89-5572-8cad-0ec5718ac47e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F598%252F1a25673194aa4cb1bb268496a5aa2639%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/598/1a25673194aa4cb1bb268496a5aa2639/images/large/1.jpg saved to cache
2026-01-27 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a0b1343-8a89-5572-8cad-0ec5718ac47e
2026-01-27 20:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a0b1343-8a89-5572-8cad-0ec5718ac47e, skipping ID generation
2026-01-27 20:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0b1343-8a89-5572-8cad-0ec5718ac47e with scrape type 1
2026-01-27 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4a0b1343-8a89-5572-8cad-0ec5718ac47e from tracking dictionaries
2026-01-27 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a0b1343-8a89-5572-8cad-0ec5718ac47e sending to next pipeline
2026-01-27 20:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4a0b1343-8a89-5572-8cad-0ec5718ac47e, identifier: 1875115
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a8f390>
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_160b9113-b697-5a19-885f-670c600471f3/160b9113-b697-5a19-885f-670c600471f3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F679%252F591c76446e984267a288593d5c8670c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/679/591c76446e984267a288593d5c8670c2/images/large/1.jpg saved to cache
2026-01-27 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 160b9113-b697-5a19-885f-670c600471f3
2026-01-27 20:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 160b9113-b697-5a19-885f-670c600471f3, skipping ID generation
2026-01-27 20:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 160b9113-b697-5a19-885f-670c600471f3 with scrape type 1
2026-01-27 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 160b9113-b697-5a19-885f-670c600471f3 from tracking dictionaries
2026-01-27 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 160b9113-b697-5a19-885f-670c600471f3 sending to next pipeline
2026-01-27 20:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 160b9113-b697-5a19-885f-670c600471f3, identifier: 1875117
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571ba9a10>
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcd5d0a-af78-5a16-b116-4923fc5df882/7dcd5d0a-af78-5a16-b116-4923fc5df882_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F907%252Ffe7abb3d37334a009bfe6def32847b4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/907/fe7abb3d37334a009bfe6def32847b4b/images/large/1.jpg saved to cache
2026-01-27 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7dcd5d0a-af78-5a16-b116-4923fc5df882
2026-01-27 20:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7dcd5d0a-af78-5a16-b116-4923fc5df882, skipping ID generation
2026-01-27 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcd5d0a-af78-5a16-b116-4923fc5df882 with scrape type 1
2026-01-27 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7dcd5d0a-af78-5a16-b116-4923fc5df882 from tracking dictionaries
2026-01-27 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7dcd5d0a-af78-5a16-b116-4923fc5df882 sending to next pipeline
2026-01-27 20:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7dcd5d0a-af78-5a16-b116-4923fc5df882, identifier: 1875119
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a7e750>
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2360781a-3c0a-5126-8689-e3e4100fa7b5/2360781a-3c0a-5126-8689-e3e4100fa7b5_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F926%252F0d97f1dcb7bf447290fb017e32abfef3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/926/0d97f1dcb7bf447290fb017e32abfef3/images/large/1.jpg saved to cache
2026-01-27 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2360781a-3c0a-5126-8689-e3e4100fa7b5
2026-01-27 20:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2360781a-3c0a-5126-8689-e3e4100fa7b5, skipping ID generation
2026-01-27 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2360781a-3c0a-5126-8689-e3e4100fa7b5 with scrape type 1
2026-01-27 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2360781a-3c0a-5126-8689-e3e4100fa7b5 from tracking dictionaries
2026-01-27 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2360781a-3c0a-5126-8689-e3e4100fa7b5 sending to next pipeline
2026-01-27 20:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2360781a-3c0a-5126-8689-e3e4100fa7b5, identifier: 1875118
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57238fc90>
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf718185-608f-590b-a8da-140a9adec458/bf718185-608f-590b-a8da-140a9adec458_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252Fce9b1e843a554d3d92f6214777541e13%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/ce9b1e843a554d3d92f6214777541e13/images/large/1.jpg saved to cache
2026-01-27 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf718185-608f-590b-a8da-140a9adec458
2026-01-27 20:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf718185-608f-590b-a8da-140a9adec458, skipping ID generation
2026-01-27 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf718185-608f-590b-a8da-140a9adec458 with scrape type 1
2026-01-27 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bf718185-608f-590b-a8da-140a9adec458 from tracking dictionaries
2026-01-27 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf718185-608f-590b-a8da-140a9adec458 sending to next pipeline
2026-01-27 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf718185-608f-590b-a8da-140a9adec458, identifier: 1875120
2026-01-27 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c with identifier: 1875113
2026-01-27 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c with identifier: 1875113
2026-01-27 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159986 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159986
2026-01-27 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c spider: ayvens.es
2026-01-27 20:02:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c due to rule: high_mileage_for_country.json, error: 159986 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159986
{'auction_title': '',
 'c_o_2_emission_value': 84,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 159986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c/2d5d8a62-4a3c-5c63-a8de-a26d5cae6a8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/201/dbc8673203164684848dea764b6b5eb4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 100H Active',
 'transmission': 'manual',
 'trim': '1.5 100H Active',
 'vin': None,
 'year': 2018}
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875113%27 HTTP/1.1" 200 None
2026-01-27 20:02:16 [ayvens.es] INFO: Saving data for 1875113: {'created_time': 1769544136.385806, 'last_price_update_time': 1769544136.385819, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875113') HTTP/1.1" 204 0
2026-01-27 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 01d0f88b-d116-56a2-9c64-347af762e48d with identifier: 1875116
2026-01-27 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 01d0f88b-d116-56a2-9c64-347af762e48d with identifier: 1875116
2026-01-27 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'puretech 60kw (83cv) feel pack', 'title': 'citroën c3 puretech 60kw (83cv) feel pack', 'price': 0, 'odometer': 23988, 'odometer_reading_unit': 'km', 'registration_date': '2022-03-03', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 123, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '01d0f88b-d116-56a2-9c64-347af762e48d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d0f88b-d116-56a2-9c64-347af762e48d/01d0f88b-d116-56a2-9c64-347af762e48d_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/b15538d8019d47a2867b8c4b00e39db1/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 340342}], 'current_year_diff': 4, 'age_in_months': 46, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 23988}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '01d0f88b-d116-56a2-9c64-347af762e48d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c3',
     'model': 'c3',
     'odometer': 23988,
     'odometer_in_km': 23988,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d0f88b-d116-56a2-9c64-347af762e48d/01d0f88b-d116-56a2-9c64-347af762e48d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 340342,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/b15538d8019d47a2867b8c4b00e39db1/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-03-03',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c3 puretech 60kw (83cv) feel pack',
     'transmission': 'manual',
     'trim': 'puretech 60kw (83cv) feel pack',
     'vin': None,
     'year': 2022}
2026-01-27 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 01d0f88b-d116-56a2-9c64-347af762e48d spider: ayvens.es
2026-01-27 20:02:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 01d0f88b-d116-56a2-9c64-347af762e48d due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'puretech 60kw (83cv) feel pack', 'title': 'citroën c3 puretech 60kw (83cv) feel pack', 'price': 0, 'odometer': 23988, 'odometer_reading_unit': 'km', 'registration_date': '2022-03-03', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 123, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '01d0f88b-d116-56a2-9c64-347af762e48d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d0f88b-d116-56a2-9c64-347af762e48d/01d0f88b-d116-56a2-9c64-347af762e48d_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/b15538d8019d47a2867b8c4b00e39db1/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 340342}], 'current_year_diff': 4, 'age_in_months': 46, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 23988}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 46,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '01d0f88b-d116-56a2-9c64-347af762e48d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c3',
     'model': 'c3',
     'odometer': 23988,
     'odometer_in_km': 23988,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d0f88b-d116-56a2-9c64-347af762e48d/01d0f88b-d116-56a2-9c64-347af762e48d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 340342,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/b15538d8019d47a2867b8c4b00e39db1/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-03-03',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c3 puretech 60kw (83cv) feel pack',
     'transmission': 'manual',
     'trim': 'puretech 60kw (83cv) feel pack',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '01d0f88b-d116-56a2-9c64-347af762e48d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 23988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d0f88b-d116-56a2-9c64-347af762e48d/01d0f88b-d116-56a2-9c64-347af762e48d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/b15538d8019d47a2867b8c4b00e39db1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 PureTech 60KW (83CV) Feel Pack',
 'transmission': 'manual',
 'trim': 'PureTech 60KW (83CV) Feel Pack',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875116%27 HTTP/1.1" 200 None
2026-01-27 20:02:16 [ayvens.es] INFO: Saving data for 1875116: {'created_time': 1769544136.647589, 'last_price_update_time': 1769544136.647605, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875116') HTTP/1.1" 204 0
2026-01-27 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4a0b1343-8a89-5572-8cad-0ec5718ac47e with identifier: 1875115
2026-01-27 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4a0b1343-8a89-5572-8cad-0ec5718ac47e with identifier: 1875115
2026-01-27 20:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4a0b1343-8a89-5572-8cad-0ec5718ac47e with identifier: 1875115 to the API
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/598/1a25673194aa4cb1bb268496a5aa2639/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4a0b1343-8a89-5572-8cad-0ec5718ac47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 63581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a0b1343-8a89-5572-8cad-0ec5718ac47e/4a0b1343-8a89-5572-8cad-0ec5718ac47e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/598/1a25673194aa4cb1bb268496a5aa2639/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875115%27 HTTP/1.1" 200 None
2026-01-27 20:02:17 [ayvens.es] INFO: Saving data for 1875115: {'created_time': 1769544137.057835, 'last_price_update_time': 1769544137.057845, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875115') HTTP/1.1" 204 0
2026-01-27 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 160b9113-b697-5a19-885f-670c600471f3 with identifier: 1875117
2026-01-27 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 160b9113-b697-5a19-885f-670c600471f3 with identifier: 1875117
2026-01-27 20:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 160b9113-b697-5a19-885f-670c600471f3 with identifier: 1875117 to the API
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/679/591c76446e984267a288593d5c8670c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '160b9113-b697-5a19-885f-670c600471f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 31108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_160b9113-b697-5a19-885f-670c600471f3/160b9113-b697-5a19-885f-670c600471f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/679/591c76446e984267a288593d5c8670c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Dolcevita 1.0 Hybrid 51KW (70 CV)',
 'transmission': 'manual',
 'trim': 'Dolcevita 1.0 Hybrid 51KW (70 CV)',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875117%27 HTTP/1.1" 200 None
2026-01-27 20:02:17 [ayvens.es] INFO: Saving data for 1875117: {'created_time': 1769544137.457771, 'last_price_update_time': 1769544137.457783, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875117') HTTP/1.1" 204 0
2026-01-27 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7dcd5d0a-af78-5a16-b116-4923fc5df882 with identifier: 1875119
2026-01-27 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7dcd5d0a-af78-5a16-b116-4923fc5df882 with identifier: 1875119
2026-01-27 20:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7dcd5d0a-af78-5a16-b116-4923fc5df882 with identifier: 1875119 to the API
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/907/fe7abb3d37334a009bfe6def32847b4b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '7dcd5d0a-af78-5a16-b116-4923fc5df882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 36407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcd5d0a-af78-5a16-b116-4923fc5df882/7dcd5d0a-af78-5a16-b116-4923fc5df882_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/907/fe7abb3d37334a009bfe6def32847b4b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA Equilibre E-TECH full hybr. 105kW(145CV)',
 'transmission': 'manual',
 'trim': 'Equilibre E-TECH full hybr. 105kW(145CV)',
 'vin': None,
 'year': 2023}
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875119%27 HTTP/1.1" 200 None
2026-01-27 20:02:17 [ayvens.es] INFO: Saving data for 1875119: {'created_time': 1769544137.887529, 'last_price_update_time': 1769544137.887541, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875119') HTTP/1.1" 204 0
2026-01-27 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2360781a-3c0a-5126-8689-e3e4100fa7b5 with identifier: 1875118
2026-01-27 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2360781a-3c0a-5126-8689-e3e4100fa7b5 with identifier: 1875118
2026-01-27 20:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2360781a-3c0a-5126-8689-e3e4100fa7b5 with identifier: 1875118 to the API
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/926/0d97f1dcb7bf447290fb017e32abfef3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2360781a-3c0a-5126-8689-e3e4100fa7b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 15389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2360781a-3c0a-5126-8689-e3e4100fa7b5/2360781a-3c0a-5126-8689-e3e4100fa7b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/926/0d97f1dcb7bf447290fb017e32abfef3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2024}
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875118%27 HTTP/1.1" 200 None
2026-01-27 20:02:18 [ayvens.es] INFO: Saving data for 1875118: {'created_time': 1769544138.326844, 'last_price_update_time': 1769544138.326857, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875118') HTTP/1.1" 204 0
2026-01-27 20:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf718185-608f-590b-a8da-140a9adec458 with identifier: 1875120
2026-01-27 20:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf718185-608f-590b-a8da-140a9adec458 with identifier: 1875120
2026-01-27 20:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf718185-608f-590b-a8da-140a9adec458 with identifier: 1875120 to the API
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/003/ce9b1e843a554d3d92f6214777541e13/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bf718185-608f-590b-a8da-140a9adec458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 59709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf718185-608f-590b-a8da-140a9adec458/bf718185-608f-590b-a8da-140a9adec458_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/003/ce9b1e843a554d3d92f6214777541e13/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS Sedan A 180',
 'transmission': 'manual',
 'trim': 'Sedan A 180',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875120%27 HTTP/1.1" 200 None
2026-01-27 20:02:18 [ayvens.es] INFO: Saving data for 1875120: {'created_time': 1769544138.663542, 'last_price_update_time': 1769544138.663553, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875120') HTTP/1.1" 204 0
2026-01-27 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/507/8efc34debd3a4bb3bcf5b7f655f6ace8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/719/72a3cf9fbc6846e89937291340b616eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/338/045064fe9ae0497fb13db7c40dcdd08e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572317210>
2026-01-27 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce24fb7b-441b-5c69-9289-73cf9d78dbd2/ce24fb7b-441b-5c69-9289-73cf9d78dbd2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F507%252F8efc34debd3a4bb3bcf5b7f655f6ace8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/507/8efc34debd3a4bb3bcf5b7f655f6ace8/images/large/1.jpg saved to cache
2026-01-27 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce24fb7b-441b-5c69-9289-73cf9d78dbd2
2026-01-27 20:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce24fb7b-441b-5c69-9289-73cf9d78dbd2, skipping ID generation
2026-01-27 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce24fb7b-441b-5c69-9289-73cf9d78dbd2 with scrape type 1
2026-01-27 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ce24fb7b-441b-5c69-9289-73cf9d78dbd2 from tracking dictionaries
2026-01-27 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce24fb7b-441b-5c69-9289-73cf9d78dbd2 sending to next pipeline
2026-01-27 20:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce24fb7b-441b-5c69-9289-73cf9d78dbd2, identifier: 1875122
2026-01-27 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f36390>
2026-01-27 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe141f3-c9e6-5fec-a54d-08bb47a56be2/2fe141f3-c9e6-5fec-a54d-08bb47a56be2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F719%252F72a3cf9fbc6846e89937291340b616eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/719/72a3cf9fbc6846e89937291340b616eb/images/large/1.jpg saved to cache
2026-01-27 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fe141f3-c9e6-5fec-a54d-08bb47a56be2
2026-01-27 20:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fe141f3-c9e6-5fec-a54d-08bb47a56be2, skipping ID generation
2026-01-27 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 with scrape type 1
2026-01-27 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 from tracking dictionaries
2026-01-27 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 sending to next pipeline
2026-01-27 20:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2fe141f3-c9e6-5fec-a54d-08bb47a56be2, identifier: 1875121
2026-01-27 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce24fb7b-441b-5c69-9289-73cf9d78dbd2 with identifier: 1875122
2026-01-27 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce24fb7b-441b-5c69-9289-73cf9d78dbd2 with identifier: 1875122
2026-01-27 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165810 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165810
2026-01-27 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ce24fb7b-441b-5c69-9289-73cf9d78dbd2 spider: ayvens.es
2026-01-27 20:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ce24fb7b-441b-5c69-9289-73cf9d78dbd2 due to rule: high_mileage_for_country.json, error: 165810 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165810
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce24fb7b-441b-5c69-9289-73cf9d78dbd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 165810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce24fb7b-441b-5c69-9289-73cf9d78dbd2/ce24fb7b-441b-5c69-9289-73cf9d78dbd2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/507/8efc34debd3a4bb3bcf5b7f655f6ace8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875122%27 HTTP/1.1" 200 None
2026-01-27 20:02:20 [ayvens.es] INFO: Saving data for 1875122: {'created_time': 1769544140.055053, 'last_price_update_time': 1769544140.055064, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875122') HTTP/1.1" 204 0
2026-01-27 20:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 with identifier: 1875121
2026-01-27 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 with identifier: 1875121
2026-01-27 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160438 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160438
2026-01-27 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 spider: ayvens.es
2026-01-27 20:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 2fe141f3-c9e6-5fec-a54d-08bb47a56be2 due to rule: high_mileage_for_country.json, error: 160438 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160438
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Cristal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2fe141f3-c9e6-5fec-a54d-08bb47a56be2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 160438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe141f3-c9e6-5fec-a54d-08bb47a56be2/2fe141f3-c9e6-5fec-a54d-08bb47a56be2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/719/72a3cf9fbc6846e89937291340b616eb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT. PERF.LINE',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT. PERF.LINE',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875121%27 HTTP/1.1" 200 None
2026-01-27 20:02:20 [ayvens.es] INFO: Saving data for 1875121: {'created_time': 1769544140.307461, 'last_price_update_time': 1769544140.307476, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875121') HTTP/1.1" 204 0
2026-01-27 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-27 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572343650>
2026-01-27 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe4cdde-d7d0-50fd-9980-307a21b01c78/bfe4cdde-d7d0-50fd-9980-307a21b01c78_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252F045064fe9ae0497fb13db7c40dcdd08e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/045064fe9ae0497fb13db7c40dcdd08e/images/large/1.jpg saved to cache
2026-01-27 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfe4cdde-d7d0-50fd-9980-307a21b01c78
2026-01-27 20:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfe4cdde-d7d0-50fd-9980-307a21b01c78, skipping ID generation
2026-01-27 20:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe4cdde-d7d0-50fd-9980-307a21b01c78 with scrape type 1
2026-01-27 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bfe4cdde-d7d0-50fd-9980-307a21b01c78 from tracking dictionaries
2026-01-27 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfe4cdde-d7d0-50fd-9980-307a21b01c78 sending to next pipeline
2026-01-27 20:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bfe4cdde-d7d0-50fd-9980-307a21b01c78, identifier: 1875123
2026-01-27 20:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bfe4cdde-d7d0-50fd-9980-307a21b01c78 with identifier: 1875123
2026-01-27 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bfe4cdde-d7d0-50fd-9980-307a21b01c78 with identifier: 1875123
2026-01-27 20:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bfe4cdde-d7d0-50fd-9980-307a21b01c78 with identifier: 1875123 to the API
2026-01-27 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/338/045064fe9ae0497fb13db7c40dcdd08e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bfe4cdde-d7d0-50fd-9980-307a21b01c78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 75633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe4cdde-d7d0-50fd-9980-307a21b01c78/bfe4cdde-d7d0-50fd-9980-307a21b01c78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/338/045064fe9ae0497fb13db7c40dcdd08e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875123%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Saving data for 1875123: {'created_time': 1769544141.166811, 'last_price_update_time': 1769544141.166822, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875123') HTTP/1.1" 204 0
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875124
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875124%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875124: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875124
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1542cfc1-0e64-5250-a253-efdcdc9a30bd with identifier: 1875124
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1542cfc1-0e64-5250-a253-efdcdc9a30bd with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1542cfc1-0e64-5250-a253-efdcdc9a30bd
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F136%252Fd948130524c6433a8a93591dfd079034%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/136/d948130524c6433a8a93591dfd079034/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875125
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875125%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875125: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875125
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 729953cd-6015-5335-a742-147e109d2385 with identifier: 1875125
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 729953cd-6015-5335-a742-147e109d2385 with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 729953cd-6015-5335-a742-147e109d2385
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F690%252F799ccd4dd40a459f9dea5762a9a04cf2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/690/799ccd4dd40a459f9dea5762a9a04cf2/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875126
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875126%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875126: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875126
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b333a73f-518b-5822-a75c-2fd8908977fa with identifier: 1875126
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b333a73f-518b-5822-a75c-2fd8908977fa with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b333a73f-518b-5822-a75c-2fd8908977fa
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F088%252F9f01101972b14dbf9befd1524a94bb40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/088/9f01101972b14dbf9befd1524a94bb40/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875127
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875127%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875127: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875127
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb with identifier: 1875127
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252Fc1742d86c28847e5b18520277127a15d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/c1742d86c28847e5b18520277127a15d/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875128
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875128%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875128: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875128
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1669705e-2e62-58d7-81e1-f6be679b946b with identifier: 1875128
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1669705e-2e62-58d7-81e1-f6be679b946b with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1669705e-2e62-58d7-81e1-f6be679b946b
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F942%252F0737f7ec02144285af33fd5d83f8ced9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/942/0737f7ec02144285af33fd5d83f8ced9/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875129
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875129%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875129: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875129
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77fe7049-5253-5b4c-99c8-bbf0ee7520e1 with identifier: 1875129
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77fe7049-5253-5b4c-99c8-bbf0ee7520e1 with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77fe7049-5253-5b4c-99c8-bbf0ee7520e1
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F250%252F8f9d10aec5fa4f6ea1aea183f8e104f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/250/8f9d10aec5fa4f6ea1aea183f8e104f4/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875130
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875130%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875130: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875130
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9bdcd45-ba59-50a7-b7d9-1345346a785b with identifier: 1875130
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9bdcd45-ba59-50a7-b7d9-1345346a785b with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9bdcd45-ba59-50a7-b7d9-1345346a785b
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F3ddb88f63cf348bd96959f449000a167%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/3ddb88f63cf348bd96959f449000a167/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875131
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875131%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875131: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875131
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42433823-a371-5135-a1db-99672d20f0ad with identifier: 1875131
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42433823-a371-5135-a1db-99672d20f0ad with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 42433823-a371-5135-a1db-99672d20f0ad
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F920%252F48a961b1ee1840de805d029a2a655c90%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/920/48a961b1ee1840de805d029a2a655c90/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875132
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875132%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875132: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875132
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60bcb738-ef85-5557-9f8c-2d3a4e2a5364 with identifier: 1875132
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60bcb738-ef85-5557-9f8c-2d3a4e2a5364 with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 60bcb738-ef85-5557-9f8c-2d3a4e2a5364
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F740%252F3b068eea144640c994911b8f51f425f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/740/3b068eea144640c994911b8f51f425f0/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875133
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875133%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875133: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875133
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf721b49-ca23-539b-b12c-fe2b0aa8fcbb with identifier: 1875133
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf721b49-ca23-539b-b12c-fe2b0aa8fcbb with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cf721b49-ca23-539b-b12c-fe2b0aa8fcbb
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F838%252F2544b96893fb478c8cbc13f69587fe96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/838/2544b96893fb478c8cbc13f69587fe96/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875134
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875134%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875134: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875134
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef37f36d-cb13-53ca-95ed-497e35f8de3c with identifier: 1875134
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef37f36d-cb13-53ca-95ed-497e35f8de3c with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef37f36d-cb13-53ca-95ed-497e35f8de3c
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252F90ee7a739f5b4793b1d64bdf3f0d75dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/90ee7a739f5b4793b1d64bdf3f0d75dc/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875135
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875135%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875135: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875135
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b8adfd5-afa0-5304-8c19-d20ac341b2de with identifier: 1875135
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8adfd5-afa0-5304-8c19-d20ac341b2de with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1b8adfd5-afa0-5304-8c19-d20ac341b2de
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F541%252Ff0db709addda4ed1922014941c4c8246%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/541/f0db709addda4ed1922014941c4c8246/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875136
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875136%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875136: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875136
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78eea009-9624-5ba7-994f-f98fafe8cb79 with identifier: 1875136
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78eea009-9624-5ba7-994f-f98fafe8cb79 with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 78eea009-9624-5ba7-994f-f98fafe8cb79
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F234%252F8ff9e36f8bf440b48e6f8d5fe4eead34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/234/8ff9e36f8bf440b48e6f8d5fe4eead34/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/250/8f9d10aec5fa4f6ea1aea183f8e104f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875137
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875137%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875137: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875137
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4699f89-1eb9-5eaa-8f8e-d6506be01bd8 with identifier: 1875137
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4699f89-1eb9-5eaa-8f8e-d6506be01bd8 with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4699f89-1eb9-5eaa-8f8e-d6506be01bd8
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F594%252Fdcc6432bd37948298468b0213960f7d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/594/dcc6432bd37948298468b0213960f7d0/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875138
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875138%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875138: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875138
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4367e109-8d7b-5741-a0b0-e3b0ad45446c with identifier: 1875138
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4367e109-8d7b-5741-a0b0-e3b0ad45446c with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4367e109-8d7b-5741-a0b0-e3b0ad45446c
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F2b8c2f4c641f42ddbb97ab85e5bbffd6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/2b8c2f4c641f42ddbb97ab85e5bbffd6/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875139
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875139%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875139: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875139
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74cca09-a462-5f23-b2e8-58cc10d31bb1 with identifier: 1875139
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74cca09-a462-5f23-b2e8-58cc10d31bb1 with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e74cca09-a462-5f23-b2e8-58cc10d31bb1
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F496%252F5db8c5894282477a9fab8f185025a5fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/496/5db8c5894282477a9fab8f185025a5fd/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [ayvens.es] INFO: Found listing with ID: 1875140
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875140%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [ayvens.es] INFO: Scrape type for 1875140: 1
2026-01-27 20:02:21 [ayvens.es] INFO: Extracting data for car ID: 1875140
2026-01-27 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eba4466c-056e-5a30-9d2c-4f236c954ef5 with identifier: 1875140
2026-01-27 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eba4466c-056e-5a30-9d2c-4f236c954ef5 with scrape type 1
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eba4466c-056e-5a30-9d2c-4f236c954ef5
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F424%252Fc6cb74fbcd5043cb91b2fce4b9730747%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/424/c6cb74fbcd5043cb91b2fce4b9730747/images/large/1.jpg not downloaded yet
2026-01-27 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722af710>
2026-01-27 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77fe7049-5253-5b4c-99c8-bbf0ee7520e1/77fe7049-5253-5b4c-99c8-bbf0ee7520e1_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F250%252F8f9d10aec5fa4f6ea1aea183f8e104f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/250/8f9d10aec5fa4f6ea1aea183f8e104f4/images/large/1.jpg saved to cache
2026-01-27 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77fe7049-5253-5b4c-99c8-bbf0ee7520e1
2026-01-27 20:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77fe7049-5253-5b4c-99c8-bbf0ee7520e1, skipping ID generation
2026-01-27 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77fe7049-5253-5b4c-99c8-bbf0ee7520e1 with scrape type 1
2026-01-27 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 77fe7049-5253-5b4c-99c8-bbf0ee7520e1 from tracking dictionaries
2026-01-27 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77fe7049-5253-5b4c-99c8-bbf0ee7520e1 sending to next pipeline
2026-01-27 20:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77fe7049-5253-5b4c-99c8-bbf0ee7520e1, identifier: 1875129
2026-01-27 20:02:22 [ayvens.es] INFO: Found listing with ID: 1875141
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875141%27 HTTP/1.1" 200 None
2026-01-27 20:02:22 [ayvens.es] INFO: Scrape type for 1875141: 1
2026-01-27 20:02:22 [ayvens.es] INFO: Extracting data for car ID: 1875141
2026-01-27 20:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac48414-2f6f-50f0-8b81-66da60afd54c with identifier: 1875141
2026-01-27 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac48414-2f6f-50f0-8b81-66da60afd54c with scrape type 1
2026-01-27 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ac48414-2f6f-50f0-8b81-66da60afd54c
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F334%252Fbbb88fce2f1d435abc9c30e7738cb73e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/334/bbb88fce2f1d435abc9c30e7738cb73e/images/large/1.jpg not downloaded yet
2026-01-27 20:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77fe7049-5253-5b4c-99c8-bbf0ee7520e1 with identifier: 1875129
2026-01-27 20:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77fe7049-5253-5b4c-99c8-bbf0ee7520e1 with identifier: 1875129
2026-01-27 20:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77fe7049-5253-5b4c-99c8-bbf0ee7520e1 with identifier: 1875129 to the API
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/250/8f9d10aec5fa4f6ea1aea183f8e104f4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '77fe7049-5253-5b4c-99c8-bbf0ee7520e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KADJAR',
 'odometer': 99942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77fe7049-5253-5b4c-99c8-bbf0ee7520e1/77fe7049-5253-5b4c-99c8-bbf0ee7520e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/250/8f9d10aec5fa4f6ea1aea183f8e104f4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KADJAR Intens GPF TCe 103kW (140CV)',
 'transmission': 'manual',
 'trim': 'Intens GPF TCe 103kW (140CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875129%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [ayvens.es] INFO: Saving data for 1875129: {'created_time': 1769544143.042454, 'last_price_update_time': 1769544143.042672, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875129') HTTP/1.1" 204 0
2026-01-27 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/897/3ddb88f63cf348bd96959f449000a167/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:23 [ayvens.es] INFO: Found listing with ID: 1875142
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875142%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [ayvens.es] INFO: Scrape type for 1875142: 1
2026-01-27 20:02:23 [ayvens.es] INFO: Extracting data for car ID: 1875142
2026-01-27 20:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c with identifier: 1875142
2026-01-27 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c with scrape type 1
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F340%252F8ff1819e032547d8a7f143324a22f282%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/340/8ff1819e032547d8a7f143324a22f282/images/large/1.jpg not downloaded yet
2026-01-27 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/920/48a961b1ee1840de805d029a2a655c90/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/740/3b068eea144640c994911b8f51f425f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:23 [ayvens.es] INFO: Found listing with ID: 1875143
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875143%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [ayvens.es] INFO: Scrape type for 1875143: 1
2026-01-27 20:02:23 [ayvens.es] INFO: Extracting data for car ID: 1875143
2026-01-27 20:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 with identifier: 1875143
2026-01-27 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 with scrape type 1
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F134%252F4dda4ccae2e747a391aa8349de277952%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/134/4dda4ccae2e747a391aa8349de277952/images/large/1.jpg not downloaded yet
2026-01-27 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/088/9f01101972b14dbf9befd1524a94bb40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:23 [ayvens.es] INFO: Found listing with ID: 1875144
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875144%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [ayvens.es] INFO: Scrape type for 1875144: 1
2026-01-27 20:02:23 [ayvens.es] INFO: Extracting data for car ID: 1875144
2026-01-27 20:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b87889f7-e50c-5b99-8d0c-c372b64a2450 with identifier: 1875144
2026-01-27 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b87889f7-e50c-5b99-8d0c-c372b64a2450 with scrape type 1
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b87889f7-e50c-5b99-8d0c-c372b64a2450
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F404%252F8e5e2e0881ef4b5bad79d1052539d454%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/404/8e5e2e0881ef4b5bad79d1052539d454/images/large/1.jpg not downloaded yet
2026-01-27 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/690/799ccd4dd40a459f9dea5762a9a04cf2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/136/d948130524c6433a8a93591dfd079034/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/418/c1742d86c28847e5b18520277127a15d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/942/0737f7ec02144285af33fd5d83f8ced9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:23 [ayvens.es] INFO: Found listing with ID: 1875145
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875145%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [ayvens.es] INFO: Scrape type for 1875145: 1
2026-01-27 20:02:23 [ayvens.es] INFO: Extracting data for car ID: 1875145
2026-01-27 20:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b33bbe46-8da3-59bb-9ff4-1d6c852e461f with identifier: 1875145
2026-01-27 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33bbe46-8da3-59bb-9ff4-1d6c852e461f with scrape type 1
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b33bbe46-8da3-59bb-9ff4-1d6c852e461f
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F224%252Fefb29d67b49e4c829ed52f336558efcd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/224/efb29d67b49e4c829ed52f336558efcd/images/large/1.jpg not downloaded yet
2026-01-27 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572352c90>
2026-01-27 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9bdcd45-ba59-50a7-b7d9-1345346a785b/f9bdcd45-ba59-50a7-b7d9-1345346a785b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F3ddb88f63cf348bd96959f449000a167%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/3ddb88f63cf348bd96959f449000a167/images/large/1.jpg saved to cache
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9bdcd45-ba59-50a7-b7d9-1345346a785b
2026-01-27 20:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9bdcd45-ba59-50a7-b7d9-1345346a785b, skipping ID generation
2026-01-27 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9bdcd45-ba59-50a7-b7d9-1345346a785b with scrape type 1
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f9bdcd45-ba59-50a7-b7d9-1345346a785b from tracking dictionaries
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9bdcd45-ba59-50a7-b7d9-1345346a785b sending to next pipeline
2026-01-27 20:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f9bdcd45-ba59-50a7-b7d9-1345346a785b, identifier: 1875130
2026-01-27 20:02:23 [ayvens.es] INFO: Found listing with ID: 1875146
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875146%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [ayvens.es] INFO: Scrape type for 1875146: 1
2026-01-27 20:02:23 [ayvens.es] INFO: Extracting data for car ID: 1875146
2026-01-27 20:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8f70f0a-04bc-5693-bafa-e1ada813ac4c with identifier: 1875146
2026-01-27 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8f70f0a-04bc-5693-bafa-e1ada813ac4c with scrape type 1
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8f70f0a-04bc-5693-bafa-e1ada813ac4c
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252Faef5c33c9a304855be4fc38d4c165e22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/aef5c33c9a304855be4fc38d4c165e22/images/large/1.jpg not downloaded yet
2026-01-27 20:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f9bdcd45-ba59-50a7-b7d9-1345346a785b with identifier: 1875130
2026-01-27 20:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f9bdcd45-ba59-50a7-b7d9-1345346a785b with identifier: 1875130
2026-01-27 20:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f9bdcd45-ba59-50a7-b7d9-1345346a785b with identifier: 1875130 to the API
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/897/3ddb88f63cf348bd96959f449000a167/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f9bdcd45-ba59-50a7-b7d9-1345346a785b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 86447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9bdcd45-ba59-50a7-b7d9-1345346a785b/f9bdcd45-ba59-50a7-b7d9-1345346a785b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/897/3ddb88f63cf348bd96959f449000a167/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875130%27 HTTP/1.1" 200 None
2026-01-27 20:02:24 [ayvens.es] INFO: Saving data for 1875130: {'created_time': 1769544144.277161, 'last_price_update_time': 1769544144.277174, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875130') HTTP/1.1" 204 0
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572350f50>
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42433823-a371-5135-a1db-99672d20f0ad/42433823-a371-5135-a1db-99672d20f0ad_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F920%252F48a961b1ee1840de805d029a2a655c90%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/920/48a961b1ee1840de805d029a2a655c90/images/large/1.jpg saved to cache
2026-01-27 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42433823-a371-5135-a1db-99672d20f0ad
2026-01-27 20:02:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42433823-a371-5135-a1db-99672d20f0ad, skipping ID generation
2026-01-27 20:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42433823-a371-5135-a1db-99672d20f0ad with scrape type 1
2026-01-27 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 42433823-a371-5135-a1db-99672d20f0ad from tracking dictionaries
2026-01-27 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42433823-a371-5135-a1db-99672d20f0ad sending to next pipeline
2026-01-27 20:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 42433823-a371-5135-a1db-99672d20f0ad, identifier: 1875131
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572353bd0>
2026-01-27 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60bcb738-ef85-5557-9f8c-2d3a4e2a5364/60bcb738-ef85-5557-9f8c-2d3a4e2a5364_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F740%252F3b068eea144640c994911b8f51f425f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/740/3b068eea144640c994911b8f51f425f0/images/large/1.jpg saved to cache
2026-01-27 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60bcb738-ef85-5557-9f8c-2d3a4e2a5364
2026-01-27 20:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60bcb738-ef85-5557-9f8c-2d3a4e2a5364, skipping ID generation
2026-01-27 20:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60bcb738-ef85-5557-9f8c-2d3a4e2a5364 with scrape type 1
2026-01-27 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 60bcb738-ef85-5557-9f8c-2d3a4e2a5364 from tracking dictionaries
2026-01-27 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60bcb738-ef85-5557-9f8c-2d3a4e2a5364 sending to next pipeline
2026-01-27 20:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 60bcb738-ef85-5557-9f8c-2d3a4e2a5364, identifier: 1875132
2026-01-27 20:02:25 [ayvens.es] INFO: Found listing with ID: 1875147
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875147%27 HTTP/1.1" 200 None
2026-01-27 20:02:25 [ayvens.es] INFO: Scrape type for 1875147: 1
2026-01-27 20:02:25 [ayvens.es] INFO: Extracting data for car ID: 1875147
2026-01-27 20:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 with identifier: 1875147
2026-01-27 20:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 with scrape type 1
2026-01-27 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F030%252F14cb4d525b0e4fcbb3394266783dd709%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/030/14cb4d525b0e4fcbb3394266783dd709/images/large/1.jpg not downloaded yet
2026-01-27 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 42433823-a371-5135-a1db-99672d20f0ad with identifier: 1875131
2026-01-27 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 42433823-a371-5135-a1db-99672d20f0ad with identifier: 1875131
2026-01-27 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159794 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159794
2026-01-27 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 42433823-a371-5135-a1db-99672d20f0ad spider: ayvens.es
2026-01-27 20:02:25 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 42433823-a371-5135-a1db-99672d20f0ad due to rule: high_mileage_for_country.json, error: 159794 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159794
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '42433823-a371-5135-a1db-99672d20f0ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 159794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42433823-a371-5135-a1db-99672d20f0ad/42433823-a371-5135-a1db-99672d20f0ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/920/48a961b1ee1840de805d029a2a655c90/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875131%27 HTTP/1.1" 200 None
2026-01-27 20:02:25 [ayvens.es] INFO: Saving data for 1875131: {'created_time': 1769544145.568724, 'last_price_update_time': 1769544145.568735, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875131') HTTP/1.1" 204 0
2026-01-27 20:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 60bcb738-ef85-5557-9f8c-2d3a4e2a5364 with identifier: 1875132
2026-01-27 20:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 60bcb738-ef85-5557-9f8c-2d3a4e2a5364 with identifier: 1875132
2026-01-27 20:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 60bcb738-ef85-5557-9f8c-2d3a4e2a5364 with identifier: 1875132 to the API
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/740/3b068eea144640c994911b8f51f425f0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '60bcb738-ef85-5557-9f8c-2d3a4e2a5364',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 112611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60bcb738-ef85-5557-9f8c-2d3a4e2a5364/60bcb738-ef85-5557-9f8c-2d3a4e2a5364_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/740/3b068eea144640c994911b8f51f425f0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS B 180 d',
 'transmission': 'manual',
 'trim': 'B 180 d',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875132%27 HTTP/1.1" 200 None
2026-01-27 20:02:25 [ayvens.es] INFO: Saving data for 1875132: {'created_time': 1769544145.963758, 'last_price_update_time': 1769544145.963768, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875132') HTTP/1.1" 204 0
2026-01-27 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724c2fd0>
2026-01-27 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b333a73f-518b-5822-a75c-2fd8908977fa/b333a73f-518b-5822-a75c-2fd8908977fa_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F088%252F9f01101972b14dbf9befd1524a94bb40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/088/9f01101972b14dbf9befd1524a94bb40/images/large/1.jpg saved to cache
2026-01-27 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b333a73f-518b-5822-a75c-2fd8908977fa
2026-01-27 20:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b333a73f-518b-5822-a75c-2fd8908977fa, skipping ID generation
2026-01-27 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b333a73f-518b-5822-a75c-2fd8908977fa with scrape type 1
2026-01-27 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b333a73f-518b-5822-a75c-2fd8908977fa from tracking dictionaries
2026-01-27 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b333a73f-518b-5822-a75c-2fd8908977fa sending to next pipeline
2026-01-27 20:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b333a73f-518b-5822-a75c-2fd8908977fa, identifier: 1875126
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57265ff50>
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729953cd-6015-5335-a742-147e109d2385/729953cd-6015-5335-a742-147e109d2385_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F690%252F799ccd4dd40a459f9dea5762a9a04cf2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/690/799ccd4dd40a459f9dea5762a9a04cf2/images/large/1.jpg saved to cache
2026-01-27 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 729953cd-6015-5335-a742-147e109d2385
2026-01-27 20:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 729953cd-6015-5335-a742-147e109d2385, skipping ID generation
2026-01-27 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 729953cd-6015-5335-a742-147e109d2385 with scrape type 1
2026-01-27 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 729953cd-6015-5335-a742-147e109d2385 from tracking dictionaries
2026-01-27 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 729953cd-6015-5335-a742-147e109d2385 sending to next pipeline
2026-01-27 20:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 729953cd-6015-5335-a742-147e109d2385, identifier: 1875125
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57241df90>
2026-01-27 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1542cfc1-0e64-5250-a253-efdcdc9a30bd/1542cfc1-0e64-5250-a253-efdcdc9a30bd_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F136%252Fd948130524c6433a8a93591dfd079034%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/136/d948130524c6433a8a93591dfd079034/images/large/1.jpg saved to cache
2026-01-27 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1542cfc1-0e64-5250-a253-efdcdc9a30bd
2026-01-27 20:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1542cfc1-0e64-5250-a253-efdcdc9a30bd, skipping ID generation
2026-01-27 20:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1542cfc1-0e64-5250-a253-efdcdc9a30bd with scrape type 1
2026-01-27 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1542cfc1-0e64-5250-a253-efdcdc9a30bd from tracking dictionaries
2026-01-27 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1542cfc1-0e64-5250-a253-efdcdc9a30bd sending to next pipeline
2026-01-27 20:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1542cfc1-0e64-5250-a253-efdcdc9a30bd, identifier: 1875124
2026-01-27 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57265d890>
2026-01-27 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cca7df7-16a8-52bd-ab0b-1b1efbb886eb/0cca7df7-16a8-52bd-ab0b-1b1efbb886eb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252Fc1742d86c28847e5b18520277127a15d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/c1742d86c28847e5b18520277127a15d/images/large/1.jpg saved to cache
2026-01-27 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb
2026-01-27 20:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb, skipping ID generation
2026-01-27 20:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb with scrape type 1
2026-01-27 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb from tracking dictionaries
2026-01-27 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb sending to next pipeline
2026-01-27 20:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb, identifier: 1875127
2026-01-27 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572652810>
2026-01-27 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1669705e-2e62-58d7-81e1-f6be679b946b/1669705e-2e62-58d7-81e1-f6be679b946b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F942%252F0737f7ec02144285af33fd5d83f8ced9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/942/0737f7ec02144285af33fd5d83f8ced9/images/large/1.jpg saved to cache
2026-01-27 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1669705e-2e62-58d7-81e1-f6be679b946b
2026-01-27 20:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1669705e-2e62-58d7-81e1-f6be679b946b, skipping ID generation
2026-01-27 20:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1669705e-2e62-58d7-81e1-f6be679b946b with scrape type 1
2026-01-27 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1669705e-2e62-58d7-81e1-f6be679b946b from tracking dictionaries
2026-01-27 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1669705e-2e62-58d7-81e1-f6be679b946b sending to next pipeline
2026-01-27 20:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1669705e-2e62-58d7-81e1-f6be679b946b, identifier: 1875128
2026-01-27 20:02:28 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at -2 pages/min), scraped 76 items (at 48 items/min)
2026-01-27 20:02:28 [ayvens.es] INFO: Found listing with ID: 1875148
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875148%27 HTTP/1.1" 200 None
2026-01-27 20:02:28 [ayvens.es] INFO: Scrape type for 1875148: 1
2026-01-27 20:02:28 [ayvens.es] INFO: Extracting data for car ID: 1875148
2026-01-27 20:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52b8b4d-67d2-5c2a-939d-824d1913795b with identifier: 1875148
2026-01-27 20:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52b8b4d-67d2-5c2a-939d-824d1913795b with scrape type 1
2026-01-27 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a52b8b4d-67d2-5c2a-939d-824d1913795b
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F268%252Fc5461df920a4415390fae2bbd1464055%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/268/c5461df920a4415390fae2bbd1464055/images/large/1.jpg not downloaded yet
2026-01-27 20:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b333a73f-518b-5822-a75c-2fd8908977fa with identifier: 1875126
2026-01-27 20:02:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b333a73f-518b-5822-a75c-2fd8908977fa with identifier: 1875126
2026-01-27 20:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b333a73f-518b-5822-a75c-2fd8908977fa with identifier: 1875126 to the API
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/088/9f01101972b14dbf9befd1524a94bb40/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Snowflake',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b333a73f-518b-5822-a75c-2fd8908977fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-30',
 'odometer': 145471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b333a73f-518b-5822-a75c-2fd8908977fa/b333a73f-518b-5822-a75c-2fd8908977fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/088/9f01101972b14dbf9befd1524a94bb40/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-30 e-SKYACTIV-X 2.0 137kW AT Evolution',
 'transmission': 'manual',
 'trim': 'e-SKYACTIV-X 2.0 137kW AT Evolution',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875126%27 HTTP/1.1" 200 None
2026-01-27 20:02:28 [ayvens.es] INFO: Saving data for 1875126: {'created_time': 1769544148.85414, 'last_price_update_time': 1769544148.854153, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875126') HTTP/1.1" 204 0
2026-01-27 20:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 729953cd-6015-5335-a742-147e109d2385 with identifier: 1875125
2026-01-27 20:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 729953cd-6015-5335-a742-147e109d2385 with identifier: 1875125
2026-01-27 20:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c4', 'trim': 'puretech 100 s&s 6v live pack', 'title': 'citroën c4 puretech 100 s&s 6v live pack', 'price': 0, 'odometer': 57406, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-27', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 126, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '729953cd-6015-5335-a742-147e109d2385', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729953cd-6015-5335-a742-147e109d2385/729953cd-6015-5335-a742-147e109d2385_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/690/799ccd4dd40a459f9dea5762a9a04cf2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 347052}], 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'citroën c4', 'sanitized_make': 'citron', 'odometer_in_km': 57406}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'color': 'gris',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '729953cd-6015-5335-a742-147e109d2385',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c4',
     'model': 'c4',
     'odometer': 57406,
     'odometer_in_km': 57406,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729953cd-6015-5335-a742-147e109d2385/729953cd-6015-5335-a742-147e109d2385_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 347052,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/690/799ccd4dd40a459f9dea5762a9a04cf2/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-04-27',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c4 puretech 100 s&s 6v live pack',
     'transmission': 'manual',
     'trim': 'puretech 100 s&s 6v live pack',
     'vin': None,
     'year': 2023}
2026-01-27 20:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 729953cd-6015-5335-a742-147e109d2385 spider: ayvens.es
2026-01-27 20:02:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 729953cd-6015-5335-a742-147e109d2385 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c4', 'trim': 'puretech 100 s&s 6v live pack', 'title': 'citroën c4 puretech 100 s&s 6v live pack', 'price': 0, 'odometer': 57406, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-27', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 126, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '729953cd-6015-5335-a742-147e109d2385', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729953cd-6015-5335-a742-147e109d2385/729953cd-6015-5335-a742-147e109d2385_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/690/799ccd4dd40a459f9dea5762a9a04cf2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 347052}], 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'citroën c4', 'sanitized_make': 'citron', 'odometer_in_km': 57406}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'color': 'gris',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '729953cd-6015-5335-a742-147e109d2385',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c4',
     'model': 'c4',
     'odometer': 57406,
     'odometer_in_km': 57406,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729953cd-6015-5335-a742-147e109d2385/729953cd-6015-5335-a742-147e109d2385_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 347052,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/690/799ccd4dd40a459f9dea5762a9a04cf2/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-04-27',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c4 puretech 100 s&s 6v live pack',
     'transmission': 'manual',
     'trim': 'puretech 100 s&s 6v live pack',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '729953cd-6015-5335-a742-147e109d2385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4',
 'odometer': 57406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729953cd-6015-5335-a742-147e109d2385/729953cd-6015-5335-a742-147e109d2385_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/690/799ccd4dd40a459f9dea5762a9a04cf2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 PureTech 100 S&S 6v Live Pack',
 'transmission': 'manual',
 'trim': 'PureTech 100 S&S 6v Live Pack',
 'vin': None,
 'year': 2023}
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875125%27 HTTP/1.1" 200 None
2026-01-27 20:02:29 [ayvens.es] INFO: Saving data for 1875125: {'created_time': 1769544149.121209, 'last_price_update_time': 1769544149.121222, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875125') HTTP/1.1" 204 0
2026-01-27 20:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1542cfc1-0e64-5250-a253-efdcdc9a30bd with identifier: 1875124
2026-01-27 20:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1542cfc1-0e64-5250-a253-efdcdc9a30bd with identifier: 1875124
2026-01-27 20:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1542cfc1-0e64-5250-a253-efdcdc9a30bd with identifier: 1875124 to the API
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/136/d948130524c6433a8a93591dfd079034/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1542cfc1-0e64-5250-a253-efdcdc9a30bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 51621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1542cfc1-0e64-5250-a253-efdcdc9a30bd/1542cfc1-0e64-5250-a253-efdcdc9a30bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/136/d948130524c6433a8a93591dfd079034/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive16d',
 'transmission': 'manual',
 'trim': 'sDrive16d',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875124%27 HTTP/1.1" 200 None
2026-01-27 20:02:29 [ayvens.es] INFO: Saving data for 1875124: {'created_time': 1769544149.510811, 'last_price_update_time': 1769544149.510824, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875124') HTTP/1.1" 204 0
2026-01-27 20:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb with identifier: 1875127
2026-01-27 20:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb with identifier: 1875127
2026-01-27 20:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154798 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154798
2026-01-27 20:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb spider: ayvens.es
2026-01-27 20:02:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0cca7df7-16a8-52bd-ab0b-1b1efbb886eb due to rule: high_mileage_for_country.json, error: 154798 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154798
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0cca7df7-16a8-52bd-ab0b-1b1efbb886eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE',
 'odometer': 154798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cca7df7-16a8-52bd-ab0b-1b1efbb886eb/0cca7df7-16a8-52bd-ab0b-1b1efbb886eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/418/c1742d86c28847e5b18520277127a15d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE GLE 450 4MATIC',
 'transmission': 'manual',
 'trim': 'GLE 450 4MATIC',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875127%27 HTTP/1.1" 200 None
2026-01-27 20:02:29 [ayvens.es] INFO: Saving data for 1875127: {'created_time': 1769544149.770934, 'last_price_update_time': 1769544149.771006, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875127') HTTP/1.1" 204 0
2026-01-27 20:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1669705e-2e62-58d7-81e1-f6be679b946b with identifier: 1875128
2026-01-27 20:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1669705e-2e62-58d7-81e1-f6be679b946b with identifier: 1875128
2026-01-27 20:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155679 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155679
2026-01-27 20:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1669705e-2e62-58d7-81e1-f6be679b946b spider: ayvens.es
2026-01-27 20:02:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1669705e-2e62-58d7-81e1-f6be679b946b due to rule: high_mileage_for_country.json, error: 155679 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155679
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1669705e-2e62-58d7-81e1-f6be679b946b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 155679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1669705e-2e62-58d7-81e1-f6be679b946b/1669705e-2e62-58d7-81e1-f6be679b946b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/942/0737f7ec02144285af33fd5d83f8ced9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': '(O) Business Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875128%27 HTTP/1.1" 200 None
2026-01-27 20:02:29 [ayvens.es] INFO: Saving data for 1875128: {'created_time': 1769544149.998028, 'last_price_update_time': 1769544149.998038, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875128') HTTP/1.1" 204 0
2026-01-27 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/170/90ee7a739f5b4793b1d64bdf3f0d75dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/838/2544b96893fb478c8cbc13f69587fe96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:30 [ayvens.es] INFO: Found listing with ID: 1875149
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875149%27 HTTP/1.1" 200 None
2026-01-27 20:02:30 [ayvens.es] INFO: Scrape type for 1875149: 1
2026-01-27 20:02:30 [ayvens.es] INFO: Extracting data for car ID: 1875149
2026-01-27 20:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f5dae86-692f-58d3-89d4-0f4c702483a4 with identifier: 1875149
2026-01-27 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f5dae86-692f-58d3-89d4-0f4c702483a4 with scrape type 1
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5f5dae86-692f-58d3-89d4-0f4c702483a4
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F20169adb77ab462a85f4e6229905b748%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/20169adb77ab462a85f4e6229905b748/images/large/1.jpg not downloaded yet
2026-01-27 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/594/dcc6432bd37948298468b0213960f7d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/234/8ff9e36f8bf440b48e6f8d5fe4eead34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/424/c6cb74fbcd5043cb91b2fce4b9730747/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:30 [ayvens.es] INFO: Found listing with ID: 1875150
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875150%27 HTTP/1.1" 200 None
2026-01-27 20:02:30 [ayvens.es] INFO: Scrape type for 1875150: 1
2026-01-27 20:02:30 [ayvens.es] INFO: Extracting data for car ID: 1875150
2026-01-27 20:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617a028f-5edf-5432-9a5b-ff14adf249c4 with identifier: 1875150
2026-01-27 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617a028f-5edf-5432-9a5b-ff14adf249c4 with scrape type 1
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 617a028f-5edf-5432-9a5b-ff14adf249c4
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F315%252Ffa7039431cc54bab9b3a54d9fe2eb3fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/315/fa7039431cc54bab9b3a54d9fe2eb3fb/images/large/1.jpg not downloaded yet
2026-01-27 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/541/f0db709addda4ed1922014941c4c8246/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/496/5db8c5894282477a9fab8f185025a5fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:30 [ayvens.es] INFO: Found listing with ID: 1875151
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875151%27 HTTP/1.1" 200 None
2026-01-27 20:02:30 [ayvens.es] INFO: Scrape type for 1875151: 1
2026-01-27 20:02:30 [ayvens.es] INFO: Extracting data for car ID: 1875151
2026-01-27 20:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc43caf-0849-5612-a2be-7daf551f3ff1 with identifier: 1875151
2026-01-27 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc43caf-0849-5612-a2be-7daf551f3ff1 with scrape type 1
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4fc43caf-0849-5612-a2be-7daf551f3ff1
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F16d66eb4603e4a7d89a53357847aaa3e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/16d66eb4603e4a7d89a53357847aaa3e/images/large/1.jpg not downloaded yet
2026-01-27 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/353/2b8c2f4c641f42ddbb97ab85e5bbffd6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:30 [ayvens.es] INFO: Found listing with ID: 1875152
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875152%27 HTTP/1.1" 200 None
2026-01-27 20:02:30 [ayvens.es] INFO: Scrape type for 1875152: 1
2026-01-27 20:02:30 [ayvens.es] INFO: Extracting data for car ID: 1875152
2026-01-27 20:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c865025d-2382-50b9-a828-58211ca9cd9f with identifier: 1875152
2026-01-27 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c865025d-2382-50b9-a828-58211ca9cd9f with scrape type 1
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c865025d-2382-50b9-a828-58211ca9cd9f
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F060%252F23e523e8f1f64be5bfd28e1e9058db44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/060/23e523e8f1f64be5bfd28e1e9058db44/images/large/1.jpg not downloaded yet
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a7df50>
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef37f36d-cb13-53ca-95ed-497e35f8de3c/ef37f36d-cb13-53ca-95ed-497e35f8de3c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252F90ee7a739f5b4793b1d64bdf3f0d75dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/90ee7a739f5b4793b1d64bdf3f0d75dc/images/large/1.jpg saved to cache
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef37f36d-cb13-53ca-95ed-497e35f8de3c
2026-01-27 20:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef37f36d-cb13-53ca-95ed-497e35f8de3c, skipping ID generation
2026-01-27 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef37f36d-cb13-53ca-95ed-497e35f8de3c with scrape type 1
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ef37f36d-cb13-53ca-95ed-497e35f8de3c from tracking dictionaries
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef37f36d-cb13-53ca-95ed-497e35f8de3c sending to next pipeline
2026-01-27 20:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef37f36d-cb13-53ca-95ed-497e35f8de3c, identifier: 1875134
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572271d10>
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf721b49-ca23-539b-b12c-fe2b0aa8fcbb/cf721b49-ca23-539b-b12c-fe2b0aa8fcbb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F838%252F2544b96893fb478c8cbc13f69587fe96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/838/2544b96893fb478c8cbc13f69587fe96/images/large/1.jpg saved to cache
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf721b49-ca23-539b-b12c-fe2b0aa8fcbb
2026-01-27 20:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf721b49-ca23-539b-b12c-fe2b0aa8fcbb, skipping ID generation
2026-01-27 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf721b49-ca23-539b-b12c-fe2b0aa8fcbb with scrape type 1
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf721b49-ca23-539b-b12c-fe2b0aa8fcbb from tracking dictionaries
2026-01-27 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf721b49-ca23-539b-b12c-fe2b0aa8fcbb sending to next pipeline
2026-01-27 20:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cf721b49-ca23-539b-b12c-fe2b0aa8fcbb, identifier: 1875133
2026-01-27 20:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef37f36d-cb13-53ca-95ed-497e35f8de3c with identifier: 1875134
2026-01-27 20:02:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef37f36d-cb13-53ca-95ed-497e35f8de3c with identifier: 1875134
2026-01-27 20:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef37f36d-cb13-53ca-95ed-497e35f8de3c with identifier: 1875134 to the API
2026-01-27 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/170/90ee7a739f5b4793b1d64bdf3f0d75dc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Cararraweiss',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ef37f36d-cb13-53ca-95ed-497e35f8de3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 92846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef37f36d-cb13-53ca-95ed-497e35f8de3c/ef37f36d-cb13-53ca-95ed-497e35f8de3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/170/90ee7a739f5b4793b1d64bdf3f0d75dc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.5 MHEV iMT Emotion 118kW (160CV)',
 'transmission': 'manual',
 'trim': '1.5 MHEV iMT Emotion 118kW (160CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875134%27 HTTP/1.1" 200 None
2026-01-27 20:02:31 [ayvens.es] INFO: Saving data for 1875134: {'created_time': 1769544151.651877, 'last_price_update_time': 1769544151.651887, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875134') HTTP/1.1" 204 0
2026-01-27 20:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cf721b49-ca23-539b-b12c-fe2b0aa8fcbb with identifier: 1875133
2026-01-27 20:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cf721b49-ca23-539b-b12c-fe2b0aa8fcbb with identifier: 1875133
2026-01-27 20:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172588 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172588
2026-01-27 20:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cf721b49-ca23-539b-b12c-fe2b0aa8fcbb spider: ayvens.es
2026-01-27 20:02:32 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: cf721b49-ca23-539b-b12c-fe2b0aa8fcbb due to rule: high_mileage_for_country.json, error: 172588 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172588
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'cf721b49-ca23-539b-b12c-fe2b0aa8fcbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 172588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf721b49-ca23-539b-b12c-fe2b0aa8fcbb/cf721b49-ca23-539b-b12c-fe2b0aa8fcbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/838/2544b96893fb478c8cbc13f69587fe96/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875133%27 HTTP/1.1" 200 None
2026-01-27 20:02:32 [ayvens.es] INFO: Saving data for 1875133: {'created_time': 1769544152.021034, 'last_price_update_time': 1769544152.021044, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875133') HTTP/1.1" 204 0
2026-01-27 20:02:32 [ayvens.es] INFO: Found listing with ID: 1875153
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875153%27 HTTP/1.1" 200 None
2026-01-27 20:02:32 [ayvens.es] INFO: Scrape type for 1875153: 1
2026-01-27 20:02:32 [ayvens.es] INFO: Extracting data for car ID: 1875153
2026-01-27 20:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 307e7000-ee7c-572f-a4dc-604dcda2d4dc with identifier: 1875153
2026-01-27 20:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 307e7000-ee7c-572f-a4dc-604dcda2d4dc with scrape type 1
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 307e7000-ee7c-572f-a4dc-604dcda2d4dc
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F436%252F8a0cd9ae938d4b50b39618b2cf6f5b22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/436/8a0cd9ae938d4b50b39618b2cf6f5b22/images/large/1.jpg not downloaded yet
2026-01-27 20:02:32 [ayvens.es] INFO: Found listing with ID: 1875154
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875154%27 HTTP/1.1" 200 None
2026-01-27 20:02:32 [ayvens.es] INFO: Scrape type for 1875154: 1
2026-01-27 20:02:32 [ayvens.es] INFO: Extracting data for car ID: 1875154
2026-01-27 20:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603d77c2-e0c9-5059-99d3-f01f9ba2a86b with identifier: 1875154
2026-01-27 20:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603d77c2-e0c9-5059-99d3-f01f9ba2a86b with scrape type 1
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 603d77c2-e0c9-5059-99d3-f01f9ba2a86b
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F987%252F5395744015d549428b8e9f4f08953692%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/987/5395744015d549428b8e9f4f08953692/images/large/1.jpg not downloaded yet
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722ac610>
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4699f89-1eb9-5eaa-8f8e-d6506be01bd8/b4699f89-1eb9-5eaa-8f8e-d6506be01bd8_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F594%252Fdcc6432bd37948298468b0213960f7d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/594/dcc6432bd37948298468b0213960f7d0/images/large/1.jpg saved to cache
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4699f89-1eb9-5eaa-8f8e-d6506be01bd8
2026-01-27 20:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4699f89-1eb9-5eaa-8f8e-d6506be01bd8, skipping ID generation
2026-01-27 20:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4699f89-1eb9-5eaa-8f8e-d6506be01bd8 with scrape type 1
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b4699f89-1eb9-5eaa-8f8e-d6506be01bd8 from tracking dictionaries
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4699f89-1eb9-5eaa-8f8e-d6506be01bd8 sending to next pipeline
2026-01-27 20:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4699f89-1eb9-5eaa-8f8e-d6506be01bd8, identifier: 1875137
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572439010>
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78eea009-9624-5ba7-994f-f98fafe8cb79/78eea009-9624-5ba7-994f-f98fafe8cb79_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F234%252F8ff9e36f8bf440b48e6f8d5fe4eead34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/234/8ff9e36f8bf440b48e6f8d5fe4eead34/images/large/1.jpg saved to cache
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78eea009-9624-5ba7-994f-f98fafe8cb79
2026-01-27 20:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78eea009-9624-5ba7-994f-f98fafe8cb79, skipping ID generation
2026-01-27 20:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78eea009-9624-5ba7-994f-f98fafe8cb79 with scrape type 1
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 78eea009-9624-5ba7-994f-f98fafe8cb79 from tracking dictionaries
2026-01-27 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78eea009-9624-5ba7-994f-f98fafe8cb79 sending to next pipeline
2026-01-27 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 78eea009-9624-5ba7-994f-f98fafe8cb79, identifier: 1875136
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572625ad0>
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eba4466c-056e-5a30-9d2c-4f236c954ef5/eba4466c-056e-5a30-9d2c-4f236c954ef5_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F424%252Fc6cb74fbcd5043cb91b2fce4b9730747%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/424/c6cb74fbcd5043cb91b2fce4b9730747/images/large/1.jpg saved to cache
2026-01-27 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eba4466c-056e-5a30-9d2c-4f236c954ef5
2026-01-27 20:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eba4466c-056e-5a30-9d2c-4f236c954ef5, skipping ID generation
2026-01-27 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eba4466c-056e-5a30-9d2c-4f236c954ef5 with scrape type 1
2026-01-27 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eba4466c-056e-5a30-9d2c-4f236c954ef5 from tracking dictionaries
2026-01-27 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eba4466c-056e-5a30-9d2c-4f236c954ef5 sending to next pipeline
2026-01-27 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eba4466c-056e-5a30-9d2c-4f236c954ef5, identifier: 1875140
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724af8d0>
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8adfd5-afa0-5304-8c19-d20ac341b2de/1b8adfd5-afa0-5304-8c19-d20ac341b2de_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F541%252Ff0db709addda4ed1922014941c4c8246%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/541/f0db709addda4ed1922014941c4c8246/images/large/1.jpg saved to cache
2026-01-27 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b8adfd5-afa0-5304-8c19-d20ac341b2de
2026-01-27 20:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b8adfd5-afa0-5304-8c19-d20ac341b2de, skipping ID generation
2026-01-27 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8adfd5-afa0-5304-8c19-d20ac341b2de with scrape type 1
2026-01-27 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1b8adfd5-afa0-5304-8c19-d20ac341b2de from tracking dictionaries
2026-01-27 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b8adfd5-afa0-5304-8c19-d20ac341b2de sending to next pipeline
2026-01-27 20:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1b8adfd5-afa0-5304-8c19-d20ac341b2de, identifier: 1875135
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f7bad0>
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74cca09-a462-5f23-b2e8-58cc10d31bb1/e74cca09-a462-5f23-b2e8-58cc10d31bb1_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F496%252F5db8c5894282477a9fab8f185025a5fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/496/5db8c5894282477a9fab8f185025a5fd/images/large/1.jpg saved to cache
2026-01-27 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e74cca09-a462-5f23-b2e8-58cc10d31bb1
2026-01-27 20:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e74cca09-a462-5f23-b2e8-58cc10d31bb1, skipping ID generation
2026-01-27 20:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74cca09-a462-5f23-b2e8-58cc10d31bb1 with scrape type 1
2026-01-27 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e74cca09-a462-5f23-b2e8-58cc10d31bb1 from tracking dictionaries
2026-01-27 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e74cca09-a462-5f23-b2e8-58cc10d31bb1 sending to next pipeline
2026-01-27 20:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e74cca09-a462-5f23-b2e8-58cc10d31bb1, identifier: 1875139
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570929c90>
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4367e109-8d7b-5741-a0b0-e3b0ad45446c/4367e109-8d7b-5741-a0b0-e3b0ad45446c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F2b8c2f4c641f42ddbb97ab85e5bbffd6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/2b8c2f4c641f42ddbb97ab85e5bbffd6/images/large/1.jpg saved to cache
2026-01-27 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4367e109-8d7b-5741-a0b0-e3b0ad45446c
2026-01-27 20:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4367e109-8d7b-5741-a0b0-e3b0ad45446c, skipping ID generation
2026-01-27 20:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4367e109-8d7b-5741-a0b0-e3b0ad45446c with scrape type 1
2026-01-27 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4367e109-8d7b-5741-a0b0-e3b0ad45446c from tracking dictionaries
2026-01-27 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4367e109-8d7b-5741-a0b0-e3b0ad45446c sending to next pipeline
2026-01-27 20:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4367e109-8d7b-5741-a0b0-e3b0ad45446c, identifier: 1875138
2026-01-27 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/334/bbb88fce2f1d435abc9c30e7738cb73e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:35 [ayvens.es] INFO: Found listing with ID: 1875155
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875155%27 HTTP/1.1" 200 None
2026-01-27 20:02:35 [ayvens.es] INFO: Scrape type for 1875155: 1
2026-01-27 20:02:35 [ayvens.es] INFO: Extracting data for car ID: 1875155
2026-01-27 20:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 with identifier: 1875155
2026-01-27 20:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 with scrape type 1
2026-01-27 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2a1c7cb-21e2-5e8b-8101-e5108e196ab4
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252Fd380b4ee780a427d96e0ccbadb104e8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/d380b4ee780a427d96e0ccbadb104e8b/images/large/1.jpg not downloaded yet
2026-01-27 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4699f89-1eb9-5eaa-8f8e-d6506be01bd8 with identifier: 1875137
2026-01-27 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4699f89-1eb9-5eaa-8f8e-d6506be01bd8 with identifier: 1875137
2026-01-27 20:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b4699f89-1eb9-5eaa-8f8e-d6506be01bd8 with identifier: 1875137 to the API
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/594/dcc6432bd37948298468b0213960f7d0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b4699f89-1eb9-5eaa-8f8e-d6506be01bd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 108147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4699f89-1eb9-5eaa-8f8e-d6506be01bd8/b4699f89-1eb9-5eaa-8f8e-d6506be01bd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/594/dcc6432bd37948298468b0213960f7d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 HIBRIDO AIRE CVT',
 'transmission': 'manual',
 'trim': '1.8 HIBRIDO AIRE CVT',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875137%27 HTTP/1.1" 200 None
2026-01-27 20:02:35 [ayvens.es] INFO: Saving data for 1875137: {'created_time': 1769544155.457795, 'last_price_update_time': 1769544155.457807, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875137') HTTP/1.1" 204 0
2026-01-27 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 78eea009-9624-5ba7-994f-f98fafe8cb79 with identifier: 1875136
2026-01-27 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 78eea009-9624-5ba7-994f-f98fafe8cb79 with identifier: 1875136
2026-01-27 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146549 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146549
2026-01-27 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 78eea009-9624-5ba7-994f-f98fafe8cb79 spider: ayvens.es
2026-01-27 20:02:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 78eea009-9624-5ba7-994f-f98fafe8cb79 due to rule: high_mileage_for_make.json, error: 146549 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146549
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '78eea009-9624-5ba7-994f-f98fafe8cb79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 146549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78eea009-9624-5ba7-994f-f98fafe8cb79/78eea009-9624-5ba7-994f-f98fafe8cb79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/234/8ff9e36f8bf440b48e6f8d5fe4eead34/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure EAT8',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875136%27 HTTP/1.1" 200 None
2026-01-27 20:02:35 [ayvens.es] INFO: Saving data for 1875136: {'created_time': 1769544155.695033, 'last_price_update_time': 1769544155.695045, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875136') HTTP/1.1" 204 0
2026-01-27 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eba4466c-056e-5a30-9d2c-4f236c954ef5 with identifier: 1875140
2026-01-27 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eba4466c-056e-5a30-9d2c-4f236c954ef5 with identifier: 1875140
2026-01-27 20:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eba4466c-056e-5a30-9d2c-4f236c954ef5 with identifier: 1875140 to the API
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/424/c6cb74fbcd5043cb91b2fce4b9730747/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eba4466c-056e-5a30-9d2c-4f236c954ef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 37137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eba4466c-056e-5a30-9d2c-4f236c954ef5/eba4466c-056e-5a30-9d2c-4f236c954ef5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/424/c6cb74fbcd5043cb91b2fce4b9730747/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 74kW (100CV) MHEV iMT Concept',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 74kW (100CV) MHEV iMT Concept',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875140%27 HTTP/1.1" 200 None
2026-01-27 20:02:36 [ayvens.es] INFO: Saving data for 1875140: {'created_time': 1769544156.050642, 'last_price_update_time': 1769544156.050658, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875140') HTTP/1.1" 204 0
2026-01-27 20:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1b8adfd5-afa0-5304-8c19-d20ac341b2de with identifier: 1875135
2026-01-27 20:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1b8adfd5-afa0-5304-8c19-d20ac341b2de with identifier: 1875135
2026-01-27 20:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ds automobiles', 'model': 'ds 3 crossback', 'trim': 'puretech 73 kw manual performance line', 'title': 'ds automobiles ds 3 crossback puretech 73 kw manual performance line', 'price': 0, 'odometer': 38549, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-28', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 127, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '1b8adfd5-afa0-5304-8c19-d20ac341b2de', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8adfd5-afa0-5304-8c19-d20ac341b2de/1b8adfd5-afa0-5304-8c19-d20ac341b2de_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/541/f0db709addda4ed1922014941c4c8246/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 599326}], 'current_year_diff': 5, 'age_in_months': 48, 'make_model': 'ds automobiles ds 3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 38549}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '1b8adfd5-afa0-5304-8c19-d20ac341b2de',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds 3 crossback',
     'model': 'ds 3 crossback',
     'odometer': 38549,
     'odometer_in_km': 38549,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8adfd5-afa0-5304-8c19-d20ac341b2de/1b8adfd5-afa0-5304-8c19-d20ac341b2de_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 599326,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/541/f0db709addda4ed1922014941c4c8246/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-28',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds 3 crossback puretech 73 kw manual '
              'performance line',
     'transmission': 'manual',
     'trim': 'puretech 73 kw manual performance line',
     'vin': None,
     'year': 2021}
2026-01-27 20:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 1b8adfd5-afa0-5304-8c19-d20ac341b2de spider: ayvens.es
2026-01-27 20:02:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1b8adfd5-afa0-5304-8c19-d20ac341b2de due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ds automobiles', 'model': 'ds 3 crossback', 'trim': 'puretech 73 kw manual performance line', 'title': 'ds automobiles ds 3 crossback puretech 73 kw manual performance line', 'price': 0, 'odometer': 38549, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-28', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 127, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '1b8adfd5-afa0-5304-8c19-d20ac341b2de', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8adfd5-afa0-5304-8c19-d20ac341b2de/1b8adfd5-afa0-5304-8c19-d20ac341b2de_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/541/f0db709addda4ed1922014941c4c8246/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 599326}], 'current_year_diff': 5, 'age_in_months': 48, 'make_model': 'ds automobiles ds 3 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 38549}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '1b8adfd5-afa0-5304-8c19-d20ac341b2de',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds 3 crossback',
     'model': 'ds 3 crossback',
     'odometer': 38549,
     'odometer_in_km': 38549,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8adfd5-afa0-5304-8c19-d20ac341b2de/1b8adfd5-afa0-5304-8c19-d20ac341b2de_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 599326,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/541/f0db709addda4ed1922014941c4c8246/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-28',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds 3 crossback puretech 73 kw manual '
              'performance line',
     'transmission': 'manual',
     'trim': 'puretech 73 kw manual performance line',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b8adfd5-afa0-5304-8c19-d20ac341b2de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 38549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8adfd5-afa0-5304-8c19-d20ac341b2de/1b8adfd5-afa0-5304-8c19-d20ac341b2de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/541/f0db709addda4ed1922014941c4c8246/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK PureTech 73 kW Manual PERFORMANCE '
          'LINE',
 'transmission': 'manual',
 'trim': 'PureTech 73 kW Manual PERFORMANCE LINE',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875135%27 HTTP/1.1" 200 None
2026-01-27 20:02:36 [ayvens.es] INFO: Saving data for 1875135: {'created_time': 1769544156.425912, 'last_price_update_time': 1769544156.425922, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875135') HTTP/1.1" 204 0
2026-01-27 20:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e74cca09-a462-5f23-b2e8-58cc10d31bb1 with identifier: 1875139
2026-01-27 20:02:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e74cca09-a462-5f23-b2e8-58cc10d31bb1 with identifier: 1875139
2026-01-27 20:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e74cca09-a462-5f23-b2e8-58cc10d31bb1 with identifier: 1875139 to the API
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/496/5db8c5894282477a9fab8f185025a5fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Santorini',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e74cca09-a462-5f23-b2e8-58cc10d31bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 96460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74cca09-a462-5f23-b2e8-58cc10d31bb1/e74cca09-a462-5f23-b2e8-58cc10d31bb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/496/5db8c5894282477a9fab8f185025a5fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0D 120kW R-Dynamic SE 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0D 120kW R-Dynamic SE 4WD Auto',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875139%27 HTTP/1.1" 200 None
2026-01-27 20:02:36 [ayvens.es] INFO: Saving data for 1875139: {'created_time': 1769544156.750823, 'last_price_update_time': 1769544156.750836, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875139') HTTP/1.1" 204 0
2026-01-27 20:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4367e109-8d7b-5741-a0b0-e3b0ad45446c with identifier: 1875138
2026-01-27 20:02:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4367e109-8d7b-5741-a0b0-e3b0ad45446c with identifier: 1875138
2026-01-27 20:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4367e109-8d7b-5741-a0b0-e3b0ad45446c with identifier: 1875138 to the API
2026-01-27 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/353/2b8c2f4c641f42ddbb97ab85e5bbffd6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'Chili',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4367e109-8d7b-5741-a0b0-e3b0ad45446c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 39796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4367e109-8d7b-5741-a0b0-e3b0ad45446c/4367e109-8d7b-5741-a0b0-e3b0ad45446c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/353/2b8c2f4c641f42ddbb97ab85e5bbffd6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI MINI COOPER S CABRIO',
 'transmission': 'manual',
 'trim': 'COOPER S CABRIO',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875138%27 HTTP/1.1" 200 None
2026-01-27 20:02:37 [ayvens.es] INFO: Saving data for 1875138: {'created_time': 1769544157.614088, 'last_price_update_time': 1769544157.6141, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875138') HTTP/1.1" 204 0
2026-01-27 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/340/8ff1819e032547d8a7f143324a22f282/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/030/14cb4d525b0e4fcbb3394266783dd709/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/134/4dda4ccae2e747a391aa8349de277952/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:37 [ayvens.es] INFO: Found listing with ID: 1875156
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875156%27 HTTP/1.1" 200 None
2026-01-27 20:02:37 [ayvens.es] INFO: Scrape type for 1875156: 1
2026-01-27 20:02:37 [ayvens.es] INFO: Extracting data for car ID: 1875156
2026-01-27 20:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657ff108-bc29-590a-856d-b2b012db51ea with identifier: 1875156
2026-01-27 20:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657ff108-bc29-590a-856d-b2b012db51ea with scrape type 1
2026-01-27 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 657ff108-bc29-590a-856d-b2b012db51ea
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F200%252Fba6890f3282344528bfa8a591788a201%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/200/ba6890f3282344528bfa8a591788a201/images/large/1.jpg not downloaded yet
2026-01-27 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/404/8e5e2e0881ef4b5bad79d1052539d454/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57095bd90>
2026-01-27 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac48414-2f6f-50f0-8b81-66da60afd54c/1ac48414-2f6f-50f0-8b81-66da60afd54c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F334%252Fbbb88fce2f1d435abc9c30e7738cb73e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/334/bbb88fce2f1d435abc9c30e7738cb73e/images/large/1.jpg saved to cache
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ac48414-2f6f-50f0-8b81-66da60afd54c
2026-01-27 20:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ac48414-2f6f-50f0-8b81-66da60afd54c, skipping ID generation
2026-01-27 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac48414-2f6f-50f0-8b81-66da60afd54c with scrape type 1
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1ac48414-2f6f-50f0-8b81-66da60afd54c from tracking dictionaries
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ac48414-2f6f-50f0-8b81-66da60afd54c sending to next pipeline
2026-01-27 20:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1ac48414-2f6f-50f0-8b81-66da60afd54c, identifier: 1875141
2026-01-27 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/449/aef5c33c9a304855be4fc38d4c165e22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/224/efb29d67b49e4c829ed52f336558efcd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:38 [ayvens.es] INFO: Found listing with ID: 1875157
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875157%27 HTTP/1.1" 200 None
2026-01-27 20:02:38 [ayvens.es] INFO: Scrape type for 1875157: 1
2026-01-27 20:02:38 [ayvens.es] INFO: Extracting data for car ID: 1875157
2026-01-27 20:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4445b43-4842-59c8-8bc9-5c4e7eb96434 with identifier: 1875157
2026-01-27 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4445b43-4842-59c8-8bc9-5c4e7eb96434 with scrape type 1
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4445b43-4842-59c8-8bc9-5c4e7eb96434
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F292%252F8c6c1a13259b47849bf2f367be5faab4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/292/8c6c1a13259b47849bf2f367be5faab4/images/large/1.jpg not downloaded yet
2026-01-27 20:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1ac48414-2f6f-50f0-8b81-66da60afd54c with identifier: 1875141
2026-01-27 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1ac48414-2f6f-50f0-8b81-66da60afd54c with identifier: 1875141
2026-01-27 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'hyundai', 'model': 'i20', 'trim': '1.0 tgdi 74kw smart hibrido 48v', 'title': 'hyundai i20 1.0 tgdi 74kw smart hibrido 48v', 'price': 0, 'odometer': 203933, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-30', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.0l', 'c_o_2_emission_value': 115, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '1ac48414-2f6f-50f0-8b81-66da60afd54c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac48414-2f6f-50f0-8b81-66da60afd54c/1ac48414-2f6f-50f0-8b81-66da60afd54c_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/334/bbb88fce2f1d435abc9c30e7738cb73e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 331173}], 'current_year_diff': 5, 'age_in_months': 48, 'make_model': 'hyundai i20', 'sanitized_make': 'hyundai', 'odometer_in_km': 203933}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '1ac48414-2f6f-50f0-8b81-66da60afd54c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'hyundai',
     'make_model': 'hyundai i20',
     'model': 'i20',
     'odometer': 203933,
     'odometer_in_km': 203933,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac48414-2f6f-50f0-8b81-66da60afd54c/1ac48414-2f6f-50f0-8b81-66da60afd54c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 331173,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/334/bbb88fce2f1d435abc9c30e7738cb73e/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-30',
     'sanitized_make': 'hyundai',
     'seats_number': 5,
     'seller_name': None,
     'title': 'hyundai i20 1.0 tgdi 74kw smart hibrido 48v',
     'transmission': 'manual',
     'trim': '1.0 tgdi 74kw smart hibrido 48v',
     'vin': None,
     'year': 2021}
2026-01-27 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 1ac48414-2f6f-50f0-8b81-66da60afd54c spider: ayvens.es
2026-01-27 20:02:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1ac48414-2f6f-50f0-8b81-66da60afd54c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'hyundai', 'model': 'i20', 'trim': '1.0 tgdi 74kw smart hibrido 48v', 'title': 'hyundai i20 1.0 tgdi 74kw smart hibrido 48v', 'price': 0, 'odometer': 203933, 'odometer_reading_unit': 'km', 'registration_date': '2021-12-30', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.0l', 'c_o_2_emission_value': 115, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '1ac48414-2f6f-50f0-8b81-66da60afd54c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac48414-2f6f-50f0-8b81-66da60afd54c/1ac48414-2f6f-50f0-8b81-66da60afd54c_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/334/bbb88fce2f1d435abc9c30e7738cb73e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 331173}], 'current_year_diff': 5, 'age_in_months': 48, 'make_model': 'hyundai i20', 'sanitized_make': 'hyundai', 'odometer_in_km': 203933}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '1ac48414-2f6f-50f0-8b81-66da60afd54c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'hyundai',
     'make_model': 'hyundai i20',
     'model': 'i20',
     'odometer': 203933,
     'odometer_in_km': 203933,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac48414-2f6f-50f0-8b81-66da60afd54c/1ac48414-2f6f-50f0-8b81-66da60afd54c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 331173,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/334/bbb88fce2f1d435abc9c30e7738cb73e/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-30',
     'sanitized_make': 'hyundai',
     'seats_number': 5,
     'seller_name': None,
     'title': 'hyundai i20 1.0 tgdi 74kw smart hibrido 48v',
     'transmission': 'manual',
     'trim': '1.0 tgdi 74kw smart hibrido 48v',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1ac48414-2f6f-50f0-8b81-66da60afd54c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'I20',
 'odometer': 203933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac48414-2f6f-50f0-8b81-66da60afd54c/1ac48414-2f6f-50f0-8b81-66da60afd54c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/334/bbb88fce2f1d435abc9c30e7738cb73e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI I20 1.0 TGDi 74kW Smart Hibrido 48V',
 'transmission': 'manual',
 'trim': '1.0 TGDi 74kW Smart Hibrido 48V',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875141%27 HTTP/1.1" 200 None
2026-01-27 20:02:38 [ayvens.es] INFO: Saving data for 1875141: {'created_time': 1769544158.430754, 'last_price_update_time': 1769544158.430765, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875141') HTTP/1.1" 204 0
2026-01-27 20:02:38 [ayvens.es] INFO: Found listing with ID: 1875158
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875158%27 HTTP/1.1" 200 None
2026-01-27 20:02:38 [ayvens.es] INFO: Scrape type for 1875158: 1
2026-01-27 20:02:38 [ayvens.es] INFO: Extracting data for car ID: 1875158
2026-01-27 20:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3094a5d5-cd59-5ef2-be72-e59428127b3d with identifier: 1875158
2026-01-27 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3094a5d5-cd59-5ef2-be72-e59428127b3d with scrape type 1
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3094a5d5-cd59-5ef2-be72-e59428127b3d
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Fc1b9e672b57a474385c032e8b192c97b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/c1b9e672b57a474385c032e8b192c97b/images/large/1.jpg not downloaded yet
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571ef9bd0>
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c/e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F340%252F8ff1819e032547d8a7f143324a22f282%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/340/8ff1819e032547d8a7f143324a22f282/images/large/1.jpg saved to cache
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c
2026-01-27 20:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c, skipping ID generation
2026-01-27 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c with scrape type 1
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c from tracking dictionaries
2026-01-27 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c sending to next pipeline
2026-01-27 20:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c, identifier: 1875142
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572408510>
2026-01-27 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbf1b9a-c7a1-5cd8-9073-a298ff45df78/8fbf1b9a-c7a1-5cd8-9073-a298ff45df78_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F030%252F14cb4d525b0e4fcbb3394266783dd709%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/030/14cb4d525b0e4fcbb3394266783dd709/images/large/1.jpg saved to cache
2026-01-27 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78
2026-01-27 20:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78, skipping ID generation
2026-01-27 20:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 with scrape type 1
2026-01-27 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 from tracking dictionaries
2026-01-27 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 sending to next pipeline
2026-01-27 20:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78, identifier: 1875147
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57240b390>
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fc86a9-c137-5ca6-b1be-1d0221d7c1e2/70fc86a9-c137-5ca6-b1be-1d0221d7c1e2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F134%252F4dda4ccae2e747a391aa8349de277952%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/134/4dda4ccae2e747a391aa8349de277952/images/large/1.jpg saved to cache
2026-01-27 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2
2026-01-27 20:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2, skipping ID generation
2026-01-27 20:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 with scrape type 1
2026-01-27 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 from tracking dictionaries
2026-01-27 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 sending to next pipeline
2026-01-27 20:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2, identifier: 1875143
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a7d750>
2026-01-27 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b87889f7-e50c-5b99-8d0c-c372b64a2450/b87889f7-e50c-5b99-8d0c-c372b64a2450_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F404%252F8e5e2e0881ef4b5bad79d1052539d454%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/404/8e5e2e0881ef4b5bad79d1052539d454/images/large/1.jpg saved to cache
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b87889f7-e50c-5b99-8d0c-c372b64a2450
2026-01-27 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b87889f7-e50c-5b99-8d0c-c372b64a2450, skipping ID generation
2026-01-27 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b87889f7-e50c-5b99-8d0c-c372b64a2450 with scrape type 1
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b87889f7-e50c-5b99-8d0c-c372b64a2450 from tracking dictionaries
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b87889f7-e50c-5b99-8d0c-c372b64a2450 sending to next pipeline
2026-01-27 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b87889f7-e50c-5b99-8d0c-c372b64a2450, identifier: 1875144
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721ada10>
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f70f0a-04bc-5693-bafa-e1ada813ac4c/b8f70f0a-04bc-5693-bafa-e1ada813ac4c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252Faef5c33c9a304855be4fc38d4c165e22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/aef5c33c9a304855be4fc38d4c165e22/images/large/1.jpg saved to cache
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8f70f0a-04bc-5693-bafa-e1ada813ac4c
2026-01-27 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8f70f0a-04bc-5693-bafa-e1ada813ac4c, skipping ID generation
2026-01-27 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8f70f0a-04bc-5693-bafa-e1ada813ac4c with scrape type 1
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b8f70f0a-04bc-5693-bafa-e1ada813ac4c from tracking dictionaries
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8f70f0a-04bc-5693-bafa-e1ada813ac4c sending to next pipeline
2026-01-27 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b8f70f0a-04bc-5693-bafa-e1ada813ac4c, identifier: 1875146
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572268cd0>
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b33bbe46-8da3-59bb-9ff4-1d6c852e461f/b33bbe46-8da3-59bb-9ff4-1d6c852e461f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F224%252Fefb29d67b49e4c829ed52f336558efcd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/224/efb29d67b49e4c829ed52f336558efcd/images/large/1.jpg saved to cache
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b33bbe46-8da3-59bb-9ff4-1d6c852e461f
2026-01-27 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b33bbe46-8da3-59bb-9ff4-1d6c852e461f, skipping ID generation
2026-01-27 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33bbe46-8da3-59bb-9ff4-1d6c852e461f with scrape type 1
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b33bbe46-8da3-59bb-9ff4-1d6c852e461f from tracking dictionaries
2026-01-27 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b33bbe46-8da3-59bb-9ff4-1d6c852e461f sending to next pipeline
2026-01-27 20:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b33bbe46-8da3-59bb-9ff4-1d6c852e461f, identifier: 1875145
2026-01-27 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/268/c5461df920a4415390fae2bbd1464055/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:41 [ayvens.es] INFO: Found listing with ID: 1875159
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875159%27 HTTP/1.1" 200 None
2026-01-27 20:02:41 [ayvens.es] INFO: Scrape type for 1875159: 1
2026-01-27 20:02:41 [ayvens.es] INFO: Extracting data for car ID: 1875159
2026-01-27 20:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 186ea547-e029-53bc-975e-0cd711e9b2c0 with identifier: 1875159
2026-01-27 20:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186ea547-e029-53bc-975e-0cd711e9b2c0 with scrape type 1
2026-01-27 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 186ea547-e029-53bc-975e-0cd711e9b2c0
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F850%252Fe5256c32ea2147cba11438b7280fdb09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/850/e5256c32ea2147cba11438b7280fdb09/images/large/1.jpg not downloaded yet
2026-01-27 20:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c with identifier: 1875142
2026-01-27 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c with identifier: 1875142
2026-01-27 20:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c with identifier: 1875142 to the API
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/340/8ff1819e032547d8a7f143324a22f282/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 45094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c/e0ebf97e-ca73-5d8d-8d8e-bf262b37ed2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/340/8ff1819e032547d8a7f143324a22f282/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line X 1.5 EcoBlue 88kW (120CV) Auto',
 'transmission': 'manual',
 'trim': 'ST-Line X 1.5 EcoBlue 88kW (120CV) Auto',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875142%27 HTTP/1.1" 200 None
2026-01-27 20:02:41 [ayvens.es] INFO: Saving data for 1875142: {'created_time': 1769544161.469999, 'last_price_update_time': 1769544161.470009, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875142') HTTP/1.1" 204 0
2026-01-27 20:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 with identifier: 1875147
2026-01-27 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 with identifier: 1875147
2026-01-27 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156165 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156165
2026-01-27 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 spider: ayvens.es
2026-01-27 20:02:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 8fbf1b9a-c7a1-5cd8-9073-a298ff45df78 due to rule: high_mileage_for_country.json, error: 156165 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156165
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8fbf1b9a-c7a1-5cd8-9073-a298ff45df78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 156165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbf1b9a-c7a1-5cd8-9073-a298ff45df78/8fbf1b9a-c7a1-5cd8-9073-a298ff45df78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/030/14cb4d525b0e4fcbb3394266783dd709/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875147%27 HTTP/1.1" 200 None
2026-01-27 20:02:41 [ayvens.es] INFO: Saving data for 1875147: {'created_time': 1769544161.76576, 'last_price_update_time': 1769544161.765775, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875147') HTTP/1.1" 204 0
2026-01-27 20:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 with identifier: 1875143
2026-01-27 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 with identifier: 1875143
2026-01-27 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179706 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179706
2026-01-27 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 spider: ayvens.es
2026-01-27 20:02:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 70fc86a9-c137-5ca6-b1be-1d0221d7c1e2 due to rule: high_mileage_for_country.json, error: 179706 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179706
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '70fc86a9-c137-5ca6-b1be-1d0221d7c1e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 179706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fc86a9-c137-5ca6-b1be-1d0221d7c1e2/70fc86a9-c137-5ca6-b1be-1d0221d7c1e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/134/4dda4ccae2e747a391aa8349de277952/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.6 TDI 85kW (115CV) St&Sp Reference Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW (115CV) St&Sp Reference Eco',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875143%27 HTTP/1.1" 200 None
2026-01-27 20:02:42 [ayvens.es] INFO: Saving data for 1875143: {'created_time': 1769544162.004142, 'last_price_update_time': 1769544162.004154, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875143') HTTP/1.1" 204 0
2026-01-27 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b87889f7-e50c-5b99-8d0c-c372b64a2450 with identifier: 1875144
2026-01-27 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b87889f7-e50c-5b99-8d0c-c372b64a2450 with identifier: 1875144
2026-01-27 20:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b87889f7-e50c-5b99-8d0c-c372b64a2450 with identifier: 1875144 to the API
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/404/8e5e2e0881ef4b5bad79d1052539d454/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b87889f7-e50c-5b99-8d0c-c372b64a2450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 59799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b87889f7-e50c-5b99-8d0c-c372b64a2450/b87889f7-e50c-5b99-8d0c-c372b64a2450_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/404/8e5e2e0881ef4b5bad79d1052539d454/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS Advance 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2023}
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875144%27 HTTP/1.1" 200 None
2026-01-27 20:02:42 [ayvens.es] INFO: Saving data for 1875144: {'created_time': 1769544162.326249, 'last_price_update_time': 1769544162.326258, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875144') HTTP/1.1" 204 0
2026-01-27 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b8f70f0a-04bc-5693-bafa-e1ada813ac4c with identifier: 1875146
2026-01-27 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b8f70f0a-04bc-5693-bafa-e1ada813ac4c with identifier: 1875146
2026-01-27 20:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b8f70f0a-04bc-5693-bafa-e1ada813ac4c with identifier: 1875146 to the API
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/449/aef5c33c9a304855be4fc38d4c165e22/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b8f70f0a-04bc-5693-bafa-e1ada813ac4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA',
 'odometer': 148583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f70f0a-04bc-5693-bafa-e1ada813ac4c/b8f70f0a-04bc-5693-bafa-e1ada813ac4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/449/aef5c33c9a304855be4fc38d4c165e22/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA 1.4 Turbo 92kW (125CV) Selective',
 'transmission': 'manual',
 'trim': '1.4 Turbo 92kW (125CV) Selective',
 'vin': None,
 'year': 2019}
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875146%27 HTTP/1.1" 200 None
2026-01-27 20:02:42 [ayvens.es] INFO: Saving data for 1875146: {'created_time': 1769544162.750498, 'last_price_update_time': 1769544162.750511, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875146') HTTP/1.1" 204 0
2026-01-27 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b33bbe46-8da3-59bb-9ff4-1d6c852e461f with identifier: 1875145
2026-01-27 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b33bbe46-8da3-59bb-9ff4-1d6c852e461f with identifier: 1875145
2026-01-27 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'pintura', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'lynk & co', 'model': '1', 'trim': '1.5 phev 6.6kw', 'title': 'lynk & co 1 1.5 phev 6.6kw', 'price': 0, 'odometer': 26866, 'odometer_reading_unit': 'km', 'registration_date': '2024-05-24', 'year': 2024, 'fuel_type': 'hybrid', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 24, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'b33bbe46-8da3-59bb-9ff4-1d6c852e461f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33bbe46-8da3-59bb-9ff4-1d6c852e461f/b33bbe46-8da3-59bb-9ff4-1d6c852e461f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/224/efb29d67b49e4c829ed52f336558efcd/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 506246}], 'current_year_diff': 2, 'age_in_months': 20, 'make_model': 'lynk & co 1', 'sanitized_make': 'lynkco', 'odometer_in_km': 26866}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 20,
     'auction_title': '',
     'c_o_2_emission_value': 24,
     'color': 'pintura',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'hybrid',
     'id': 'b33bbe46-8da3-59bb-9ff4-1d6c852e461f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'lynk & co',
     'make_model': 'lynk & co 1',
     'model': '1',
     'odometer': 26866,
     'odometer_in_km': 26866,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33bbe46-8da3-59bb-9ff4-1d6c852e461f/b33bbe46-8da3-59bb-9ff4-1d6c852e461f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 506246,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/224/efb29d67b49e4c829ed52f336558efcd/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-05-24',
     'sanitized_make': 'lynkco',
     'seats_number': 5,
     'seller_name': None,
     'title': 'lynk & co 1 1.5 phev 6.6kw',
     'transmission': 'manual',
     'trim': '1.5 phev 6.6kw',
     'vin': None,
     'year': 2024}
2026-01-27 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: b33bbe46-8da3-59bb-9ff4-1d6c852e461f spider: ayvens.es
2026-01-27 20:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b33bbe46-8da3-59bb-9ff4-1d6c852e461f due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'pintura', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'lynk & co', 'model': '1', 'trim': '1.5 phev 6.6kw', 'title': 'lynk & co 1 1.5 phev 6.6kw', 'price': 0, 'odometer': 26866, 'odometer_reading_unit': 'km', 'registration_date': '2024-05-24', 'year': 2024, 'fuel_type': 'hybrid', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 24, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'b33bbe46-8da3-59bb-9ff4-1d6c852e461f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33bbe46-8da3-59bb-9ff4-1d6c852e461f/b33bbe46-8da3-59bb-9ff4-1d6c852e461f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/224/efb29d67b49e4c829ed52f336558efcd/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 506246}], 'current_year_diff': 2, 'age_in_months': 20, 'make_model': 'lynk & co 1', 'sanitized_make': 'lynkco', 'odometer_in_km': 26866}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 20,
     'auction_title': '',
     'c_o_2_emission_value': 24,
     'color': 'pintura',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'hybrid',
     'id': 'b33bbe46-8da3-59bb-9ff4-1d6c852e461f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'lynk & co',
     'make_model': 'lynk & co 1',
     'model': '1',
     'odometer': 26866,
     'odometer_in_km': 26866,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33bbe46-8da3-59bb-9ff4-1d6c852e461f/b33bbe46-8da3-59bb-9ff4-1d6c852e461f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 506246,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/224/efb29d67b49e4c829ed52f336558efcd/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-05-24',
     'sanitized_make': 'lynkco',
     'seats_number': 5,
     'seller_name': None,
     'title': 'lynk & co 1 1.5 phev 6.6kw',
     'transmission': 'manual',
     'trim': '1.5 phev 6.6kw',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b33bbe46-8da3-59bb-9ff4-1d6c852e461f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'LYNK & CO',
 'model': '1',
 'odometer': 26866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b33bbe46-8da3-59bb-9ff4-1d6c852e461f/b33bbe46-8da3-59bb-9ff4-1d6c852e461f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/224/efb29d67b49e4c829ed52f336558efcd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LYNK & CO 1 1.5 PHEV 6.6kW',
 'transmission': 'manual',
 'trim': '1.5 PHEV 6.6kW',
 'vin': None,
 'year': 2024}
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875145%27 HTTP/1.1" 200 None
2026-01-27 20:02:42 [ayvens.es] INFO: Saving data for 1875145: {'created_time': 1769544162.974533, 'last_price_update_time': 1769544162.974544, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875145') HTTP/1.1" 204 0
2026-01-27 20:02:43 [ayvens.es] INFO: Found listing with ID: 1875160
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875160%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [ayvens.es] INFO: Scrape type for 1875160: 1
2026-01-27 20:02:43 [ayvens.es] INFO: Extracting data for car ID: 1875160
2026-01-27 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8213b76e-338b-5e44-a32e-db957d58e74b with identifier: 1875160
2026-01-27 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8213b76e-338b-5e44-a32e-db957d58e74b with scrape type 1
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8213b76e-338b-5e44-a32e-db957d58e74b
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252F9a92e7ba291b4fb7b9a67b9e19e5650a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/9a92e7ba291b4fb7b9a67b9e19e5650a/images/large/1.jpg not downloaded yet
2026-01-27 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/744/20169adb77ab462a85f4e6229905b748/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:43 [ayvens.es] INFO: Found listing with ID: 1875161
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875161%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [ayvens.es] INFO: Scrape type for 1875161: 1
2026-01-27 20:02:43 [ayvens.es] INFO: Extracting data for car ID: 1875161
2026-01-27 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b93f005-6da8-5c0d-9c20-beb97b4844eb with identifier: 1875161
2026-01-27 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b93f005-6da8-5c0d-9c20-beb97b4844eb with scrape type 1
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6b93f005-6da8-5c0d-9c20-beb97b4844eb
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F158%252Ff1fd05750a7b46f69c88aca971c908ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/158/f1fd05750a7b46f69c88aca971c908ba/images/large/1.jpg not downloaded yet
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57238c550>
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a52b8b4d-67d2-5c2a-939d-824d1913795b/a52b8b4d-67d2-5c2a-939d-824d1913795b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F268%252Fc5461df920a4415390fae2bbd1464055%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/268/c5461df920a4415390fae2bbd1464055/images/large/1.jpg saved to cache
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a52b8b4d-67d2-5c2a-939d-824d1913795b
2026-01-27 20:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a52b8b4d-67d2-5c2a-939d-824d1913795b, skipping ID generation
2026-01-27 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52b8b4d-67d2-5c2a-939d-824d1913795b with scrape type 1
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a52b8b4d-67d2-5c2a-939d-824d1913795b from tracking dictionaries
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a52b8b4d-67d2-5c2a-939d-824d1913795b sending to next pipeline
2026-01-27 20:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a52b8b4d-67d2-5c2a-939d-824d1913795b, identifier: 1875148
2026-01-27 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/315/fa7039431cc54bab9b3a54d9fe2eb3fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a52b8b4d-67d2-5c2a-939d-824d1913795b with identifier: 1875148
2026-01-27 20:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a52b8b4d-67d2-5c2a-939d-824d1913795b with identifier: 1875148
2026-01-27 20:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-27 20:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a52b8b4d-67d2-5c2a-939d-824d1913795b spider: ayvens.es
2026-01-27 20:02:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: a52b8b4d-67d2-5c2a-939d-824d1913795b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a52b8b4d-67d2-5c2a-939d-824d1913795b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 66872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52b8b4d-67d2-5c2a-939d-824d1913795b/a52b8b4d-67d2-5c2a-939d-824d1913795b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/268/c5461df920a4415390fae2bbd1464055/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Life Edition One 1.5 Blue dCi 55kW(75CV)',
 'transmission': 'manual',
 'trim': 'Life Edition One 1.5 Blue dCi 55kW(75CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875148%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [ayvens.es] INFO: Saving data for 1875148: {'created_time': 1769544163.814605, 'last_price_update_time': 1769544163.814618, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875148') HTTP/1.1" 204 0
2026-01-27 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/987/5395744015d549428b8e9f4f08953692/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/706/d380b4ee780a427d96e0ccbadb104e8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:43 [ayvens.es] INFO: Found listing with ID: 1875162
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875162%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [ayvens.es] INFO: Scrape type for 1875162: 1
2026-01-27 20:02:43 [ayvens.es] INFO: Extracting data for car ID: 1875162
2026-01-27 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871c235e-551b-5c6c-96cd-b8647372e491 with identifier: 1875162
2026-01-27 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871c235e-551b-5c6c-96cd-b8647372e491 with scrape type 1
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 871c235e-551b-5c6c-96cd-b8647372e491
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F99d8e4b213e846c6bb702a80b747cbb3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/99d8e4b213e846c6bb702a80b747cbb3/images/large/1.jpg not downloaded yet
2026-01-27 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/16d66eb4603e4a7d89a53357847aaa3e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/060/23e523e8f1f64be5bfd28e1e9058db44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/436/8a0cd9ae938d4b50b39618b2cf6f5b22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:43 [ayvens.es] INFO: Found listing with ID: 1875163
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875163%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [ayvens.es] INFO: Scrape type for 1875163: 1
2026-01-27 20:02:43 [ayvens.es] INFO: Extracting data for car ID: 1875163
2026-01-27 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0d45407-0c91-5368-b044-3834f0862ad3 with identifier: 1875163
2026-01-27 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d45407-0c91-5368-b044-3834f0862ad3 with scrape type 1
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d0d45407-0c91-5368-b044-3834f0862ad3
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F718%252F439e040d2c1e4881b29d369956da3dd7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/718/439e040d2c1e4881b29d369956da3dd7/images/large/1.jpg not downloaded yet
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721a9110>
2026-01-27 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f5dae86-692f-58d3-89d4-0f4c702483a4/5f5dae86-692f-58d3-89d4-0f4c702483a4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F20169adb77ab462a85f4e6229905b748%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/20169adb77ab462a85f4e6229905b748/images/large/1.jpg saved to cache
2026-01-27 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f5dae86-692f-58d3-89d4-0f4c702483a4
2026-01-27 20:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f5dae86-692f-58d3-89d4-0f4c702483a4, skipping ID generation
2026-01-27 20:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f5dae86-692f-58d3-89d4-0f4c702483a4 with scrape type 1
2026-01-27 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5f5dae86-692f-58d3-89d4-0f4c702483a4 from tracking dictionaries
2026-01-27 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f5dae86-692f-58d3-89d4-0f4c702483a4 sending to next pipeline
2026-01-27 20:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5f5dae86-692f-58d3-89d4-0f4c702483a4, identifier: 1875149
2026-01-27 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57213ccd0>
2026-01-27 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617a028f-5edf-5432-9a5b-ff14adf249c4/617a028f-5edf-5432-9a5b-ff14adf249c4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F315%252Ffa7039431cc54bab9b3a54d9fe2eb3fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/315/fa7039431cc54bab9b3a54d9fe2eb3fb/images/large/1.jpg saved to cache
2026-01-27 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 617a028f-5edf-5432-9a5b-ff14adf249c4
2026-01-27 20:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 617a028f-5edf-5432-9a5b-ff14adf249c4, skipping ID generation
2026-01-27 20:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617a028f-5edf-5432-9a5b-ff14adf249c4 with scrape type 1
2026-01-27 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 617a028f-5edf-5432-9a5b-ff14adf249c4 from tracking dictionaries
2026-01-27 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 617a028f-5edf-5432-9a5b-ff14adf249c4 sending to next pipeline
2026-01-27 20:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 617a028f-5edf-5432-9a5b-ff14adf249c4, identifier: 1875150
2026-01-27 20:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5f5dae86-692f-58d3-89d4-0f4c702483a4 with identifier: 1875149
2026-01-27 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5f5dae86-692f-58d3-89d4-0f4c702483a4 with identifier: 1875149
2026-01-27 20:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5f5dae86-692f-58d3-89d4-0f4c702483a4 with identifier: 1875149 to the API
2026-01-27 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/744/20169adb77ab462a85f4e6229905b748/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f5dae86-692f-58d3-89d4-0f4c702483a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLS',
 'odometer': 119686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f5dae86-692f-58d3-89d4-0f4c702483a4/5f5dae86-692f-58d3-89d4-0f4c702483a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/744/20169adb77ab462a85f4e6229905b748/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLS CLS 300 d',
 'transmission': 'manual',
 'trim': 'CLS 300 d',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875149%27 HTTP/1.1" 200 None
2026-01-27 20:02:46 [ayvens.es] INFO: Saving data for 1875149: {'created_time': 1769544166.198954, 'last_price_update_time': 1769544166.198964, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875149') HTTP/1.1" 204 0
2026-01-27 20:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 617a028f-5edf-5432-9a5b-ff14adf249c4 with identifier: 1875150
2026-01-27 20:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 617a028f-5edf-5432-9a5b-ff14adf249c4 with identifier: 1875150
2026-01-27 20:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 617a028f-5edf-5432-9a5b-ff14adf249c4 with identifier: 1875150 to the API
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/315/fa7039431cc54bab9b3a54d9fe2eb3fb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '617a028f-5edf-5432-9a5b-ff14adf249c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'LEXUS',
 'model': 'NX',
 'odometer': 113602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617a028f-5edf-5432-9a5b-ff14adf249c4/617a028f-5edf-5432-9a5b-ff14adf249c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/315/fa7039431cc54bab9b3a54d9fe2eb3fb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LEXUS NX 2.5 300h Premium 2WD',
 'transmission': 'manual',
 'trim': '2.5 300h Premium 2WD',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875150%27 HTTP/1.1" 200 None
2026-01-27 20:02:46 [ayvens.es] INFO: Saving data for 1875150: {'created_time': 1769544166.684862, 'last_price_update_time': 1769544166.684874, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875150') HTTP/1.1" 204 0
2026-01-27 20:02:46 [ayvens.es] INFO: Found listing with ID: 1875164
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875164%27 HTTP/1.1" 200 None
2026-01-27 20:02:46 [ayvens.es] INFO: Scrape type for 1875164: 1
2026-01-27 20:02:46 [ayvens.es] INFO: Extracting data for car ID: 1875164
2026-01-27 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86988564-af79-5fff-bc02-00b3a4d81b99 with identifier: 1875164
2026-01-27 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86988564-af79-5fff-bc02-00b3a4d81b99 with scrape type 1
2026-01-27 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 86988564-af79-5fff-bc02-00b3a4d81b99
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252F040ff93dded44049ade86423ec24a580%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/040ff93dded44049ade86423ec24a580/images/large/1.jpg not downloaded yet
2026-01-27 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f6d010>
2026-01-27 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_603d77c2-e0c9-5059-99d3-f01f9ba2a86b/603d77c2-e0c9-5059-99d3-f01f9ba2a86b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F987%252F5395744015d549428b8e9f4f08953692%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/987/5395744015d549428b8e9f4f08953692/images/large/1.jpg saved to cache
2026-01-27 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 603d77c2-e0c9-5059-99d3-f01f9ba2a86b
2026-01-27 20:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 603d77c2-e0c9-5059-99d3-f01f9ba2a86b, skipping ID generation
2026-01-27 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603d77c2-e0c9-5059-99d3-f01f9ba2a86b with scrape type 1
2026-01-27 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 603d77c2-e0c9-5059-99d3-f01f9ba2a86b from tracking dictionaries
2026-01-27 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 603d77c2-e0c9-5059-99d3-f01f9ba2a86b sending to next pipeline
2026-01-27 20:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 603d77c2-e0c9-5059-99d3-f01f9ba2a86b, identifier: 1875154
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572369f50>
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2a1c7cb-21e2-5e8b-8101-e5108e196ab4/b2a1c7cb-21e2-5e8b-8101-e5108e196ab4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252Fd380b4ee780a427d96e0ccbadb104e8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/d380b4ee780a427d96e0ccbadb104e8b/images/large/1.jpg saved to cache
2026-01-27 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2a1c7cb-21e2-5e8b-8101-e5108e196ab4
2026-01-27 20:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2a1c7cb-21e2-5e8b-8101-e5108e196ab4, skipping ID generation
2026-01-27 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 with scrape type 1
2026-01-27 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 from tracking dictionaries
2026-01-27 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 sending to next pipeline
2026-01-27 20:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2a1c7cb-21e2-5e8b-8101-e5108e196ab4, identifier: 1875155
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57235d1d0>
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc43caf-0849-5612-a2be-7daf551f3ff1/4fc43caf-0849-5612-a2be-7daf551f3ff1_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F16d66eb4603e4a7d89a53357847aaa3e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/16d66eb4603e4a7d89a53357847aaa3e/images/large/1.jpg saved to cache
2026-01-27 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fc43caf-0849-5612-a2be-7daf551f3ff1
2026-01-27 20:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fc43caf-0849-5612-a2be-7daf551f3ff1, skipping ID generation
2026-01-27 20:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc43caf-0849-5612-a2be-7daf551f3ff1 with scrape type 1
2026-01-27 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4fc43caf-0849-5612-a2be-7daf551f3ff1 from tracking dictionaries
2026-01-27 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fc43caf-0849-5612-a2be-7daf551f3ff1 sending to next pipeline
2026-01-27 20:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4fc43caf-0849-5612-a2be-7daf551f3ff1, identifier: 1875151
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57093a790>
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c865025d-2382-50b9-a828-58211ca9cd9f/c865025d-2382-50b9-a828-58211ca9cd9f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F060%252F23e523e8f1f64be5bfd28e1e9058db44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/060/23e523e8f1f64be5bfd28e1e9058db44/images/large/1.jpg saved to cache
2026-01-27 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c865025d-2382-50b9-a828-58211ca9cd9f
2026-01-27 20:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c865025d-2382-50b9-a828-58211ca9cd9f, skipping ID generation
2026-01-27 20:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c865025d-2382-50b9-a828-58211ca9cd9f with scrape type 1
2026-01-27 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c865025d-2382-50b9-a828-58211ca9cd9f from tracking dictionaries
2026-01-27 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c865025d-2382-50b9-a828-58211ca9cd9f sending to next pipeline
2026-01-27 20:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c865025d-2382-50b9-a828-58211ca9cd9f, identifier: 1875152
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722f2150>
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_307e7000-ee7c-572f-a4dc-604dcda2d4dc/307e7000-ee7c-572f-a4dc-604dcda2d4dc_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F436%252F8a0cd9ae938d4b50b39618b2cf6f5b22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/436/8a0cd9ae938d4b50b39618b2cf6f5b22/images/large/1.jpg saved to cache
2026-01-27 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 307e7000-ee7c-572f-a4dc-604dcda2d4dc
2026-01-27 20:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 307e7000-ee7c-572f-a4dc-604dcda2d4dc, skipping ID generation
2026-01-27 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 307e7000-ee7c-572f-a4dc-604dcda2d4dc with scrape type 1
2026-01-27 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 307e7000-ee7c-572f-a4dc-604dcda2d4dc from tracking dictionaries
2026-01-27 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 307e7000-ee7c-572f-a4dc-604dcda2d4dc sending to next pipeline
2026-01-27 20:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 307e7000-ee7c-572f-a4dc-604dcda2d4dc, identifier: 1875153
2026-01-27 20:02:49 [ayvens.es] INFO: Found listing with ID: 1875165
2026-01-27 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875165%27 HTTP/1.1" 200 None
2026-01-27 20:02:49 [ayvens.es] INFO: Scrape type for 1875165: 1
2026-01-27 20:02:49 [ayvens.es] INFO: Extracting data for car ID: 1875165
2026-01-27 20:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8d89406-5e85-5969-ba47-65cb85ddbfef with identifier: 1875165
2026-01-27 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d89406-5e85-5969-ba47-65cb85ddbfef with scrape type 1
2026-01-27 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8d89406-5e85-5969-ba47-65cb85ddbfef
2026-01-27 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F836%252F289581518aa24f0c95958d194ae6393b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/836/289581518aa24f0c95958d194ae6393b/images/large/1.jpg not downloaded yet
2026-01-27 20:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 603d77c2-e0c9-5059-99d3-f01f9ba2a86b with identifier: 1875154
2026-01-27 20:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 603d77c2-e0c9-5059-99d3-f01f9ba2a86b with identifier: 1875154
2026-01-27 20:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 603d77c2-e0c9-5059-99d3-f01f9ba2a86b with identifier: 1875154 to the API
2026-01-27 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/987/5395744015d549428b8e9f4f08953692/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '603d77c2-e0c9-5059-99d3-f01f9ba2a86b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 143543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603d77c2-e0c9-5059-99d3-f01f9ba2a86b/603d77c2-e0c9-5059-99d3-f01f9ba2a86b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/987/5395744015d549428b8e9f4f08953692/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 110kW DSG Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 110kW DSG Style Go',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875154%27 HTTP/1.1" 200 None
2026-01-27 20:02:51 [ayvens.es] INFO: Saving data for 1875154: {'created_time': 1769544171.145793, 'last_price_update_time': 1769544171.145809, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875154') HTTP/1.1" 204 0
2026-01-27 20:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 with identifier: 1875155
2026-01-27 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 with identifier: 1875155
2026-01-27 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162710 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162710
2026-01-27 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 spider: ayvens.es
2026-01-27 20:02:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b2a1c7cb-21e2-5e8b-8101-e5108e196ab4 due to rule: high_mileage_for_country.json, error: 162710 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162710
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2a1c7cb-21e2-5e8b-8101-e5108e196ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 162710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2a1c7cb-21e2-5e8b-8101-e5108e196ab4/b2a1c7cb-21e2-5e8b-8101-e5108e196ab4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/706/d380b4ee780a427d96e0ccbadb104e8b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 180 d',
 'transmission': 'manual',
 'trim': 'A 180 d',
 'vin': None,
 'year': 2019}
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875155%27 HTTP/1.1" 200 None
2026-01-27 20:02:51 [ayvens.es] INFO: Saving data for 1875155: {'created_time': 1769544171.45062, 'last_price_update_time': 1769544171.450633, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875155') HTTP/1.1" 204 0
2026-01-27 20:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4fc43caf-0849-5612-a2be-7daf551f3ff1 with identifier: 1875151
2026-01-27 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4fc43caf-0849-5612-a2be-7daf551f3ff1 with identifier: 1875151
2026-01-27 20:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4fc43caf-0849-5612-a2be-7daf551f3ff1 with identifier: 1875151 to the API
2026-01-27 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/16d66eb4603e4a7d89a53357847aaa3e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4fc43caf-0849-5612-a2be-7daf551f3ff1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 115561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc43caf-0849-5612-a2be-7daf551f3ff1/4fc43caf-0849-5612-a2be-7daf551f3ff1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/16d66eb4603e4a7d89a53357847aaa3e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 225 e-EAT8 Allure',
 'transmission': 'manual',
 'trim': '225 e-EAT8 Allure',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875151%27 HTTP/1.1" 200 None
2026-01-27 20:02:52 [ayvens.es] INFO: Saving data for 1875151: {'created_time': 1769544172.280427, 'last_price_update_time': 1769544172.280441, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875151') HTTP/1.1" 204 0
2026-01-27 20:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c865025d-2382-50b9-a828-58211ca9cd9f with identifier: 1875152
2026-01-27 20:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c865025d-2382-50b9-a828-58211ca9cd9f with identifier: 1875152
2026-01-27 20:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c865025d-2382-50b9-a828-58211ca9cd9f with identifier: 1875152 to the API
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/060/23e523e8f1f64be5bfd28e1e9058db44/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c865025d-2382-50b9-a828-58211ca9cd9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB',
 'odometer': 123021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c865025d-2382-50b9-a828-58211ca9cd9f/c865025d-2382-50b9-a828-58211ca9cd9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/060/23e523e8f1f64be5bfd28e1e9058db44/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB 2.0 TDI 110kW (150CV) DSG Style',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG Style',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875152%27 HTTP/1.1" 200 None
2026-01-27 20:02:52 [ayvens.es] INFO: Saving data for 1875152: {'created_time': 1769544172.720721, 'last_price_update_time': 1769544172.720735, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875152') HTTP/1.1" 204 0
2026-01-27 20:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 307e7000-ee7c-572f-a4dc-604dcda2d4dc with identifier: 1875153
2026-01-27 20:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 307e7000-ee7c-572f-a4dc-604dcda2d4dc with identifier: 1875153
2026-01-27 20:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 307e7000-ee7c-572f-a4dc-604dcda2d4dc with identifier: 1875153 to the API
2026-01-27 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/436/8a0cd9ae938d4b50b39618b2cf6f5b22/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '307e7000-ee7c-572f-a4dc-604dcda2d4dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C5 AIRCROSS',
 'odometer': 143300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_307e7000-ee7c-572f-a4dc-604dcda2d4dc/307e7000-ee7c-572f-a4dc-604dcda2d4dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/436/8a0cd9ae938d4b50b39618b2cf6f5b22/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C5 AIRCROSS BlueHdi 96kW (130CV) S&S EAT8 Feel',
 'transmission': 'manual',
 'trim': 'BlueHdi 96kW (130CV) S&S EAT8 Feel',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875153%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [ayvens.es] INFO: Saving data for 1875153: {'created_time': 1769544173.261349, 'last_price_update_time': 1769544173.26136, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875153') HTTP/1.1" 204 0
2026-01-27 20:02:53 [ayvens.es] INFO: Found listing with ID: 1875166
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875166%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [ayvens.es] INFO: Scrape type for 1875166: 1
2026-01-27 20:02:53 [ayvens.es] INFO: Extracting data for car ID: 1875166
2026-01-27 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 106f92fe-0d7d-5a1d-af4b-ce55e8152160 with identifier: 1875166
2026-01-27 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106f92fe-0d7d-5a1d-af4b-ce55e8152160 with scrape type 1
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 106f92fe-0d7d-5a1d-af4b-ce55e8152160
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F975%252F361017af6f9641fdb93ec958777c75cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/975/361017af6f9641fdb93ec958777c75cb/images/large/1.jpg not downloaded yet
2026-01-27 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/857/c1b9e672b57a474385c032e8b192c97b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/850/e5256c32ea2147cba11438b7280fdb09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/200/ba6890f3282344528bfa8a591788a201/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/158/f1fd05750a7b46f69c88aca971c908ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:53 [ayvens.es] INFO: Found listing with ID: 1875167
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875167%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [ayvens.es] INFO: Scrape type for 1875167: 1
2026-01-27 20:02:53 [ayvens.es] INFO: Extracting data for car ID: 1875167
2026-01-27 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49eae6c5-7695-5d92-99c7-135e082f5c99 with identifier: 1875167
2026-01-27 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49eae6c5-7695-5d92-99c7-135e082f5c99 with scrape type 1
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49eae6c5-7695-5d92-99c7-135e082f5c99
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252Fd6b078ac4287431484fb311d4ad3d1c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/d6b078ac4287431484fb311d4ad3d1c9/images/large/1.jpg not downloaded yet
2026-01-27 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/292/8c6c1a13259b47849bf2f367be5faab4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/279/99d8e4b213e846c6bb702a80b747cbb3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:53 [ayvens.es] INFO: Found listing with ID: 1875168
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875168%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [ayvens.es] INFO: Scrape type for 1875168: 1
2026-01-27 20:02:53 [ayvens.es] INFO: Extracting data for car ID: 1875168
2026-01-27 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dbb8a22-489a-5b93-aa2e-e3237a5b865c with identifier: 1875168
2026-01-27 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dbb8a22-489a-5b93-aa2e-e3237a5b865c with scrape type 1
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1dbb8a22-489a-5b93-aa2e-e3237a5b865c
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F9990a9b14c104e3e9c44fd258c1dc88c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/9990a9b14c104e3e9c44fd258c1dc88c/images/large/1.jpg not downloaded yet
2026-01-27 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/538/9a92e7ba291b4fb7b9a67b9e19e5650a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:53 [ayvens.es] INFO: Found listing with ID: 1875169
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875169%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [ayvens.es] INFO: Scrape type for 1875169: 1
2026-01-27 20:02:53 [ayvens.es] INFO: Extracting data for car ID: 1875169
2026-01-27 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57585024-825d-57c0-b532-4f981bd38a45 with identifier: 1875169
2026-01-27 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57585024-825d-57c0-b532-4f981bd38a45 with scrape type 1
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 57585024-825d-57c0-b532-4f981bd38a45
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F343%252F1ebdfcb4c3324105ae0a6f52f9f03cff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/343/1ebdfcb4c3324105ae0a6f52f9f03cff/images/large/1.jpg not downloaded yet
2026-01-27 20:02:53 [ayvens.es] INFO: Found listing with ID: 1875170
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875170%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [ayvens.es] INFO: Scrape type for 1875170: 1
2026-01-27 20:02:53 [ayvens.es] INFO: Extracting data for car ID: 1875170
2026-01-27 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9 with identifier: 1875170
2026-01-27 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9 with scrape type 1
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252F3df169b373d742e795c0996c47e1f1cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/3df169b373d742e795c0996c47e1f1cb/images/large/1.jpg not downloaded yet
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724484d0>
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3094a5d5-cd59-5ef2-be72-e59428127b3d/3094a5d5-cd59-5ef2-be72-e59428127b3d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Fc1b9e672b57a474385c032e8b192c97b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/c1b9e672b57a474385c032e8b192c97b/images/large/1.jpg saved to cache
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3094a5d5-cd59-5ef2-be72-e59428127b3d
2026-01-27 20:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3094a5d5-cd59-5ef2-be72-e59428127b3d, skipping ID generation
2026-01-27 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3094a5d5-cd59-5ef2-be72-e59428127b3d with scrape type 1
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3094a5d5-cd59-5ef2-be72-e59428127b3d from tracking dictionaries
2026-01-27 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3094a5d5-cd59-5ef2-be72-e59428127b3d sending to next pipeline
2026-01-27 20:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3094a5d5-cd59-5ef2-be72-e59428127b3d, identifier: 1875158
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5723842d0>
2026-01-27 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_186ea547-e029-53bc-975e-0cd711e9b2c0/186ea547-e029-53bc-975e-0cd711e9b2c0_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F850%252Fe5256c32ea2147cba11438b7280fdb09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/850/e5256c32ea2147cba11438b7280fdb09/images/large/1.jpg saved to cache
2026-01-27 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 186ea547-e029-53bc-975e-0cd711e9b2c0
2026-01-27 20:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 186ea547-e029-53bc-975e-0cd711e9b2c0, skipping ID generation
2026-01-27 20:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186ea547-e029-53bc-975e-0cd711e9b2c0 with scrape type 1
2026-01-27 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 186ea547-e029-53bc-975e-0cd711e9b2c0 from tracking dictionaries
2026-01-27 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 186ea547-e029-53bc-975e-0cd711e9b2c0 sending to next pipeline
2026-01-27 20:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 186ea547-e029-53bc-975e-0cd711e9b2c0, identifier: 1875159
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570956990>
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_657ff108-bc29-590a-856d-b2b012db51ea/657ff108-bc29-590a-856d-b2b012db51ea_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F200%252Fba6890f3282344528bfa8a591788a201%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/200/ba6890f3282344528bfa8a591788a201/images/large/1.jpg saved to cache
2026-01-27 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 657ff108-bc29-590a-856d-b2b012db51ea
2026-01-27 20:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 657ff108-bc29-590a-856d-b2b012db51ea, skipping ID generation
2026-01-27 20:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657ff108-bc29-590a-856d-b2b012db51ea with scrape type 1
2026-01-27 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 657ff108-bc29-590a-856d-b2b012db51ea from tracking dictionaries
2026-01-27 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 657ff108-bc29-590a-856d-b2b012db51ea sending to next pipeline
2026-01-27 20:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 657ff108-bc29-590a-856d-b2b012db51ea, identifier: 1875156
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722053d0>
2026-01-27 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b93f005-6da8-5c0d-9c20-beb97b4844eb/6b93f005-6da8-5c0d-9c20-beb97b4844eb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F158%252Ff1fd05750a7b46f69c88aca971c908ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/158/f1fd05750a7b46f69c88aca971c908ba/images/large/1.jpg saved to cache
2026-01-27 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b93f005-6da8-5c0d-9c20-beb97b4844eb
2026-01-27 20:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b93f005-6da8-5c0d-9c20-beb97b4844eb, skipping ID generation
2026-01-27 20:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b93f005-6da8-5c0d-9c20-beb97b4844eb with scrape type 1
2026-01-27 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6b93f005-6da8-5c0d-9c20-beb97b4844eb from tracking dictionaries
2026-01-27 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b93f005-6da8-5c0d-9c20-beb97b4844eb sending to next pipeline
2026-01-27 20:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6b93f005-6da8-5c0d-9c20-beb97b4844eb, identifier: 1875161
2026-01-27 20:02:55 [ayvens.es] INFO: Found listing with ID: 1875171
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875171%27 HTTP/1.1" 200 None
2026-01-27 20:02:55 [ayvens.es] INFO: Scrape type for 1875171: 1
2026-01-27 20:02:55 [ayvens.es] INFO: Extracting data for car ID: 1875171
2026-01-27 20:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e72c08b2-66a8-5796-ad26-7d34d7a7afd4 with identifier: 1875171
2026-01-27 20:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e72c08b2-66a8-5796-ad26-7d34d7a7afd4 with scrape type 1
2026-01-27 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e72c08b2-66a8-5796-ad26-7d34d7a7afd4
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F441%252Fec7269ff3ead43a6ae642460fb132557%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/441/ec7269ff3ead43a6ae642460fb132557/images/large/1.jpg not downloaded yet
2026-01-27 20:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3094a5d5-cd59-5ef2-be72-e59428127b3d with identifier: 1875158
2026-01-27 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3094a5d5-cd59-5ef2-be72-e59428127b3d with identifier: 1875158
2026-01-27 20:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3094a5d5-cd59-5ef2-be72-e59428127b3d with identifier: 1875158 to the API
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/857/c1b9e672b57a474385c032e8b192c97b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3094a5d5-cd59-5ef2-be72-e59428127b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 85580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3094a5d5-cd59-5ef2-be72-e59428127b3d/3094a5d5-cd59-5ef2-be72-e59428127b3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/857/c1b9e672b57a474385c032e8b192c97b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.5D DT 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.5D DT 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875158%27 HTTP/1.1" 200 None
2026-01-27 20:02:55 [ayvens.es] INFO: Saving data for 1875158: {'created_time': 1769544175.793837, 'last_price_update_time': 1769544175.79385, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875158') HTTP/1.1" 204 0
2026-01-27 20:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 186ea547-e029-53bc-975e-0cd711e9b2c0 with identifier: 1875159
2026-01-27 20:02:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 186ea547-e029-53bc-975e-0cd711e9b2c0 with identifier: 1875159
2026-01-27 20:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 186ea547-e029-53bc-975e-0cd711e9b2c0 with identifier: 1875159 to the API
2026-01-27 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/850/e5256c32ea2147cba11438b7280fdb09/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Cris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '186ea547-e029-53bc-975e-0cd711e9b2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'JEEP',
 'model': 'COMPASS',
 'odometer': 92284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_186ea547-e029-53bc-975e-0cd711e9b2c0/186ea547-e029-53bc-975e-0cd711e9b2c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/850/e5256c32ea2147cba11438b7280fdb09/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JEEP COMPASS 4Xe 1.3 PHEV 177kW (240CV) S AT AWD',
 'transmission': 'manual',
 'trim': '4Xe 1.3 PHEV 177kW (240CV) S AT AWD',
 'vin': None,
 'year': 2022}
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875159%27 HTTP/1.1" 200 None
2026-01-27 20:02:56 [ayvens.es] INFO: Saving data for 1875159: {'created_time': 1769544176.323868, 'last_price_update_time': 1769544176.323881, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875159') HTTP/1.1" 204 0
2026-01-27 20:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 657ff108-bc29-590a-856d-b2b012db51ea with identifier: 1875156
2026-01-27 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 657ff108-bc29-590a-856d-b2b012db51ea with identifier: 1875156
2026-01-27 20:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 657ff108-bc29-590a-856d-b2b012db51ea with identifier: 1875156 to the API
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/200/ba6890f3282344528bfa8a591788a201/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '657ff108-bc29-590a-856d-b2b012db51ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 97231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_657ff108-bc29-590a-856d-b2b012db51ea/657ff108-bc29-590a-856d-b2b012db51ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/200/ba6890f3282344528bfa8a591788a201/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Business',
 'transmission': 'manual',
 'trim': '2.5l 220H Business',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875156%27 HTTP/1.1" 200 None
2026-01-27 20:02:56 [ayvens.es] INFO: Saving data for 1875156: {'created_time': 1769544176.763729, 'last_price_update_time': 1769544176.763758, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875156') HTTP/1.1" 204 0
2026-01-27 20:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6b93f005-6da8-5c0d-9c20-beb97b4844eb with identifier: 1875161
2026-01-27 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6b93f005-6da8-5c0d-9c20-beb97b4844eb with identifier: 1875161
2026-01-27 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2026-01-27 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 6b93f005-6da8-5c0d-9c20-beb97b4844eb spider: ayvens.es
2026-01-27 20:02:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6b93f005-6da8-5c0d-9c20-beb97b4844eb due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6b93f005-6da8-5c0d-9c20-beb97b4844eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 141538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b93f005-6da8-5c0d-9c20-beb97b4844eb/6b93f005-6da8-5c0d-9c20-beb97b4844eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/158/f1fd05750a7b46f69c88aca971c908ba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 75',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 75',
 'vin': None,
 'year': 2016}
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875161%27 HTTP/1.1" 200 None
2026-01-27 20:02:57 [ayvens.es] INFO: Saving data for 1875161: {'created_time': 1769544177.031702, 'last_price_update_time': 1769544177.031717, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875161') HTTP/1.1" 204 0
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f4a5d0>
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4445b43-4842-59c8-8bc9-5c4e7eb96434/b4445b43-4842-59c8-8bc9-5c4e7eb96434_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F292%252F8c6c1a13259b47849bf2f367be5faab4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/292/8c6c1a13259b47849bf2f367be5faab4/images/large/1.jpg saved to cache
2026-01-27 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4445b43-4842-59c8-8bc9-5c4e7eb96434
2026-01-27 20:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4445b43-4842-59c8-8bc9-5c4e7eb96434, skipping ID generation
2026-01-27 20:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4445b43-4842-59c8-8bc9-5c4e7eb96434 with scrape type 1
2026-01-27 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b4445b43-4842-59c8-8bc9-5c4e7eb96434 from tracking dictionaries
2026-01-27 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4445b43-4842-59c8-8bc9-5c4e7eb96434 sending to next pipeline
2026-01-27 20:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4445b43-4842-59c8-8bc9-5c4e7eb96434, identifier: 1875157
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570945050>
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871c235e-551b-5c6c-96cd-b8647372e491/871c235e-551b-5c6c-96cd-b8647372e491_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F99d8e4b213e846c6bb702a80b747cbb3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/99d8e4b213e846c6bb702a80b747cbb3/images/large/1.jpg saved to cache
2026-01-27 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 871c235e-551b-5c6c-96cd-b8647372e491
2026-01-27 20:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 871c235e-551b-5c6c-96cd-b8647372e491, skipping ID generation
2026-01-27 20:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871c235e-551b-5c6c-96cd-b8647372e491 with scrape type 1
2026-01-27 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 871c235e-551b-5c6c-96cd-b8647372e491 from tracking dictionaries
2026-01-27 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 871c235e-551b-5c6c-96cd-b8647372e491 sending to next pipeline
2026-01-27 20:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 871c235e-551b-5c6c-96cd-b8647372e491, identifier: 1875162
2026-01-27 20:02:58 [ayvens.es] INFO: Found listing with ID: 1875172
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875172%27 HTTP/1.1" 200 None
2026-01-27 20:02:58 [ayvens.es] INFO: Scrape type for 1875172: 1
2026-01-27 20:02:58 [ayvens.es] INFO: Extracting data for car ID: 1875172
2026-01-27 20:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3 with identifier: 1875172
2026-01-27 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3 with scrape type 1
2026-01-27 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F515%252F4ea696400e3343009b4b6acc8da3fbfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/515/4ea696400e3343009b4b6acc8da3fbfe/images/large/1.jpg not downloaded yet
2026-01-27 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4445b43-4842-59c8-8bc9-5c4e7eb96434 with identifier: 1875157
2026-01-27 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4445b43-4842-59c8-8bc9-5c4e7eb96434 with identifier: 1875157
2026-01-27 20:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b4445b43-4842-59c8-8bc9-5c4e7eb96434 with identifier: 1875157 to the API
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/292/8c6c1a13259b47849bf2f367be5faab4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b4445b43-4842-59c8-8bc9-5c4e7eb96434',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 30396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4445b43-4842-59c8-8bc9-5c4e7eb96434/b4445b43-4842-59c8-8bc9-5c4e7eb96434_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/292/8c6c1a13259b47849bf2f367be5faab4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S Allure Pack EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S Allure Pack EAT8',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875157%27 HTTP/1.1" 200 None
2026-01-27 20:02:58 [ayvens.es] INFO: Saving data for 1875157: {'created_time': 1769544178.502566, 'last_price_update_time': 1769544178.50258, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875157') HTTP/1.1" 204 0
2026-01-27 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 871c235e-551b-5c6c-96cd-b8647372e491 with identifier: 1875162
2026-01-27 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 871c235e-551b-5c6c-96cd-b8647372e491 with identifier: 1875162
2026-01-27 20:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 871c235e-551b-5c6c-96cd-b8647372e491 with identifier: 1875162 to the API
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/279/99d8e4b213e846c6bb702a80b747cbb3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '871c235e-551b-5c6c-96cd-b8647372e491',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 149842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871c235e-551b-5c6c-96cd-b8647372e491/871c235e-551b-5c6c-96cd-b8647372e491_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/279/99d8e4b213e846c6bb702a80b747cbb3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 90kW (122CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 90kW (122CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875162%27 HTTP/1.1" 200 None
2026-01-27 20:02:58 [ayvens.es] INFO: Saving data for 1875162: {'created_time': 1769544178.98495, 'last_price_update_time': 1769544178.984964, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875162') HTTP/1.1" 204 0
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5723400d0>
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8213b76e-338b-5e44-a32e-db957d58e74b/8213b76e-338b-5e44-a32e-db957d58e74b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252F9a92e7ba291b4fb7b9a67b9e19e5650a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/9a92e7ba291b4fb7b9a67b9e19e5650a/images/large/1.jpg saved to cache
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8213b76e-338b-5e44-a32e-db957d58e74b
2026-01-27 20:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8213b76e-338b-5e44-a32e-db957d58e74b, skipping ID generation
2026-01-27 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8213b76e-338b-5e44-a32e-db957d58e74b with scrape type 1
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8213b76e-338b-5e44-a32e-db957d58e74b from tracking dictionaries
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8213b76e-338b-5e44-a32e-db957d58e74b sending to next pipeline
2026-01-27 20:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8213b76e-338b-5e44-a32e-db957d58e74b, identifier: 1875160
2026-01-27 20:02:59 [ayvens.es] INFO: Found listing with ID: 1875173
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875173%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [ayvens.es] INFO: Scrape type for 1875173: 1
2026-01-27 20:02:59 [ayvens.es] INFO: Extracting data for car ID: 1875173
2026-01-27 20:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82f6e858-914e-597c-90e9-b63072abd40f with identifier: 1875173
2026-01-27 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82f6e858-914e-597c-90e9-b63072abd40f with scrape type 1
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 82f6e858-914e-597c-90e9-b63072abd40f
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252F98b058ca42e545c78393c7295f5a482f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/98b058ca42e545c78393c7295f5a482f/images/large/1.jpg not downloaded yet
2026-01-27 20:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8213b76e-338b-5e44-a32e-db957d58e74b with identifier: 1875160
2026-01-27 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8213b76e-338b-5e44-a32e-db957d58e74b with identifier: 1875160
2026-01-27 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-27 20:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8213b76e-338b-5e44-a32e-db957d58e74b spider: ayvens.es
2026-01-27 20:02:59 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 8213b76e-338b-5e44-a32e-db957d58e74b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8213b76e-338b-5e44-a32e-db957d58e74b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 97329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213b76e-338b-5e44-a32e-db957d58e74b/8213b76e-338b-5e44-a32e-db957d58e74b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/538/9a92e7ba291b4fb7b9a67b9e19e5650a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) S/S Expression L',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) S/S Expression L',
 'vin': None,
 'year': 2020}
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875160%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [ayvens.es] INFO: Saving data for 1875160: {'created_time': 1769544179.75164, 'last_price_update_time': 1769544179.751653, 'auction_closing_time': 1769601600.0}
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875160') HTTP/1.1" 204 0
2026-01-27 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/744/9990a9b14c104e3e9c44fd258c1dc88c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/718/439e040d2c1e4881b29d369956da3dd7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/975/361017af6f9641fdb93ec958777c75cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/766/d6b078ac4287431484fb311d4ad3d1c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:59 [ayvens.es] INFO: Found listing with ID: 1875174
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875174%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [ayvens.es] INFO: Scrape type for 1875174: 1
2026-01-27 20:02:59 [ayvens.es] INFO: Extracting data for car ID: 1875174
2026-01-27 20:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6b8a6eb-19f9-539f-921c-b8fecd592ecb with identifier: 1875174
2026-01-27 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6b8a6eb-19f9-539f-921c-b8fecd592ecb with scrape type 1
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6b8a6eb-19f9-539f-921c-b8fecd592ecb
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F779%252Fcb23bba451c24c78b6085325266b83d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/779/cb23bba451c24c78b6085325266b83d9/images/large/1.jpg not downloaded yet
2026-01-27 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/836/289581518aa24f0c95958d194ae6393b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:59 [ayvens.es] INFO: Found listing with ID: 1875175
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875175%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [ayvens.es] INFO: Scrape type for 1875175: 1
2026-01-27 20:02:59 [ayvens.es] INFO: Extracting data for car ID: 1875175
2026-01-27 20:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c123f89-8e1b-5681-946a-9a8a3595b458 with identifier: 1875175
2026-01-27 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c123f89-8e1b-5681-946a-9a8a3595b458 with scrape type 1
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c123f89-8e1b-5681-946a-9a8a3595b458
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F611%252F2b36b229187f4ec592ff337a65c331ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/611/2b36b229187f4ec592ff337a65c331ca/images/large/1.jpg not downloaded yet
2026-01-27 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/148/040ff93dded44049ade86423ec24a580/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/343/1ebdfcb4c3324105ae0a6f52f9f03cff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:59 [ayvens.es] INFO: Found listing with ID: 1875176
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875176%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [ayvens.es] INFO: Scrape type for 1875176: 1
2026-01-27 20:02:59 [ayvens.es] INFO: Extracting data for car ID: 1875176
2026-01-27 20:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daadf62b-8461-54d4-a0b5-f6568a02cc7a with identifier: 1875176
2026-01-27 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daadf62b-8461-54d4-a0b5-f6568a02cc7a with scrape type 1
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item daadf62b-8461-54d4-a0b5-f6568a02cc7a
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F278%252Fd225a44fc80a4ed697c1daf1927ff3ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/278/d225a44fc80a4ed697c1daf1927ff3ad/images/large/1.jpg not downloaded yet
2026-01-27 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/736/3df169b373d742e795c0996c47e1f1cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:02:59 [ayvens.es] INFO: Found listing with ID: 1875177
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875177%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [ayvens.es] INFO: Scrape type for 1875177: 1
2026-01-27 20:02:59 [ayvens.es] INFO: Extracting data for car ID: 1875177
2026-01-27 20:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d834356-9473-5345-97e9-336b0a46b8d3 with identifier: 1875177
2026-01-27 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d834356-9473-5345-97e9-336b0a46b8d3 with scrape type 1
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d834356-9473-5345-97e9-336b0a46b8d3
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F215%252Ff48147acf71f4818acc6d414d9087a6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/215/f48147acf71f4818acc6d414d9087a6d/images/large/1.jpg not downloaded yet
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571babc10>
2026-01-27 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbb8a22-489a-5b93-aa2e-e3237a5b865c/1dbb8a22-489a-5b93-aa2e-e3237a5b865c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F9990a9b14c104e3e9c44fd258c1dc88c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/9990a9b14c104e3e9c44fd258c1dc88c/images/large/1.jpg saved to cache
2026-01-27 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dbb8a22-489a-5b93-aa2e-e3237a5b865c
2026-01-27 20:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dbb8a22-489a-5b93-aa2e-e3237a5b865c, skipping ID generation
2026-01-27 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dbb8a22-489a-5b93-aa2e-e3237a5b865c with scrape type 1
2026-01-27 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1dbb8a22-489a-5b93-aa2e-e3237a5b865c from tracking dictionaries
2026-01-27 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dbb8a22-489a-5b93-aa2e-e3237a5b865c sending to next pipeline
2026-01-27 20:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1dbb8a22-489a-5b93-aa2e-e3237a5b865c, identifier: 1875168
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b5ffd0>
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d45407-0c91-5368-b044-3834f0862ad3/d0d45407-0c91-5368-b044-3834f0862ad3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F718%252F439e040d2c1e4881b29d369956da3dd7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/718/439e040d2c1e4881b29d369956da3dd7/images/large/1.jpg saved to cache
2026-01-27 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0d45407-0c91-5368-b044-3834f0862ad3
2026-01-27 20:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0d45407-0c91-5368-b044-3834f0862ad3, skipping ID generation
2026-01-27 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d45407-0c91-5368-b044-3834f0862ad3 with scrape type 1
2026-01-27 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d0d45407-0c91-5368-b044-3834f0862ad3 from tracking dictionaries
2026-01-27 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0d45407-0c91-5368-b044-3834f0862ad3 sending to next pipeline
2026-01-27 20:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d0d45407-0c91-5368-b044-3834f0862ad3, identifier: 1875163
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57231e110>
2026-01-27 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_106f92fe-0d7d-5a1d-af4b-ce55e8152160/106f92fe-0d7d-5a1d-af4b-ce55e8152160_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F975%252F361017af6f9641fdb93ec958777c75cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/975/361017af6f9641fdb93ec958777c75cb/images/large/1.jpg saved to cache
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 106f92fe-0d7d-5a1d-af4b-ce55e8152160
2026-01-27 20:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 106f92fe-0d7d-5a1d-af4b-ce55e8152160, skipping ID generation
2026-01-27 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106f92fe-0d7d-5a1d-af4b-ce55e8152160 with scrape type 1
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 106f92fe-0d7d-5a1d-af4b-ce55e8152160 from tracking dictionaries
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 106f92fe-0d7d-5a1d-af4b-ce55e8152160 sending to next pipeline
2026-01-27 20:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 106f92fe-0d7d-5a1d-af4b-ce55e8152160, identifier: 1875166
2026-01-27 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572377c10>
2026-01-27 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49eae6c5-7695-5d92-99c7-135e082f5c99/49eae6c5-7695-5d92-99c7-135e082f5c99_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252Fd6b078ac4287431484fb311d4ad3d1c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/d6b078ac4287431484fb311d4ad3d1c9/images/large/1.jpg saved to cache
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49eae6c5-7695-5d92-99c7-135e082f5c99
2026-01-27 20:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49eae6c5-7695-5d92-99c7-135e082f5c99, skipping ID generation
2026-01-27 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49eae6c5-7695-5d92-99c7-135e082f5c99 with scrape type 1
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 49eae6c5-7695-5d92-99c7-135e082f5c99 from tracking dictionaries
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49eae6c5-7695-5d92-99c7-135e082f5c99 sending to next pipeline
2026-01-27 20:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49eae6c5-7695-5d92-99c7-135e082f5c99, identifier: 1875167
2026-01-27 20:03:01 [ayvens.es] INFO: Found listing with ID: 1875178
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875178%27 HTTP/1.1" 200 None
2026-01-27 20:03:01 [ayvens.es] INFO: Scrape type for 1875178: 1
2026-01-27 20:03:01 [ayvens.es] INFO: Extracting data for car ID: 1875178
2026-01-27 20:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeff07d3-613b-5a24-87f7-dfc10c92cc92 with identifier: 1875178
2026-01-27 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeff07d3-613b-5a24-87f7-dfc10c92cc92 with scrape type 1
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aeff07d3-613b-5a24-87f7-dfc10c92cc92
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252F10088a814d7c47f7995cc05066fa0e4a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/10088a814d7c47f7995cc05066fa0e4a/images/large/1.jpg not downloaded yet
2026-01-27 20:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1dbb8a22-489a-5b93-aa2e-e3237a5b865c with identifier: 1875168
2026-01-27 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1dbb8a22-489a-5b93-aa2e-e3237a5b865c with identifier: 1875168
2026-01-27 20:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1dbb8a22-489a-5b93-aa2e-e3237a5b865c with identifier: 1875168 to the API
2026-01-27 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/744/9990a9b14c104e3e9c44fd258c1dc88c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1dbb8a22-489a-5b93-aa2e-e3237a5b865c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 121325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbb8a22-489a-5b93-aa2e-e3237a5b865c/1dbb8a22-489a-5b93-aa2e-e3237a5b865c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/744/9990a9b14c104e3e9c44fd258c1dc88c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875168%27 HTTP/1.1" 200 None
2026-01-27 20:03:02 [ayvens.es] INFO: Saving data for 1875168: {'created_time': 1769544182.200948, 'last_price_update_time': 1769544182.200961, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875168') HTTP/1.1" 204 0
2026-01-27 20:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d0d45407-0c91-5368-b044-3834f0862ad3 with identifier: 1875163
2026-01-27 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d0d45407-0c91-5368-b044-3834f0862ad3 with identifier: 1875163
2026-01-27 20:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d0d45407-0c91-5368-b044-3834f0862ad3 with identifier: 1875163 to the API
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/718/439e040d2c1e4881b29d369956da3dd7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd0d45407-0c91-5368-b044-3834f0862ad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 83038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d45407-0c91-5368-b044-3834f0862ad3/d0d45407-0c91-5368-b044-3834f0862ad3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/718/439e040d2c1e4881b29d369956da3dd7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 2.0 TDI 110kW DSG-7 S&S Xcellence',
 'transmission': 'manual',
 'trim': 'ST 2.0 TDI 110kW DSG-7 S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875163%27 HTTP/1.1" 200 None
2026-01-27 20:03:02 [ayvens.es] INFO: Saving data for 1875163: {'created_time': 1769544182.781587, 'last_price_update_time': 1769544182.781599, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875163') HTTP/1.1" 204 0
2026-01-27 20:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 106f92fe-0d7d-5a1d-af4b-ce55e8152160 with identifier: 1875166
2026-01-27 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 106f92fe-0d7d-5a1d-af4b-ce55e8152160 with identifier: 1875166
2026-01-27 20:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 106f92fe-0d7d-5a1d-af4b-ce55e8152160 with identifier: 1875166 to the API
2026-01-27 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/975/361017af6f9641fdb93ec958777c75cb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '106f92fe-0d7d-5a1d-af4b-ce55e8152160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 78629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_106f92fe-0d7d-5a1d-af4b-ce55e8152160/106f92fe-0d7d-5a1d-af4b-ce55e8152160_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/975/361017af6f9641fdb93ec958777c75cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875166%27 HTTP/1.1" 200 None
2026-01-27 20:03:03 [ayvens.es] INFO: Saving data for 1875166: {'created_time': 1769544183.193311, 'last_price_update_time': 1769544183.193326, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875166') HTTP/1.1" 204 0
2026-01-27 20:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49eae6c5-7695-5d92-99c7-135e082f5c99 with identifier: 1875167
2026-01-27 20:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49eae6c5-7695-5d92-99c7-135e082f5c99 with identifier: 1875167
2026-01-27 20:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49eae6c5-7695-5d92-99c7-135e082f5c99 with identifier: 1875167 to the API
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/766/d6b078ac4287431484fb311d4ad3d1c9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '49eae6c5-7695-5d92-99c7-135e082f5c99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 128924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49eae6c5-7695-5d92-99c7-135e082f5c99/49eae6c5-7695-5d92-99c7-135e082f5c99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/766/d6b078ac4287431484fb311d4ad3d1c9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875167%27 HTTP/1.1" 200 None
2026-01-27 20:03:03 [ayvens.es] INFO: Saving data for 1875167: {'created_time': 1769544183.628047, 'last_price_update_time': 1769544183.628065, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875167') HTTP/1.1" 204 0
2026-01-27 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57231cb50>
2026-01-27 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8d89406-5e85-5969-ba47-65cb85ddbfef/b8d89406-5e85-5969-ba47-65cb85ddbfef_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F836%252F289581518aa24f0c95958d194ae6393b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/836/289581518aa24f0c95958d194ae6393b/images/large/1.jpg saved to cache
2026-01-27 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8d89406-5e85-5969-ba47-65cb85ddbfef
2026-01-27 20:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8d89406-5e85-5969-ba47-65cb85ddbfef, skipping ID generation
2026-01-27 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d89406-5e85-5969-ba47-65cb85ddbfef with scrape type 1
2026-01-27 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b8d89406-5e85-5969-ba47-65cb85ddbfef from tracking dictionaries
2026-01-27 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8d89406-5e85-5969-ba47-65cb85ddbfef sending to next pipeline
2026-01-27 20:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b8d89406-5e85-5969-ba47-65cb85ddbfef, identifier: 1875165
2026-01-27 20:03:04 [ayvens.es] INFO: Found listing with ID: 1875179
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875179%27 HTTP/1.1" 200 None
2026-01-27 20:03:04 [ayvens.es] INFO: Scrape type for 1875179: 1
2026-01-27 20:03:04 [ayvens.es] INFO: Extracting data for car ID: 1875179
2026-01-27 20:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b with identifier: 1875179
2026-01-27 20:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b with scrape type 1
2026-01-27 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F517c5e546b2c4c8c939a17210dc83af0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/517c5e546b2c4c8c939a17210dc83af0/images/large/1.jpg not downloaded yet
2026-01-27 20:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b8d89406-5e85-5969-ba47-65cb85ddbfef with identifier: 1875165
2026-01-27 20:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b8d89406-5e85-5969-ba47-65cb85ddbfef with identifier: 1875165
2026-01-27 20:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b8d89406-5e85-5969-ba47-65cb85ddbfef with identifier: 1875165 to the API
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/836/289581518aa24f0c95958d194ae6393b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b8d89406-5e85-5969-ba47-65cb85ddbfef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 76380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8d89406-5e85-5969-ba47-65cb85ddbfef/b8d89406-5e85-5969-ba47-65cb85ddbfef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/836/289581518aa24f0c95958d194ae6393b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 300 e-EAT8 GT',
 'transmission': 'manual',
 'trim': '300 e-EAT8 GT',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875165%27 HTTP/1.1" 200 None
2026-01-27 20:03:04 [ayvens.es] INFO: Saving data for 1875165: {'created_time': 1769544184.549795, 'last_price_update_time': 1769544184.549809, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875165') HTTP/1.1" 204 0
2026-01-27 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57227be10>
2026-01-27 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86988564-af79-5fff-bc02-00b3a4d81b99/86988564-af79-5fff-bc02-00b3a4d81b99_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252F040ff93dded44049ade86423ec24a580%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/040ff93dded44049ade86423ec24a580/images/large/1.jpg saved to cache
2026-01-27 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86988564-af79-5fff-bc02-00b3a4d81b99
2026-01-27 20:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86988564-af79-5fff-bc02-00b3a4d81b99, skipping ID generation
2026-01-27 20:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86988564-af79-5fff-bc02-00b3a4d81b99 with scrape type 1
2026-01-27 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 86988564-af79-5fff-bc02-00b3a4d81b99 from tracking dictionaries
2026-01-27 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86988564-af79-5fff-bc02-00b3a4d81b99 sending to next pipeline
2026-01-27 20:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 86988564-af79-5fff-bc02-00b3a4d81b99, identifier: 1875164
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721ba8d0>
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57585024-825d-57c0-b532-4f981bd38a45/57585024-825d-57c0-b532-4f981bd38a45_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F343%252F1ebdfcb4c3324105ae0a6f52f9f03cff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/343/1ebdfcb4c3324105ae0a6f52f9f03cff/images/large/1.jpg saved to cache
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57585024-825d-57c0-b532-4f981bd38a45
2026-01-27 20:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57585024-825d-57c0-b532-4f981bd38a45, skipping ID generation
2026-01-27 20:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57585024-825d-57c0-b532-4f981bd38a45 with scrape type 1
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 57585024-825d-57c0-b532-4f981bd38a45 from tracking dictionaries
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57585024-825d-57c0-b532-4f981bd38a45 sending to next pipeline
2026-01-27 20:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 57585024-825d-57c0-b532-4f981bd38a45, identifier: 1875169
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a18550>
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9/77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252F3df169b373d742e795c0996c47e1f1cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/3df169b373d742e795c0996c47e1f1cb/images/large/1.jpg saved to cache
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9
2026-01-27 20:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9, skipping ID generation
2026-01-27 20:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9 with scrape type 1
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9 from tracking dictionaries
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9 sending to next pipeline
2026-01-27 20:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9, identifier: 1875170
2026-01-27 20:03:05 [ayvens.es] INFO: Found listing with ID: 1875180
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875180%27 HTTP/1.1" 200 None
2026-01-27 20:03:05 [ayvens.es] INFO: Scrape type for 1875180: 1
2026-01-27 20:03:05 [ayvens.es] INFO: Extracting data for car ID: 1875180
2026-01-27 20:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62450889-fac9-599c-8142-c9afc7492ef2 with identifier: 1875180
2026-01-27 20:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62450889-fac9-599c-8142-c9afc7492ef2 with scrape type 1
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62450889-fac9-599c-8142-c9afc7492ef2
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F4bb5c3e8f6eb414d9e269803144532e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/4bb5c3e8f6eb414d9e269803144532e3/images/large/1.jpg not downloaded yet
2026-01-27 20:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 86988564-af79-5fff-bc02-00b3a4d81b99 with identifier: 1875164
2026-01-27 20:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 86988564-af79-5fff-bc02-00b3a4d81b99 with identifier: 1875164
2026-01-27 20:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187563 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187563
2026-01-27 20:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 86988564-af79-5fff-bc02-00b3a4d81b99 spider: ayvens.es
2026-01-27 20:03:06 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 86988564-af79-5fff-bc02-00b3a4d81b99 due to rule: high_mileage_for_country.json, error: 187563 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187563
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '86988564-af79-5fff-bc02-00b3a4d81b99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 187563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86988564-af79-5fff-bc02-00b3a4d81b99/86988564-af79-5fff-bc02-00b3a4d81b99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/040ff93dded44049ade86423ec24a580/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style Go',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875164%27 HTTP/1.1" 200 None
2026-01-27 20:03:06 [ayvens.es] INFO: Saving data for 1875164: {'created_time': 1769544186.099765, 'last_price_update_time': 1769544186.099778, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875164') HTTP/1.1" 204 0
2026-01-27 20:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 57585024-825d-57c0-b532-4f981bd38a45 with identifier: 1875169
2026-01-27 20:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 57585024-825d-57c0-b532-4f981bd38a45 with identifier: 1875169
2026-01-27 20:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 57585024-825d-57c0-b532-4f981bd38a45 with identifier: 1875169 to the API
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/343/1ebdfcb4c3324105ae0a6f52f9f03cff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '57585024-825d-57c0-b532-4f981bd38a45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'JEEP',
 'model': 'RENEGADE',
 'odometer': 138129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57585024-825d-57c0-b532-4f981bd38a45/57585024-825d-57c0-b532-4f981bd38a45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/343/1ebdfcb4c3324105ae0a6f52f9f03cff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JEEP RENEGADE 2.0 Mjet Trailhawk 4x4 125kW Auto AD Low',
 'transmission': 'manual',
 'trim': '2.0 Mjet Trailhawk 4x4 125kW Auto AD Low',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875169%27 HTTP/1.1" 200 None
2026-01-27 20:03:06 [ayvens.es] INFO: Saving data for 1875169: {'created_time': 1769544186.58322, 'last_price_update_time': 1769544186.583234, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875169') HTTP/1.1" 204 0
2026-01-27 20:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9 with identifier: 1875170
2026-01-27 20:03:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9 with identifier: 1875170
2026-01-27 20:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9 with identifier: 1875170 to the API
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/736/3df169b373d742e795c0996c47e1f1cb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Nightshade',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 68444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9/77ee3bf1-a0cf-5d89-aedd-b147ae8bb6c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/736/3df169b373d742e795c0996c47e1f1cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875170%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [ayvens.es] INFO: Saving data for 1875170: {'created_time': 1769544187.049078, 'last_price_update_time': 1769544187.049092, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875170') HTTP/1.1" 204 0
2026-01-27 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/611/2b36b229187f4ec592ff337a65c331ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/441/ec7269ff3ead43a6ae642460fb132557/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/515/4ea696400e3343009b4b6acc8da3fbfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/779/cb23bba451c24c78b6085325266b83d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:07 [ayvens.es] INFO: Found listing with ID: 1875181
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875181%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [ayvens.es] INFO: Scrape type for 1875181: 1
2026-01-27 20:03:07 [ayvens.es] INFO: Extracting data for car ID: 1875181
2026-01-27 20:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccfd49f1-69d3-5ce2-9178-ddf08fdea363 with identifier: 1875181
2026-01-27 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccfd49f1-69d3-5ce2-9178-ddf08fdea363 with scrape type 1
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ccfd49f1-69d3-5ce2-9178-ddf08fdea363
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F448%252Fd0c3f8c800c94f23996cc4e0dee65d4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/448/d0c3f8c800c94f23996cc4e0dee65d4b/images/large/1.jpg not downloaded yet
2026-01-27 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/278/d225a44fc80a4ed697c1daf1927ff3ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:07 [ayvens.es] INFO: Found listing with ID: 1875182
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875182%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [ayvens.es] INFO: Scrape type for 1875182: 1
2026-01-27 20:03:07 [ayvens.es] INFO: Extracting data for car ID: 1875182
2026-01-27 20:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 509b309e-a2d1-56eb-9f46-a84371e6e98c with identifier: 1875182
2026-01-27 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 509b309e-a2d1-56eb-9f46-a84371e6e98c with scrape type 1
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 509b309e-a2d1-56eb-9f46-a84371e6e98c
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F203%252F6e2e498dc9494e29a5b15b8c020ed169%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/203/6e2e498dc9494e29a5b15b8c020ed169/images/large/1.jpg not downloaded yet
2026-01-27 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/406/98b058ca42e545c78393c7295f5a482f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/336/10088a814d7c47f7995cc05066fa0e4a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:07 [ayvens.es] INFO: Found listing with ID: 1875183
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875183%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [ayvens.es] INFO: Scrape type for 1875183: 1
2026-01-27 20:03:07 [ayvens.es] INFO: Extracting data for car ID: 1875183
2026-01-27 20:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c58bf1a1-e7cf-5f13-9f75-78c37683c6ae with identifier: 1875183
2026-01-27 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58bf1a1-e7cf-5f13-9f75-78c37683c6ae with scrape type 1
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c58bf1a1-e7cf-5f13-9f75-78c37683c6ae
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F50bd7ddc6ca4497182c1dee42ff17a6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/50bd7ddc6ca4497182c1dee42ff17a6d/images/large/1.jpg not downloaded yet
2026-01-27 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/215/f48147acf71f4818acc6d414d9087a6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571ee90d0>
2026-01-27 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c123f89-8e1b-5681-946a-9a8a3595b458/0c123f89-8e1b-5681-946a-9a8a3595b458_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F611%252F2b36b229187f4ec592ff337a65c331ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/611/2b36b229187f4ec592ff337a65c331ca/images/large/1.jpg saved to cache
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c123f89-8e1b-5681-946a-9a8a3595b458
2026-01-27 20:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c123f89-8e1b-5681-946a-9a8a3595b458, skipping ID generation
2026-01-27 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c123f89-8e1b-5681-946a-9a8a3595b458 with scrape type 1
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0c123f89-8e1b-5681-946a-9a8a3595b458 from tracking dictionaries
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c123f89-8e1b-5681-946a-9a8a3595b458 sending to next pipeline
2026-01-27 20:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c123f89-8e1b-5681-946a-9a8a3595b458, identifier: 1875175
2026-01-27 20:03:07 [ayvens.es] INFO: Found listing with ID: 1875184
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875184%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [ayvens.es] INFO: Scrape type for 1875184: 1
2026-01-27 20:03:07 [ayvens.es] INFO: Extracting data for car ID: 1875184
2026-01-27 20:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02857921-4470-53bb-b81f-eb38b0d615e0 with identifier: 1875184
2026-01-27 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02857921-4470-53bb-b81f-eb38b0d615e0 with scrape type 1
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 02857921-4470-53bb-b81f-eb38b0d615e0
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252F29f118e60f8e4b2f93ffd38ca2893a31%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/29f118e60f8e4b2f93ffd38ca2893a31/images/large/1.jpg not downloaded yet
2026-01-27 20:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c123f89-8e1b-5681-946a-9a8a3595b458 with identifier: 1875175
2026-01-27 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c123f89-8e1b-5681-946a-9a8a3595b458 with identifier: 1875175
2026-01-27 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'grand tourneo connect' containing 'tourneo'
2026-01-27 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0c123f89-8e1b-5681-946a-9a8a3595b458 spider: ayvens.es
2026-01-27 20:03:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0c123f89-8e1b-5681-946a-9a8a3595b458 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'grand tourneo connect' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c123f89-8e1b-5681-946a-9a8a3595b458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'GRAND TOURNEO CONNECT',
 'odometer': 179687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c123f89-8e1b-5681-946a-9a8a3595b458/0c123f89-8e1b-5681-946a-9a8a3595b458_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/611/2b36b229187f4ec592ff337a65c331ca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD GRAND TOURNEO CONNECT 1.5 TDCi 74kW (100CV) Titanium',
 'transmission': 'manual',
 'trim': '1.5 TDCi 74kW (100CV) Titanium',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875175%27 HTTP/1.1" 200 None
2026-01-27 20:03:07 [ayvens.es] INFO: Saving data for 1875175: {'created_time': 1769544187.982807, 'last_price_update_time': 1769544187.982817, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875175') HTTP/1.1" 204 0
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f78e10>
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72c08b2-66a8-5796-ad26-7d34d7a7afd4/e72c08b2-66a8-5796-ad26-7d34d7a7afd4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F441%252Fec7269ff3ead43a6ae642460fb132557%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/441/ec7269ff3ead43a6ae642460fb132557/images/large/1.jpg saved to cache
2026-01-27 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e72c08b2-66a8-5796-ad26-7d34d7a7afd4
2026-01-27 20:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e72c08b2-66a8-5796-ad26-7d34d7a7afd4, skipping ID generation
2026-01-27 20:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e72c08b2-66a8-5796-ad26-7d34d7a7afd4 with scrape type 1
2026-01-27 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e72c08b2-66a8-5796-ad26-7d34d7a7afd4 from tracking dictionaries
2026-01-27 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e72c08b2-66a8-5796-ad26-7d34d7a7afd4 sending to next pipeline
2026-01-27 20:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e72c08b2-66a8-5796-ad26-7d34d7a7afd4, identifier: 1875171
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572291890>
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d7bcd5a-994f-5a5d-977f-ed8bb32609e3/3d7bcd5a-994f-5a5d-977f-ed8bb32609e3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F515%252F4ea696400e3343009b4b6acc8da3fbfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/515/4ea696400e3343009b4b6acc8da3fbfe/images/large/1.jpg saved to cache
2026-01-27 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3
2026-01-27 20:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3, skipping ID generation
2026-01-27 20:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3 with scrape type 1
2026-01-27 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3 from tracking dictionaries
2026-01-27 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3 sending to next pipeline
2026-01-27 20:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3, identifier: 1875172
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570911fd0>
2026-01-27 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6b8a6eb-19f9-539f-921c-b8fecd592ecb/e6b8a6eb-19f9-539f-921c-b8fecd592ecb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F779%252Fcb23bba451c24c78b6085325266b83d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/779/cb23bba451c24c78b6085325266b83d9/images/large/1.jpg saved to cache
2026-01-27 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6b8a6eb-19f9-539f-921c-b8fecd592ecb
2026-01-27 20:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6b8a6eb-19f9-539f-921c-b8fecd592ecb, skipping ID generation
2026-01-27 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6b8a6eb-19f9-539f-921c-b8fecd592ecb with scrape type 1
2026-01-27 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e6b8a6eb-19f9-539f-921c-b8fecd592ecb from tracking dictionaries
2026-01-27 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6b8a6eb-19f9-539f-921c-b8fecd592ecb sending to next pipeline
2026-01-27 20:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e6b8a6eb-19f9-539f-921c-b8fecd592ecb, identifier: 1875174
2026-01-27 20:03:09 [ayvens.es] INFO: Found listing with ID: 1875185
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875185%27 HTTP/1.1" 200 None
2026-01-27 20:03:09 [ayvens.es] INFO: Scrape type for 1875185: 1
2026-01-27 20:03:09 [ayvens.es] INFO: Extracting data for car ID: 1875185
2026-01-27 20:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0eb28d2-d61c-5720-9c3f-afbd5acc0158 with identifier: 1875185
2026-01-27 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0eb28d2-d61c-5720-9c3f-afbd5acc0158 with scrape type 1
2026-01-27 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0eb28d2-d61c-5720-9c3f-afbd5acc0158
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F017%252F367e05ef0eae46c1a8e997abce4d0e78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/017/367e05ef0eae46c1a8e997abce4d0e78/images/large/1.jpg not downloaded yet
2026-01-27 20:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e72c08b2-66a8-5796-ad26-7d34d7a7afd4 with identifier: 1875171
2026-01-27 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e72c08b2-66a8-5796-ad26-7d34d7a7afd4 with identifier: 1875171
2026-01-27 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169197 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169197
2026-01-27 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e72c08b2-66a8-5796-ad26-7d34d7a7afd4 spider: ayvens.es
2026-01-27 20:03:09 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e72c08b2-66a8-5796-ad26-7d34d7a7afd4 due to rule: high_mileage_for_country.json, error: 169197 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169197
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e72c08b2-66a8-5796-ad26-7d34d7a7afd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 169197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e72c08b2-66a8-5796-ad26-7d34d7a7afd4/e72c08b2-66a8-5796-ad26-7d34d7a7afd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/441/ec7269ff3ead43a6ae642460fb132557/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA Combi 2.0 TDI 110kW (150CV) DSG Style',
 'transmission': 'manual',
 'trim': 'Combi 2.0 TDI 110kW (150CV) DSG Style',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875171%27 HTTP/1.1" 200 None
2026-01-27 20:03:09 [ayvens.es] INFO: Saving data for 1875171: {'created_time': 1769544189.563045, 'last_price_update_time': 1769544189.563059, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875171') HTTP/1.1" 204 0
2026-01-27 20:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3 with identifier: 1875172
2026-01-27 20:03:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3 with identifier: 1875172
2026-01-27 20:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d7bcd5a-994f-5a5d-977f-ed8bb32609e3 with identifier: 1875172 to the API
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/515/4ea696400e3343009b4b6acc8da3fbfe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Urban',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3d7bcd5a-994f-5a5d-977f-ed8bb32609e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 69430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7bcd5a-994f-5a5d-977f-ed8bb32609e3/3d7bcd5a-994f-5a5d-977f-ed8bb32609e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/515/4ea696400e3343009b4b6acc8da3fbfe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2023}
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875172%27 HTTP/1.1" 200 None
2026-01-27 20:03:09 [ayvens.es] INFO: Saving data for 1875172: {'created_time': 1769544189.985652, 'last_price_update_time': 1769544189.985665, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875172') HTTP/1.1" 204 0
2026-01-27 20:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e6b8a6eb-19f9-539f-921c-b8fecd592ecb with identifier: 1875174
2026-01-27 20:03:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e6b8a6eb-19f9-539f-921c-b8fecd592ecb with identifier: 1875174
2026-01-27 20:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e6b8a6eb-19f9-539f-921c-b8fecd592ecb with identifier: 1875174 to the API
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/779/cb23bba451c24c78b6085325266b83d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Enigmatic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e6b8a6eb-19f9-539f-921c-b8fecd592ecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 48464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6b8a6eb-19f9-539f-921c-b8fecd592ecb/e6b8a6eb-19f9-539f-921c-b8fecd592ecb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/779/cb23bba451c24c78b6085325266b83d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875174%27 HTTP/1.1" 200 None
2026-01-27 20:03:10 [ayvens.es] INFO: Saving data for 1875174: {'created_time': 1769544190.391105, 'last_price_update_time': 1769544190.391117, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875174') HTTP/1.1" 204 0
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572653590>
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daadf62b-8461-54d4-a0b5-f6568a02cc7a/daadf62b-8461-54d4-a0b5-f6568a02cc7a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F278%252Fd225a44fc80a4ed697c1daf1927ff3ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/278/d225a44fc80a4ed697c1daf1927ff3ad/images/large/1.jpg saved to cache
2026-01-27 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daadf62b-8461-54d4-a0b5-f6568a02cc7a
2026-01-27 20:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daadf62b-8461-54d4-a0b5-f6568a02cc7a, skipping ID generation
2026-01-27 20:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daadf62b-8461-54d4-a0b5-f6568a02cc7a with scrape type 1
2026-01-27 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item daadf62b-8461-54d4-a0b5-f6568a02cc7a from tracking dictionaries
2026-01-27 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daadf62b-8461-54d4-a0b5-f6568a02cc7a sending to next pipeline
2026-01-27 20:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: daadf62b-8461-54d4-a0b5-f6568a02cc7a, identifier: 1875176
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572288ed0>
2026-01-27 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82f6e858-914e-597c-90e9-b63072abd40f/82f6e858-914e-597c-90e9-b63072abd40f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252F98b058ca42e545c78393c7295f5a482f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/98b058ca42e545c78393c7295f5a482f/images/large/1.jpg saved to cache
2026-01-27 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82f6e858-914e-597c-90e9-b63072abd40f
2026-01-27 20:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82f6e858-914e-597c-90e9-b63072abd40f, skipping ID generation
2026-01-27 20:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82f6e858-914e-597c-90e9-b63072abd40f with scrape type 1
2026-01-27 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 82f6e858-914e-597c-90e9-b63072abd40f from tracking dictionaries
2026-01-27 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82f6e858-914e-597c-90e9-b63072abd40f sending to next pipeline
2026-01-27 20:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 82f6e858-914e-597c-90e9-b63072abd40f, identifier: 1875173
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572269350>
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeff07d3-613b-5a24-87f7-dfc10c92cc92/aeff07d3-613b-5a24-87f7-dfc10c92cc92_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252F10088a814d7c47f7995cc05066fa0e4a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/10088a814d7c47f7995cc05066fa0e4a/images/large/1.jpg saved to cache
2026-01-27 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aeff07d3-613b-5a24-87f7-dfc10c92cc92
2026-01-27 20:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aeff07d3-613b-5a24-87f7-dfc10c92cc92, skipping ID generation
2026-01-27 20:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeff07d3-613b-5a24-87f7-dfc10c92cc92 with scrape type 1
2026-01-27 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aeff07d3-613b-5a24-87f7-dfc10c92cc92 from tracking dictionaries
2026-01-27 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aeff07d3-613b-5a24-87f7-dfc10c92cc92 sending to next pipeline
2026-01-27 20:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aeff07d3-613b-5a24-87f7-dfc10c92cc92, identifier: 1875178
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572605b50>
2026-01-27 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d834356-9473-5345-97e9-336b0a46b8d3/7d834356-9473-5345-97e9-336b0a46b8d3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F215%252Ff48147acf71f4818acc6d414d9087a6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/215/f48147acf71f4818acc6d414d9087a6d/images/large/1.jpg saved to cache
2026-01-27 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d834356-9473-5345-97e9-336b0a46b8d3
2026-01-27 20:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d834356-9473-5345-97e9-336b0a46b8d3, skipping ID generation
2026-01-27 20:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d834356-9473-5345-97e9-336b0a46b8d3 with scrape type 1
2026-01-27 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7d834356-9473-5345-97e9-336b0a46b8d3 from tracking dictionaries
2026-01-27 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d834356-9473-5345-97e9-336b0a46b8d3 sending to next pipeline
2026-01-27 20:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7d834356-9473-5345-97e9-336b0a46b8d3, identifier: 1875177
2026-01-27 20:03:12 [ayvens.es] INFO: Found listing with ID: 1875186
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875186%27 HTTP/1.1" 200 None
2026-01-27 20:03:12 [ayvens.es] INFO: Scrape type for 1875186: 1
2026-01-27 20:03:12 [ayvens.es] INFO: Extracting data for car ID: 1875186
2026-01-27 20:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e91ecb-c0b9-530d-a0a6-125e37d76a30 with identifier: 1875186
2026-01-27 20:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e91ecb-c0b9-530d-a0a6-125e37d76a30 with scrape type 1
2026-01-27 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 93e91ecb-c0b9-530d-a0a6-125e37d76a30
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F851%252F0a3b016740004a45a18bc8289a1d2f72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/851/0a3b016740004a45a18bc8289a1d2f72/images/large/1.jpg not downloaded yet
2026-01-27 20:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: daadf62b-8461-54d4-a0b5-f6568a02cc7a with identifier: 1875176
2026-01-27 20:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: daadf62b-8461-54d4-a0b5-f6568a02cc7a with identifier: 1875176
2026-01-27 20:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: daadf62b-8461-54d4-a0b5-f6568a02cc7a with identifier: 1875176 to the API
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/278/d225a44fc80a4ed697c1daf1927ff3ad/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Midnight',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'daadf62b-8461-54d4-a0b5-f6568a02cc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 54466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daadf62b-8461-54d4-a0b5-f6568a02cc7a/daadf62b-8461-54d4-a0b5-f6568a02cc7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/278/d225a44fc80a4ed697c1daf1927ff3ad/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875176%27 HTTP/1.1" 200 None
2026-01-27 20:03:12 [ayvens.es] INFO: Saving data for 1875176: {'created_time': 1769544192.680699, 'last_price_update_time': 1769544192.680712, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875176') HTTP/1.1" 204 0
2026-01-27 20:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 82f6e858-914e-597c-90e9-b63072abd40f with identifier: 1875173
2026-01-27 20:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 82f6e858-914e-597c-90e9-b63072abd40f with identifier: 1875173
2026-01-27 20:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 82f6e858-914e-597c-90e9-b63072abd40f with identifier: 1875173 to the API
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/406/98b058ca42e545c78393c7295f5a482f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '82f6e858-914e-597c-90e9-b63072abd40f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 56538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82f6e858-914e-597c-90e9-b63072abd40f/82f6e858-914e-597c-90e9-b63072abd40f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/406/98b058ca42e545c78393c7295f5a482f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875173%27 HTTP/1.1" 200 None
2026-01-27 20:03:13 [ayvens.es] INFO: Saving data for 1875173: {'created_time': 1769544193.101091, 'last_price_update_time': 1769544193.101104, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875173') HTTP/1.1" 204 0
2026-01-27 20:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aeff07d3-613b-5a24-87f7-dfc10c92cc92 with identifier: 1875178
2026-01-27 20:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aeff07d3-613b-5a24-87f7-dfc10c92cc92 with identifier: 1875178
2026-01-27 20:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aeff07d3-613b-5a24-87f7-dfc10c92cc92 with identifier: 1875178 to the API
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/336/10088a814d7c47f7995cc05066fa0e4a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aeff07d3-613b-5a24-87f7-dfc10c92cc92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 113436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeff07d3-613b-5a24-87f7-dfc10c92cc92/aeff07d3-613b-5a24-87f7-dfc10c92cc92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/10088a814d7c47f7995cc05066fa0e4a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Allure Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Allure Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875178%27 HTTP/1.1" 200 None
2026-01-27 20:03:13 [ayvens.es] INFO: Saving data for 1875178: {'created_time': 1769544193.510993, 'last_price_update_time': 1769544193.511006, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875178') HTTP/1.1" 204 0
2026-01-27 20:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7d834356-9473-5345-97e9-336b0a46b8d3 with identifier: 1875177
2026-01-27 20:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7d834356-9473-5345-97e9-336b0a46b8d3 with identifier: 1875177
2026-01-27 20:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7d834356-9473-5345-97e9-336b0a46b8d3 with identifier: 1875177 to the API
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/215/f48147acf71f4818acc6d414d9087a6d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7d834356-9473-5345-97e9-336b0a46b8d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 59968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d834356-9473-5345-97e9-336b0a46b8d3/7d834356-9473-5345-97e9-336b0a46b8d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/215/f48147acf71f4818acc6d414d9087a6d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875177%27 HTTP/1.1" 200 None
2026-01-27 20:03:13 [ayvens.es] INFO: Saving data for 1875177: {'created_time': 1769544193.902439, 'last_price_update_time': 1769544193.902453, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875177') HTTP/1.1" 204 0
2026-01-27 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/615/4bb5c3e8f6eb414d9e269803144532e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:13 [ayvens.es] INFO: Found listing with ID: 1875187
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875187%27 HTTP/1.1" 200 None
2026-01-27 20:03:13 [ayvens.es] INFO: Scrape type for 1875187: 1
2026-01-27 20:03:13 [ayvens.es] INFO: Extracting data for car ID: 1875187
2026-01-27 20:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 with identifier: 1875187
2026-01-27 20:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 with scrape type 1
2026-01-27 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6c40c05f-6664-5e3e-a9b7-9b28ab870c15
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F298%252Fd08924ff2ec24a7aa73a0c38be88743c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/298/d08924ff2ec24a7aa73a0c38be88743c/images/large/1.jpg not downloaded yet
2026-01-27 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/499/517c5e546b2c4c8c939a17210dc83af0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/203/6e2e498dc9494e29a5b15b8c020ed169/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:13 [ayvens.es] INFO: Found listing with ID: 1875188
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875188%27 HTTP/1.1" 200 None
2026-01-27 20:03:14 [ayvens.es] INFO: Scrape type for 1875188: 1
2026-01-27 20:03:14 [ayvens.es] INFO: Extracting data for car ID: 1875188
2026-01-27 20:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc0dc6c-1fac-5b5f-806f-8c9ffed0555e with identifier: 1875188
2026-01-27 20:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc0dc6c-1fac-5b5f-806f-8c9ffed0555e with scrape type 1
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afc0dc6c-1fac-5b5f-806f-8c9ffed0555e
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252F7f238174223648ffb35f08c60c5051a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/7f238174223648ffb35f08c60c5051a4/images/large/1.jpg not downloaded yet
2026-01-27 20:03:14 [ayvens.es] INFO: Found listing with ID: 1875189
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875189%27 HTTP/1.1" 200 None
2026-01-27 20:03:14 [ayvens.es] INFO: Scrape type for 1875189: 1
2026-01-27 20:03:14 [ayvens.es] INFO: Extracting data for car ID: 1875189
2026-01-27 20:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 with identifier: 1875189
2026-01-27 20:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 with scrape type 1
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F508%252F418bafee1e8546b4a9ae9ff1d526fc52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/508/418bafee1e8546b4a9ae9ff1d526fc52/images/large/1.jpg not downloaded yet
2026-01-27 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/448/d0c3f8c800c94f23996cc4e0dee65d4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/478/29f118e60f8e4b2f93ffd38ca2893a31/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57090ca50>
2026-01-27 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62450889-fac9-599c-8142-c9afc7492ef2/62450889-fac9-599c-8142-c9afc7492ef2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F4bb5c3e8f6eb414d9e269803144532e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/4bb5c3e8f6eb414d9e269803144532e3/images/large/1.jpg saved to cache
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62450889-fac9-599c-8142-c9afc7492ef2
2026-01-27 20:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62450889-fac9-599c-8142-c9afc7492ef2, skipping ID generation
2026-01-27 20:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62450889-fac9-599c-8142-c9afc7492ef2 with scrape type 1
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 62450889-fac9-599c-8142-c9afc7492ef2 from tracking dictionaries
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62450889-fac9-599c-8142-c9afc7492ef2 sending to next pipeline
2026-01-27 20:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62450889-fac9-599c-8142-c9afc7492ef2, identifier: 1875180
2026-01-27 20:03:14 [ayvens.es] INFO: Found listing with ID: 1875190
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875190%27 HTTP/1.1" 200 None
2026-01-27 20:03:14 [ayvens.es] INFO: Scrape type for 1875190: 1
2026-01-27 20:03:14 [ayvens.es] INFO: Extracting data for car ID: 1875190
2026-01-27 20:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98e28f27-dcac-5d74-af47-24b896b07098 with identifier: 1875190
2026-01-27 20:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e28f27-dcac-5d74-af47-24b896b07098 with scrape type 1
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 98e28f27-dcac-5d74-af47-24b896b07098
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F208%252F3bd30c627c804c0e90dd124a668d4e4f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/208/3bd30c627c804c0e90dd124a668d4e4f/images/large/1.jpg not downloaded yet
2026-01-27 20:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62450889-fac9-599c-8142-c9afc7492ef2 with identifier: 1875180
2026-01-27 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62450889-fac9-599c-8142-c9afc7492ef2 with identifier: 1875180
2026-01-27 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183363 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183363
2026-01-27 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 62450889-fac9-599c-8142-c9afc7492ef2 spider: ayvens.es
2026-01-27 20:03:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 62450889-fac9-599c-8142-c9afc7492ef2 due to rule: high_mileage_for_country.json, error: 183363 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183363
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '62450889-fac9-599c-8142-c9afc7492ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 183363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62450889-fac9-599c-8142-c9afc7492ef2/62450889-fac9-599c-8142-c9afc7492ef2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/615/4bb5c3e8f6eb414d9e269803144532e3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.5 TDCi 75cv Trend 5p',
 'transmission': 'manual',
 'trim': '1.5 TDCi 75cv Trend 5p',
 'vin': None,
 'year': 2016}
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875180%27 HTTP/1.1" 200 None
2026-01-27 20:03:14 [ayvens.es] INFO: Saving data for 1875180: {'created_time': 1769544194.881967, 'last_price_update_time': 1769544194.881981, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875180') HTTP/1.1" 204 0
2026-01-27 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/744/50bd7ddc6ca4497182c1dee42ff17a6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:15 [ayvens.es] INFO: Found listing with ID: 1875191
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875191%27 HTTP/1.1" 200 None
2026-01-27 20:03:15 [ayvens.es] INFO: Scrape type for 1875191: 1
2026-01-27 20:03:15 [ayvens.es] INFO: Extracting data for car ID: 1875191
2026-01-27 20:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e00b975c-e9af-5a8d-9437-d2dc5a24c0b4 with identifier: 1875191
2026-01-27 20:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e00b975c-e9af-5a8d-9437-d2dc5a24c0b4 with scrape type 1
2026-01-27 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e00b975c-e9af-5a8d-9437-d2dc5a24c0b4
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252F76931b12f6914bd58a8714d5e8c61490%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/76931b12f6914bd58a8714d5e8c61490/images/large/1.jpg not downloaded yet
2026-01-27 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721a8a90>
2026-01-27 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b/92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F517c5e546b2c4c8c939a17210dc83af0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/517c5e546b2c4c8c939a17210dc83af0/images/large/1.jpg saved to cache
2026-01-27 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b
2026-01-27 20:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b, skipping ID generation
2026-01-27 20:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b with scrape type 1
2026-01-27 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b from tracking dictionaries
2026-01-27 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b sending to next pipeline
2026-01-27 20:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b, identifier: 1875179
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57090d950>
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_509b309e-a2d1-56eb-9f46-a84371e6e98c/509b309e-a2d1-56eb-9f46-a84371e6e98c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F203%252F6e2e498dc9494e29a5b15b8c020ed169%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/203/6e2e498dc9494e29a5b15b8c020ed169/images/large/1.jpg saved to cache
2026-01-27 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 509b309e-a2d1-56eb-9f46-a84371e6e98c
2026-01-27 20:03:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 509b309e-a2d1-56eb-9f46-a84371e6e98c, skipping ID generation
2026-01-27 20:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 509b309e-a2d1-56eb-9f46-a84371e6e98c with scrape type 1
2026-01-27 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 509b309e-a2d1-56eb-9f46-a84371e6e98c from tracking dictionaries
2026-01-27 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 509b309e-a2d1-56eb-9f46-a84371e6e98c sending to next pipeline
2026-01-27 20:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 509b309e-a2d1-56eb-9f46-a84371e6e98c, identifier: 1875182
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5723f3f50>
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccfd49f1-69d3-5ce2-9178-ddf08fdea363/ccfd49f1-69d3-5ce2-9178-ddf08fdea363_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F448%252Fd0c3f8c800c94f23996cc4e0dee65d4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/448/d0c3f8c800c94f23996cc4e0dee65d4b/images/large/1.jpg saved to cache
2026-01-27 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccfd49f1-69d3-5ce2-9178-ddf08fdea363
2026-01-27 20:03:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccfd49f1-69d3-5ce2-9178-ddf08fdea363, skipping ID generation
2026-01-27 20:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccfd49f1-69d3-5ce2-9178-ddf08fdea363 with scrape type 1
2026-01-27 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ccfd49f1-69d3-5ce2-9178-ddf08fdea363 from tracking dictionaries
2026-01-27 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccfd49f1-69d3-5ce2-9178-ddf08fdea363 sending to next pipeline
2026-01-27 20:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ccfd49f1-69d3-5ce2-9178-ddf08fdea363, identifier: 1875181
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570935850>
2026-01-27 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02857921-4470-53bb-b81f-eb38b0d615e0/02857921-4470-53bb-b81f-eb38b0d615e0_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252F29f118e60f8e4b2f93ffd38ca2893a31%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/29f118e60f8e4b2f93ffd38ca2893a31/images/large/1.jpg saved to cache
2026-01-27 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02857921-4470-53bb-b81f-eb38b0d615e0
2026-01-27 20:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02857921-4470-53bb-b81f-eb38b0d615e0, skipping ID generation
2026-01-27 20:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02857921-4470-53bb-b81f-eb38b0d615e0 with scrape type 1
2026-01-27 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 02857921-4470-53bb-b81f-eb38b0d615e0 from tracking dictionaries
2026-01-27 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02857921-4470-53bb-b81f-eb38b0d615e0 sending to next pipeline
2026-01-27 20:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 02857921-4470-53bb-b81f-eb38b0d615e0, identifier: 1875184
2026-01-27 20:03:17 [ayvens.es] INFO: Found listing with ID: 1875192
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875192%27 HTTP/1.1" 200 None
2026-01-27 20:03:17 [ayvens.es] INFO: Scrape type for 1875192: 1
2026-01-27 20:03:17 [ayvens.es] INFO: Extracting data for car ID: 1875192
2026-01-27 20:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2d6390-268a-59ed-800f-681c9ef60e80 with identifier: 1875192
2026-01-27 20:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2d6390-268a-59ed-800f-681c9ef60e80 with scrape type 1
2026-01-27 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dd2d6390-268a-59ed-800f-681c9ef60e80
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F853%252F4854d30f10084314a0c1f3258ffe0662%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/853/4854d30f10084314a0c1f3258ffe0662/images/large/1.jpg not downloaded yet
2026-01-27 20:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b with identifier: 1875179
2026-01-27 20:03:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b with identifier: 1875179
2026-01-27 20:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b with identifier: 1875179 to the API
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/499/517c5e546b2c4c8c939a17210dc83af0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'color': 'Mineralweiss',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2 ACTIVE TOURER',
 'odometer': 68104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b/92cf2e25-d72b-56b6-a3bf-eee1a7d97c7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/499/517c5e546b2c4c8c939a17210dc83af0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 ACTIVE TOURER 225xe iPerformance',
 'transmission': 'manual',
 'trim': '225xe iPerformance',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875179%27 HTTP/1.1" 200 None
2026-01-27 20:03:17 [ayvens.es] INFO: Saving data for 1875179: {'created_time': 1769544197.802947, 'last_price_update_time': 1769544197.802957, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875179') HTTP/1.1" 204 0
2026-01-27 20:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 509b309e-a2d1-56eb-9f46-a84371e6e98c with identifier: 1875182
2026-01-27 20:03:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 509b309e-a2d1-56eb-9f46-a84371e6e98c with identifier: 1875182
2026-01-27 20:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 509b309e-a2d1-56eb-9f46-a84371e6e98c with identifier: 1875182 to the API
2026-01-27 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/203/6e2e498dc9494e29a5b15b8c020ed169/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'De',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '509b309e-a2d1-56eb-9f46-a84371e6e98c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'TARRACO',
 'odometer': 129322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_509b309e-a2d1-56eb-9f46-a84371e6e98c/509b309e-a2d1-56eb-9f46-a84371e6e98c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/203/6e2e498dc9494e29a5b15b8c020ed169/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT TARRACO 1.4 E-Hybrid 180kW DSG Xcellence GO',
 'transmission': 'manual',
 'trim': '1.4 E-Hybrid 180kW DSG Xcellence GO',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875182%27 HTTP/1.1" 200 None
2026-01-27 20:03:18 [ayvens.es] INFO: Saving data for 1875182: {'created_time': 1769544198.271037, 'last_price_update_time': 1769544198.27105, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875182') HTTP/1.1" 204 0
2026-01-27 20:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ccfd49f1-69d3-5ce2-9178-ddf08fdea363 with identifier: 1875181
2026-01-27 20:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ccfd49f1-69d3-5ce2-9178-ddf08fdea363 with identifier: 1875181
2026-01-27 20:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ccfd49f1-69d3-5ce2-9178-ddf08fdea363 with identifier: 1875181 to the API
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/448/d0c3f8c800c94f23996cc4e0dee65d4b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ccfd49f1-69d3-5ce2-9178-ddf08fdea363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 84870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccfd49f1-69d3-5ce2-9178-ddf08fdea363/ccfd49f1-69d3-5ce2-9178-ddf08fdea363_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/448/d0c3f8c800c94f23996cc4e0dee65d4b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business 100cv dci',
 'transmission': 'manual',
 'trim': 'Business 100cv dci',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875181%27 HTTP/1.1" 200 None
2026-01-27 20:03:18 [ayvens.es] INFO: Saving data for 1875181: {'created_time': 1769544198.738173, 'last_price_update_time': 1769544198.738187, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875181') HTTP/1.1" 204 0
2026-01-27 20:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 02857921-4470-53bb-b81f-eb38b0d615e0 with identifier: 1875184
2026-01-27 20:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 02857921-4470-53bb-b81f-eb38b0d615e0 with identifier: 1875184
2026-01-27 20:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 02857921-4470-53bb-b81f-eb38b0d615e0 with identifier: 1875184 to the API
2026-01-27 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/478/29f118e60f8e4b2f93ffd38ca2893a31/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '02857921-4470-53bb-b81f-eb38b0d615e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 45985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02857921-4470-53bb-b81f-eb38b0d615e0/02857921-4470-53bb-b81f-eb38b0d615e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/478/29f118e60f8e4b2f93ffd38ca2893a31/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'SW Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875184%27 HTTP/1.1" 200 None
2026-01-27 20:03:19 [ayvens.es] INFO: Saving data for 1875184: {'created_time': 1769544199.154317, 'last_price_update_time': 1769544199.154328, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875184') HTTP/1.1" 204 0
2026-01-27 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/298/d08924ff2ec24a7aa73a0c38be88743c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:19 [ayvens.es] INFO: Found listing with ID: 1875193
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875193%27 HTTP/1.1" 200 None
2026-01-27 20:03:19 [ayvens.es] INFO: Scrape type for 1875193: 1
2026-01-27 20:03:19 [ayvens.es] INFO: Extracting data for car ID: 1875193
2026-01-27 20:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c0433e5-9698-5adc-a6da-4d541ef17e7f with identifier: 1875193
2026-01-27 20:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c0433e5-9698-5adc-a6da-4d541ef17e7f with scrape type 1
2026-01-27 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c0433e5-9698-5adc-a6da-4d541ef17e7f
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F467%252Fa86398366140480ebf1d5adc1c29eb4a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/467/a86398366140480ebf1d5adc1c29eb4a/images/large/1.jpg not downloaded yet
2026-01-27 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572136710>
2026-01-27 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c58bf1a1-e7cf-5f13-9f75-78c37683c6ae/c58bf1a1-e7cf-5f13-9f75-78c37683c6ae_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F50bd7ddc6ca4497182c1dee42ff17a6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/50bd7ddc6ca4497182c1dee42ff17a6d/images/large/1.jpg saved to cache
2026-01-27 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c58bf1a1-e7cf-5f13-9f75-78c37683c6ae
2026-01-27 20:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c58bf1a1-e7cf-5f13-9f75-78c37683c6ae, skipping ID generation
2026-01-27 20:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58bf1a1-e7cf-5f13-9f75-78c37683c6ae with scrape type 1
2026-01-27 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c58bf1a1-e7cf-5f13-9f75-78c37683c6ae from tracking dictionaries
2026-01-27 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c58bf1a1-e7cf-5f13-9f75-78c37683c6ae sending to next pipeline
2026-01-27 20:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c58bf1a1-e7cf-5f13-9f75-78c37683c6ae, identifier: 1875183
2026-01-27 20:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c58bf1a1-e7cf-5f13-9f75-78c37683c6ae with identifier: 1875183
2026-01-27 20:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c58bf1a1-e7cf-5f13-9f75-78c37683c6ae with identifier: 1875183
2026-01-27 20:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c58bf1a1-e7cf-5f13-9f75-78c37683c6ae with identifier: 1875183 to the API
2026-01-27 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/744/50bd7ddc6ca4497182c1dee42ff17a6d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c58bf1a1-e7cf-5f13-9f75-78c37683c6ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 90119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c58bf1a1-e7cf-5f13-9f75-78c37683c6ae/c58bf1a1-e7cf-5f13-9f75-78c37683c6ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/744/50bd7ddc6ca4497182c1dee42ff17a6d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (E) Intens Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': '(E) Intens Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875183%27 HTTP/1.1" 200 None
2026-01-27 20:03:20 [ayvens.es] INFO: Saving data for 1875183: {'created_time': 1769544200.264637, 'last_price_update_time': 1769544200.264651, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875183') HTTP/1.1" 204 0
2026-01-27 20:03:20 [ayvens.es] INFO: Found listing with ID: 1875194
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875194%27 HTTP/1.1" 200 None
2026-01-27 20:03:20 [ayvens.es] INFO: Scrape type for 1875194: 1
2026-01-27 20:03:20 [ayvens.es] INFO: Extracting data for car ID: 1875194
2026-01-27 20:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85b5e98-03ad-59b7-a9b1-abc90c82d332 with identifier: 1875194
2026-01-27 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85b5e98-03ad-59b7-a9b1-abc90c82d332 with scrape type 1
2026-01-27 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d85b5e98-03ad-59b7-a9b1-abc90c82d332
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252F5b8cfb5c0c604f858dadab664ff8ee0b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/5b8cfb5c0c604f858dadab664ff8ee0b/images/large/1.jpg not downloaded yet
2026-01-27 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d40d0>
2026-01-27 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c40c05f-6664-5e3e-a9b7-9b28ab870c15/6c40c05f-6664-5e3e-a9b7-9b28ab870c15_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F298%252Fd08924ff2ec24a7aa73a0c38be88743c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/298/d08924ff2ec24a7aa73a0c38be88743c/images/large/1.jpg saved to cache
2026-01-27 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c40c05f-6664-5e3e-a9b7-9b28ab870c15
2026-01-27 20:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c40c05f-6664-5e3e-a9b7-9b28ab870c15, skipping ID generation
2026-01-27 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 with scrape type 1
2026-01-27 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 from tracking dictionaries
2026-01-27 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 sending to next pipeline
2026-01-27 20:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6c40c05f-6664-5e3e-a9b7-9b28ab870c15, identifier: 1875187
2026-01-27 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/420/7f238174223648ffb35f08c60c5051a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/017/367e05ef0eae46c1a8e997abce4d0e78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/851/0a3b016740004a45a18bc8289a1d2f72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/508/418bafee1e8546b4a9ae9ff1d526fc52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:20 [ayvens.es] INFO: Found listing with ID: 1875195
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875195%27 HTTP/1.1" 200 None
2026-01-27 20:03:20 [ayvens.es] INFO: Scrape type for 1875195: 1
2026-01-27 20:03:20 [ayvens.es] INFO: Extracting data for car ID: 1875195
2026-01-27 20:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c267e9-a5ec-570c-b54e-9aaa2697f44b with identifier: 1875195
2026-01-27 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c267e9-a5ec-570c-b54e-9aaa2697f44b with scrape type 1
2026-01-27 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c0c267e9-a5ec-570c-b54e-9aaa2697f44b
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F982b270ede6e44308b405c25450f187a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/982b270ede6e44308b405c25450f187a/images/large/1.jpg not downloaded yet
2026-01-27 20:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 with identifier: 1875187
2026-01-27 20:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 with identifier: 1875187
2026-01-27 20:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150021 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150021
2026-01-27 20:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 spider: ayvens.es
2026-01-27 20:03:21 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6c40c05f-6664-5e3e-a9b7-9b28ab870c15 due to rule: high_mileage_for_country.json, error: 150021 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150021
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6c40c05f-6664-5e3e-a9b7-9b28ab870c15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 150021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c40c05f-6664-5e3e-a9b7-9b28ab870c15/6c40c05f-6664-5e3e-a9b7-9b28ab870c15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/298/d08924ff2ec24a7aa73a0c38be88743c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA Zen TCe 103kW(140CV) EDC Micro Hibrido',
 'transmission': 'manual',
 'trim': 'Zen TCe 103kW(140CV) EDC Micro Hibrido',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875187%27 HTTP/1.1" 200 None
2026-01-27 20:03:21 [ayvens.es] INFO: Saving data for 1875187: {'created_time': 1769544201.074764, 'last_price_update_time': 1769544201.074777, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875187') HTTP/1.1" 204 0
2026-01-27 20:03:21 [ayvens.es] INFO: Found listing with ID: 1875196
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875196%27 HTTP/1.1" 200 None
2026-01-27 20:03:21 [ayvens.es] INFO: Scrape type for 1875196: 1
2026-01-27 20:03:21 [ayvens.es] INFO: Extracting data for car ID: 1875196
2026-01-27 20:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b718177c-96bc-51c4-b5b5-2900d52fe3dc with identifier: 1875196
2026-01-27 20:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b718177c-96bc-51c4-b5b5-2900d52fe3dc with scrape type 1
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b718177c-96bc-51c4-b5b5-2900d52fe3dc
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F6ada661d551e4623aa51abb1407e37d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/6ada661d551e4623aa51abb1407e37d1/images/large/1.jpg not downloaded yet
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724e3850>
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afc0dc6c-1fac-5b5f-806f-8c9ffed0555e/afc0dc6c-1fac-5b5f-806f-8c9ffed0555e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252F7f238174223648ffb35f08c60c5051a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/7f238174223648ffb35f08c60c5051a4/images/large/1.jpg saved to cache
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afc0dc6c-1fac-5b5f-806f-8c9ffed0555e
2026-01-27 20:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afc0dc6c-1fac-5b5f-806f-8c9ffed0555e, skipping ID generation
2026-01-27 20:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc0dc6c-1fac-5b5f-806f-8c9ffed0555e with scrape type 1
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item afc0dc6c-1fac-5b5f-806f-8c9ffed0555e from tracking dictionaries
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afc0dc6c-1fac-5b5f-806f-8c9ffed0555e sending to next pipeline
2026-01-27 20:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: afc0dc6c-1fac-5b5f-806f-8c9ffed0555e, identifier: 1875188
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572408650>
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0eb28d2-d61c-5720-9c3f-afbd5acc0158/e0eb28d2-d61c-5720-9c3f-afbd5acc0158_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F017%252F367e05ef0eae46c1a8e997abce4d0e78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/017/367e05ef0eae46c1a8e997abce4d0e78/images/large/1.jpg saved to cache
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0eb28d2-d61c-5720-9c3f-afbd5acc0158
2026-01-27 20:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0eb28d2-d61c-5720-9c3f-afbd5acc0158, skipping ID generation
2026-01-27 20:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0eb28d2-d61c-5720-9c3f-afbd5acc0158 with scrape type 1
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e0eb28d2-d61c-5720-9c3f-afbd5acc0158 from tracking dictionaries
2026-01-27 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0eb28d2-d61c-5720-9c3f-afbd5acc0158 sending to next pipeline
2026-01-27 20:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0eb28d2-d61c-5720-9c3f-afbd5acc0158, identifier: 1875185
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572135990>
2026-01-27 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93e91ecb-c0b9-530d-a0a6-125e37d76a30/93e91ecb-c0b9-530d-a0a6-125e37d76a30_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F851%252F0a3b016740004a45a18bc8289a1d2f72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/851/0a3b016740004a45a18bc8289a1d2f72/images/large/1.jpg saved to cache
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93e91ecb-c0b9-530d-a0a6-125e37d76a30
2026-01-27 20:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93e91ecb-c0b9-530d-a0a6-125e37d76a30, skipping ID generation
2026-01-27 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e91ecb-c0b9-530d-a0a6-125e37d76a30 with scrape type 1
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 93e91ecb-c0b9-530d-a0a6-125e37d76a30 from tracking dictionaries
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93e91ecb-c0b9-530d-a0a6-125e37d76a30 sending to next pipeline
2026-01-27 20:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 93e91ecb-c0b9-530d-a0a6-125e37d76a30, identifier: 1875186
2026-01-27 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57211e710>
2026-01-27 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73/f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F508%252F418bafee1e8546b4a9ae9ff1d526fc52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/508/418bafee1e8546b4a9ae9ff1d526fc52/images/large/1.jpg saved to cache
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73
2026-01-27 20:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73, skipping ID generation
2026-01-27 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 with scrape type 1
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 from tracking dictionaries
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 sending to next pipeline
2026-01-27 20:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73, identifier: 1875189
2026-01-27 20:03:22 [ayvens.es] INFO: Found listing with ID: 1875197
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875197%27 HTTP/1.1" 200 None
2026-01-27 20:03:22 [ayvens.es] INFO: Scrape type for 1875197: 1
2026-01-27 20:03:22 [ayvens.es] INFO: Extracting data for car ID: 1875197
2026-01-27 20:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde with identifier: 1875197
2026-01-27 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde with scrape type 1
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F624%252Fc466c678198d480b85859ea83dd4011b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/624/c466c678198d480b85859ea83dd4011b/images/large/1.jpg not downloaded yet
2026-01-27 20:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: afc0dc6c-1fac-5b5f-806f-8c9ffed0555e with identifier: 1875188
2026-01-27 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: afc0dc6c-1fac-5b5f-806f-8c9ffed0555e with identifier: 1875188
2026-01-27 20:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: afc0dc6c-1fac-5b5f-806f-8c9ffed0555e with identifier: 1875188 to the API
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/420/7f238174223648ffb35f08c60c5051a4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'color': 'Mineralweiss',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'afc0dc6c-1fac-5b5f-806f-8c9ffed0555e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2 ACTIVE TOURER',
 'odometer': 117776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afc0dc6c-1fac-5b5f-806f-8c9ffed0555e/afc0dc6c-1fac-5b5f-806f-8c9ffed0555e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/420/7f238174223648ffb35f08c60c5051a4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 ACTIVE TOURER 225xe iPerformance',
 'transmission': 'manual',
 'trim': '225xe iPerformance',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875188%27 HTTP/1.1" 200 None
2026-01-27 20:03:23 [ayvens.es] INFO: Saving data for 1875188: {'created_time': 1769544203.401161, 'last_price_update_time': 1769544203.401172, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875188') HTTP/1.1" 204 0
2026-01-27 20:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0eb28d2-d61c-5720-9c3f-afbd5acc0158 with identifier: 1875185
2026-01-27 20:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0eb28d2-d61c-5720-9c3f-afbd5acc0158 with identifier: 1875185
2026-01-27 20:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0eb28d2-d61c-5720-9c3f-afbd5acc0158 with identifier: 1875185 to the API
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/017/367e05ef0eae46c1a8e997abce4d0e78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e0eb28d2-d61c-5720-9c3f-afbd5acc0158',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 88962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0eb28d2-d61c-5720-9c3f-afbd5acc0158/e0eb28d2-d61c-5720-9c3f-afbd5acc0158_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/017/367e05ef0eae46c1a8e997abce4d0e78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A5 S Line 35 TDI 120kW S tronic Sportback',
 'transmission': 'manual',
 'trim': 'S Line 35 TDI 120kW S tronic Sportback',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875185%27 HTTP/1.1" 200 None
2026-01-27 20:03:23 [ayvens.es] INFO: Saving data for 1875185: {'created_time': 1769544203.777755, 'last_price_update_time': 1769544203.777768, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875185') HTTP/1.1" 204 0
2026-01-27 20:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 93e91ecb-c0b9-530d-a0a6-125e37d76a30 with identifier: 1875186
2026-01-27 20:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 93e91ecb-c0b9-530d-a0a6-125e37d76a30 with identifier: 1875186
2026-01-27 20:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 93e91ecb-c0b9-530d-a0a6-125e37d76a30 with identifier: 1875186 to the API
2026-01-27 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/851/0a3b016740004a45a18bc8289a1d2f72/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '93e91ecb-c0b9-530d-a0a6-125e37d76a30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 126144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93e91ecb-c0b9-530d-a0a6-125e37d76a30/93e91ecb-c0b9-530d-a0a6-125e37d76a30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/851/0a3b016740004a45a18bc8289a1d2f72/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi 132kW (180CV) Auto. SO CHIC',
 'transmission': 'manual',
 'trim': 'BlueHDi 132kW (180CV) Auto. SO CHIC',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875186%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [ayvens.es] INFO: Saving data for 1875186: {'created_time': 1769544204.191962, 'last_price_update_time': 1769544204.191975, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875186') HTTP/1.1" 204 0
2026-01-27 20:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 with identifier: 1875189
2026-01-27 20:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 with identifier: 1875189
2026-01-27 20:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '5p active puretech 60kw (82cv)', 'title': 'peugeot 208 5p active puretech 60kw (82cv)', 'price': 0, 'odometer': 142439, 'odometer_reading_unit': 'km', 'registration_date': '2019-10-21', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 109, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73/f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/508/418bafee1e8546b4a9ae9ff1d526fc52/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 334969}], 'current_year_diff': 7, 'age_in_months': 75, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 142439}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 75,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 142439,
     'odometer_in_km': 142439,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73/f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 334969,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/508/418bafee1e8546b4a9ae9ff1d526fc52/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-10-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 5p active puretech 60kw (82cv)',
     'transmission': 'manual',
     'trim': '5p active puretech 60kw (82cv)',
     'vin': None,
     'year': 2019}
2026-01-27 20:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 spider: ayvens.es
2026-01-27 20:03:24 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '5p active puretech 60kw (82cv)', 'title': 'peugeot 208 5p active puretech 60kw (82cv)', 'price': 0, 'odometer': 142439, 'odometer_reading_unit': 'km', 'registration_date': '2019-10-21', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 109, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73/f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/508/418bafee1e8546b4a9ae9ff1d526fc52/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 334969}], 'current_year_diff': 7, 'age_in_months': 75, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 142439}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 75,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 142439,
     'odometer_in_km': 142439,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73/f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 334969,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/508/418bafee1e8546b4a9ae9ff1d526fc52/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-10-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 5p active puretech 60kw (82cv)',
     'transmission': 'manual',
     'trim': '5p active puretech 60kw (82cv)',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 142439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73/f7da5ecc-e0a0-5196-9f1b-51ff8ad22c73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/508/418bafee1e8546b4a9ae9ff1d526fc52/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE PureTech 60kW (82CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE PureTech 60kW (82CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875189%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [ayvens.es] INFO: Saving data for 1875189: {'created_time': 1769544204.477216, 'last_price_update_time': 1769544204.477229, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875189') HTTP/1.1" 204 0
2026-01-27 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/853/4854d30f10084314a0c1f3258ffe0662/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:24 [ayvens.es] INFO: Found listing with ID: 1875198
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875198%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [ayvens.es] INFO: Scrape type for 1875198: 1
2026-01-27 20:03:24 [ayvens.es] INFO: Extracting data for car ID: 1875198
2026-01-27 20:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0 with identifier: 1875198
2026-01-27 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0 with scrape type 1
2026-01-27 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F042%252Fbe4f9cb104704724819efc94bbeccb61%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/042/be4f9cb104704724819efc94bbeccb61/images/large/1.jpg not downloaded yet
2026-01-27 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/467/a86398366140480ebf1d5adc1c29eb4a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/208/3bd30c627c804c0e90dd124a668d4e4f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:24 [ayvens.es] INFO: Found listing with ID: 1875199
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875199%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [ayvens.es] INFO: Scrape type for 1875199: 1
2026-01-27 20:03:24 [ayvens.es] INFO: Extracting data for car ID: 1875199
2026-01-27 20:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90a087f1-bb01-5566-b373-149fd3066031 with identifier: 1875199
2026-01-27 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a087f1-bb01-5566-b373-149fd3066031 with scrape type 1
2026-01-27 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 90a087f1-bb01-5566-b373-149fd3066031
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252F94e12b7d941a4dabbff49c79fbf2f466%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/94e12b7d941a4dabbff49c79fbf2f466/images/large/1.jpg not downloaded yet
2026-01-27 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/416/76931b12f6914bd58a8714d5e8c61490/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:24 [ayvens.es] INFO: Found listing with ID: 1875200
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875200%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [ayvens.es] INFO: Scrape type for 1875200: 1
2026-01-27 20:03:24 [ayvens.es] INFO: Extracting data for car ID: 1875200
2026-01-27 20:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74699351-de2c-54e8-aaac-0330de752e66 with identifier: 1875200
2026-01-27 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74699351-de2c-54e8-aaac-0330de752e66 with scrape type 1
2026-01-27 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 74699351-de2c-54e8-aaac-0330de752e66
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F737%252F6575ef76e372468ab9cf10c662f67604%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/737/6575ef76e372468ab9cf10c662f67604/images/large/1.jpg not downloaded yet
2026-01-27 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/865/5b8cfb5c0c604f858dadab664ff8ee0b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/531/982b270ede6e44308b405c25450f187a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:24 [ayvens.es] INFO: Found listing with ID: 1875201
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875201%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [ayvens.es] INFO: Scrape type for 1875201: 1
2026-01-27 20:03:24 [ayvens.es] INFO: Extracting data for car ID: 1875201
2026-01-27 20:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77d8edfc-50fb-5ba1-8255-162c475d9198 with identifier: 1875201
2026-01-27 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d8edfc-50fb-5ba1-8255-162c475d9198 with scrape type 1
2026-01-27 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77d8edfc-50fb-5ba1-8255-162c475d9198
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F806%252F344c3c7923db487291ab12fef84d7bd3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/806/344c3c7923db487291ab12fef84d7bd3/images/large/1.jpg not downloaded yet
2026-01-27 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570928610>
2026-01-27 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd2d6390-268a-59ed-800f-681c9ef60e80/dd2d6390-268a-59ed-800f-681c9ef60e80_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F853%252F4854d30f10084314a0c1f3258ffe0662%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/853/4854d30f10084314a0c1f3258ffe0662/images/large/1.jpg saved to cache
2026-01-27 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd2d6390-268a-59ed-800f-681c9ef60e80
2026-01-27 20:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd2d6390-268a-59ed-800f-681c9ef60e80, skipping ID generation
2026-01-27 20:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2d6390-268a-59ed-800f-681c9ef60e80 with scrape type 1
2026-01-27 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dd2d6390-268a-59ed-800f-681c9ef60e80 from tracking dictionaries
2026-01-27 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd2d6390-268a-59ed-800f-681c9ef60e80 sending to next pipeline
2026-01-27 20:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dd2d6390-268a-59ed-800f-681c9ef60e80, identifier: 1875192
2026-01-27 20:03:25 [ayvens.es] INFO: Found listing with ID: 1875202
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875202%27 HTTP/1.1" 200 None
2026-01-27 20:03:25 [ayvens.es] INFO: Scrape type for 1875202: 1
2026-01-27 20:03:25 [ayvens.es] INFO: Extracting data for car ID: 1875202
2026-01-27 20:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa2c097d-0397-5af3-95e9-ddfb2556fe5c with identifier: 1875202
2026-01-27 20:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2c097d-0397-5af3-95e9-ddfb2556fe5c with scrape type 1
2026-01-27 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fa2c097d-0397-5af3-95e9-ddfb2556fe5c
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F594fe032aade45b88b079ffcb6bae8af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/594fe032aade45b88b079ffcb6bae8af/images/large/1.jpg not downloaded yet
2026-01-27 20:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dd2d6390-268a-59ed-800f-681c9ef60e80 with identifier: 1875192
2026-01-27 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dd2d6390-268a-59ed-800f-681c9ef60e80 with identifier: 1875192
2026-01-27 20:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dd2d6390-268a-59ed-800f-681c9ef60e80 with identifier: 1875192 to the API
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/853/4854d30f10084314a0c1f3258ffe0662/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dd2d6390-268a-59ed-800f-681c9ef60e80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 117359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd2d6390-268a-59ed-800f-681c9ef60e80/dd2d6390-268a-59ed-800f-681c9ef60e80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/853/4854d30f10084314a0c1f3258ffe0662/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Tiguan 2.0 TDI 90kW (122CV)',
 'transmission': 'manual',
 'trim': 'Tiguan 2.0 TDI 90kW (122CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875192%27 HTTP/1.1" 200 None
2026-01-27 20:03:25 [ayvens.es] INFO: Saving data for 1875192: {'created_time': 1769544205.583095, 'last_price_update_time': 1769544205.583106, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875192') HTTP/1.1" 204 0
2026-01-27 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57228a190>
2026-01-27 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c0433e5-9698-5adc-a6da-4d541ef17e7f/7c0433e5-9698-5adc-a6da-4d541ef17e7f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F467%252Fa86398366140480ebf1d5adc1c29eb4a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/467/a86398366140480ebf1d5adc1c29eb4a/images/large/1.jpg saved to cache
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c0433e5-9698-5adc-a6da-4d541ef17e7f
2026-01-27 20:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c0433e5-9698-5adc-a6da-4d541ef17e7f, skipping ID generation
2026-01-27 20:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c0433e5-9698-5adc-a6da-4d541ef17e7f with scrape type 1
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7c0433e5-9698-5adc-a6da-4d541ef17e7f from tracking dictionaries
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c0433e5-9698-5adc-a6da-4d541ef17e7f sending to next pipeline
2026-01-27 20:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7c0433e5-9698-5adc-a6da-4d541ef17e7f, identifier: 1875193
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572651b50>
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e28f27-dcac-5d74-af47-24b896b07098/98e28f27-dcac-5d74-af47-24b896b07098_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F208%252F3bd30c627c804c0e90dd124a668d4e4f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/208/3bd30c627c804c0e90dd124a668d4e4f/images/large/1.jpg saved to cache
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98e28f27-dcac-5d74-af47-24b896b07098
2026-01-27 20:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98e28f27-dcac-5d74-af47-24b896b07098, skipping ID generation
2026-01-27 20:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e28f27-dcac-5d74-af47-24b896b07098 with scrape type 1
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 98e28f27-dcac-5d74-af47-24b896b07098 from tracking dictionaries
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98e28f27-dcac-5d74-af47-24b896b07098 sending to next pipeline
2026-01-27 20:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 98e28f27-dcac-5d74-af47-24b896b07098, identifier: 1875190
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708de150>
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e00b975c-e9af-5a8d-9437-d2dc5a24c0b4/e00b975c-e9af-5a8d-9437-d2dc5a24c0b4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252F76931b12f6914bd58a8714d5e8c61490%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/76931b12f6914bd58a8714d5e8c61490/images/large/1.jpg saved to cache
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e00b975c-e9af-5a8d-9437-d2dc5a24c0b4
2026-01-27 20:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e00b975c-e9af-5a8d-9437-d2dc5a24c0b4, skipping ID generation
2026-01-27 20:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e00b975c-e9af-5a8d-9437-d2dc5a24c0b4 with scrape type 1
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e00b975c-e9af-5a8d-9437-d2dc5a24c0b4 from tracking dictionaries
2026-01-27 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e00b975c-e9af-5a8d-9437-d2dc5a24c0b4 sending to next pipeline
2026-01-27 20:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e00b975c-e9af-5a8d-9437-d2dc5a24c0b4, identifier: 1875191
2026-01-27 20:03:27 [ayvens.es] INFO: Found listing with ID: 1875203
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875203%27 HTTP/1.1" 200 None
2026-01-27 20:03:27 [ayvens.es] INFO: Scrape type for 1875203: 1
2026-01-27 20:03:27 [ayvens.es] INFO: Extracting data for car ID: 1875203
2026-01-27 20:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e860bea-cdb6-5373-914d-87df8adff03c with identifier: 1875203
2026-01-27 20:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e860bea-cdb6-5373-914d-87df8adff03c with scrape type 1
2026-01-27 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9e860bea-cdb6-5373-914d-87df8adff03c
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F407%252F874197423fb443358afbff658d668dac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/407/874197423fb443358afbff658d668dac/images/large/1.jpg not downloaded yet
2026-01-27 20:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7c0433e5-9698-5adc-a6da-4d541ef17e7f with identifier: 1875193
2026-01-27 20:03:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7c0433e5-9698-5adc-a6da-4d541ef17e7f with identifier: 1875193
2026-01-27 20:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'engine', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'hyundai', 'model': 'i30', 'trim': '(o) 1.6 crdi 100kw (136cv) 48v klass', 'title': 'hyundai i30 (o) 1.6 crdi 100kw (136cv) 48v klass', 'price': 0, 'odometer': 258538, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-30', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.6l', 'c_o_2_emission_value': 121, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '7c0433e5-9698-5adc-a6da-4d541ef17e7f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c0433e5-9698-5adc-a6da-4d541ef17e7f/7c0433e5-9698-5adc-a6da-4d541ef17e7f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/467/a86398366140480ebf1d5adc1c29eb4a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 385559}], 'current_year_diff': 5, 'age_in_months': 49, 'make_model': 'hyundai i30', 'sanitized_make': 'hyundai', 'odometer_in_km': 258538}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': 121,
     'color': 'engine',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.6l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '7c0433e5-9698-5adc-a6da-4d541ef17e7f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'hyundai',
     'make_model': 'hyundai i30',
     'model': 'i30',
     'odometer': 258538,
     'odometer_in_km': 258538,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c0433e5-9698-5adc-a6da-4d541ef17e7f/7c0433e5-9698-5adc-a6da-4d541ef17e7f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 385559,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/467/a86398366140480ebf1d5adc1c29eb4a/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-30',
     'sanitized_make': 'hyundai',
     'seats_number': 5,
     'seller_name': None,
     'title': 'hyundai i30 (o) 1.6 crdi 100kw (136cv) 48v klass',
     'transmission': 'manual',
     'trim': '(o) 1.6 crdi 100kw (136cv) 48v klass',
     'vin': None,
     'year': 2021}
2026-01-27 20:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 7c0433e5-9698-5adc-a6da-4d541ef17e7f spider: ayvens.es
2026-01-27 20:03:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7c0433e5-9698-5adc-a6da-4d541ef17e7f due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'engine', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'hyundai', 'model': 'i30', 'trim': '(o) 1.6 crdi 100kw (136cv) 48v klass', 'title': 'hyundai i30 (o) 1.6 crdi 100kw (136cv) 48v klass', 'price': 0, 'odometer': 258538, 'odometer_reading_unit': 'km', 'registration_date': '2021-11-30', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.6l', 'c_o_2_emission_value': 121, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '7c0433e5-9698-5adc-a6da-4d541ef17e7f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c0433e5-9698-5adc-a6da-4d541ef17e7f/7c0433e5-9698-5adc-a6da-4d541ef17e7f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/467/a86398366140480ebf1d5adc1c29eb4a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 385559}], 'current_year_diff': 5, 'age_in_months': 49, 'make_model': 'hyundai i30', 'sanitized_make': 'hyundai', 'odometer_in_km': 258538}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': 121,
     'color': 'engine',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.6l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '7c0433e5-9698-5adc-a6da-4d541ef17e7f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'hyundai',
     'make_model': 'hyundai i30',
     'model': 'i30',
     'odometer': 258538,
     'odometer_in_km': 258538,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c0433e5-9698-5adc-a6da-4d541ef17e7f/7c0433e5-9698-5adc-a6da-4d541ef17e7f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 385559,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/467/a86398366140480ebf1d5adc1c29eb4a/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-30',
     'sanitized_make': 'hyundai',
     'seats_number': 5,
     'seller_name': None,
     'title': 'hyundai i30 (o) 1.6 crdi 100kw (136cv) 48v klass',
     'transmission': 'manual',
     'trim': '(o) 1.6 crdi 100kw (136cv) 48v klass',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Engine',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7c0433e5-9698-5adc-a6da-4d541ef17e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'I30',
 'odometer': 258538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c0433e5-9698-5adc-a6da-4d541ef17e7f/7c0433e5-9698-5adc-a6da-4d541ef17e7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/467/a86398366140480ebf1d5adc1c29eb4a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI I30 (O) 1.6 CRDI 100kW (136CV) 48V Klass',
 'transmission': 'manual',
 'trim': '(O) 1.6 CRDI 100kW (136CV) 48V Klass',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875193%27 HTTP/1.1" 200 None
2026-01-27 20:03:27 [ayvens.es] INFO: Saving data for 1875193: {'created_time': 1769544207.295583, 'last_price_update_time': 1769544207.295596, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875193') HTTP/1.1" 204 0
2026-01-27 20:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 98e28f27-dcac-5d74-af47-24b896b07098 with identifier: 1875190
2026-01-27 20:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 98e28f27-dcac-5d74-af47-24b896b07098 with identifier: 1875190
2026-01-27 20:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 98e28f27-dcac-5d74-af47-24b896b07098 with identifier: 1875190 to the API
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/208/3bd30c627c804c0e90dd124a668d4e4f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '98e28f27-dcac-5d74-af47-24b896b07098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 103695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e28f27-dcac-5d74-af47-24b896b07098/98e28f27-dcac-5d74-af47-24b896b07098_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/208/3bd30c627c804c0e90dd124a668d4e4f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Limited Energy dCi 66kW (90CV) 2018',
 'transmission': 'manual',
 'trim': 'Limited Energy dCi 66kW (90CV) 2018',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875190%27 HTTP/1.1" 200 None
2026-01-27 20:03:27 [ayvens.es] INFO: Saving data for 1875190: {'created_time': 1769544207.747501, 'last_price_update_time': 1769544207.747513, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875190') HTTP/1.1" 204 0
2026-01-27 20:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e00b975c-e9af-5a8d-9437-d2dc5a24c0b4 with identifier: 1875191
2026-01-27 20:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e00b975c-e9af-5a8d-9437-d2dc5a24c0b4 with identifier: 1875191
2026-01-27 20:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e00b975c-e9af-5a8d-9437-d2dc5a24c0b4 with identifier: 1875191 to the API
2026-01-27 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/416/76931b12f6914bd58a8714d5e8c61490/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e00b975c-e9af-5a8d-9437-d2dc5a24c0b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 113960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e00b975c-e9af-5a8d-9437-d2dc5a24c0b4/e00b975c-e9af-5a8d-9437-d2dc5a24c0b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/416/76931b12f6914bd58a8714d5e8c61490/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW Reference Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW Reference Eco',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875191%27 HTTP/1.1" 200 None
2026-01-27 20:03:28 [ayvens.es] INFO: Saving data for 1875191: {'created_time': 1769544208.14051, 'last_price_update_time': 1769544208.140526, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875191') HTTP/1.1" 204 0
2026-01-27 20:03:28 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 2 pages/min), scraped 121 items (at 45 items/min)
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572334a90>
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85b5e98-03ad-59b7-a9b1-abc90c82d332/d85b5e98-03ad-59b7-a9b1-abc90c82d332_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252F5b8cfb5c0c604f858dadab664ff8ee0b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/5b8cfb5c0c604f858dadab664ff8ee0b/images/large/1.jpg saved to cache
2026-01-27 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d85b5e98-03ad-59b7-a9b1-abc90c82d332
2026-01-27 20:03:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d85b5e98-03ad-59b7-a9b1-abc90c82d332, skipping ID generation
2026-01-27 20:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85b5e98-03ad-59b7-a9b1-abc90c82d332 with scrape type 1
2026-01-27 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d85b5e98-03ad-59b7-a9b1-abc90c82d332 from tracking dictionaries
2026-01-27 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d85b5e98-03ad-59b7-a9b1-abc90c82d332 sending to next pipeline
2026-01-27 20:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d85b5e98-03ad-59b7-a9b1-abc90c82d332, identifier: 1875194
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572129610>
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c267e9-a5ec-570c-b54e-9aaa2697f44b/c0c267e9-a5ec-570c-b54e-9aaa2697f44b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F982b270ede6e44308b405c25450f187a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/982b270ede6e44308b405c25450f187a/images/large/1.jpg saved to cache
2026-01-27 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0c267e9-a5ec-570c-b54e-9aaa2697f44b
2026-01-27 20:03:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0c267e9-a5ec-570c-b54e-9aaa2697f44b, skipping ID generation
2026-01-27 20:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c267e9-a5ec-570c-b54e-9aaa2697f44b with scrape type 1
2026-01-27 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c0c267e9-a5ec-570c-b54e-9aaa2697f44b from tracking dictionaries
2026-01-27 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0c267e9-a5ec-570c-b54e-9aaa2697f44b sending to next pipeline
2026-01-27 20:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c0c267e9-a5ec-570c-b54e-9aaa2697f44b, identifier: 1875195
2026-01-27 20:03:29 [ayvens.es] INFO: Found listing with ID: 1875204
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875204%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [ayvens.es] INFO: Scrape type for 1875204: 1
2026-01-27 20:03:29 [ayvens.es] INFO: Extracting data for car ID: 1875204
2026-01-27 20:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d1c2f0-cc11-5c3d-a962-1478da2452c0 with identifier: 1875204
2026-01-27 20:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d1c2f0-cc11-5c3d-a962-1478da2452c0 with scrape type 1
2026-01-27 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3d1c2f0-cc11-5c3d-a962-1478da2452c0
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F488%252Fc11b2b172d5c417d8e83effaab359fac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/488/c11b2b172d5c417d8e83effaab359fac/images/large/1.jpg not downloaded yet
2026-01-27 20:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d85b5e98-03ad-59b7-a9b1-abc90c82d332 with identifier: 1875194
2026-01-27 20:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d85b5e98-03ad-59b7-a9b1-abc90c82d332 with identifier: 1875194
2026-01-27 20:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131133 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131133
2026-01-27 20:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: d85b5e98-03ad-59b7-a9b1-abc90c82d332 spider: ayvens.es
2026-01-27 20:03:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d85b5e98-03ad-59b7-a9b1-abc90c82d332 due to rule: high_mileage_for_make.json, error: 131133 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131133
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd85b5e98-03ad-59b7-a9b1-abc90c82d332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 131133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85b5e98-03ad-59b7-a9b1-abc90c82d332/d85b5e98-03ad-59b7-a9b1-abc90c82d332_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/865/5b8cfb5c0c604f858dadab664ff8ee0b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Life Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875194%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [ayvens.es] INFO: Saving data for 1875194: {'created_time': 1769544209.259878, 'last_price_update_time': 1769544209.25989, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875194') HTTP/1.1" 204 0
2026-01-27 20:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c0c267e9-a5ec-570c-b54e-9aaa2697f44b with identifier: 1875195
2026-01-27 20:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c0c267e9-a5ec-570c-b54e-9aaa2697f44b with identifier: 1875195
2026-01-27 20:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c0c267e9-a5ec-570c-b54e-9aaa2697f44b with identifier: 1875195 to the API
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/531/982b270ede6e44308b405c25450f187a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0c267e9-a5ec-570c-b54e-9aaa2697f44b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA',
 'odometer': 76438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c267e9-a5ec-570c-b54e-9aaa2697f44b/c0c267e9-a5ec-570c-b54e-9aaa2697f44b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/531/982b270ede6e44308b405c25450f187a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA ST 1.6 CDTi 100kW Turbo D Innovation Aut',
 'transmission': 'manual',
 'trim': 'ST 1.6 CDTi 100kW Turbo D Innovation Aut',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875195%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [ayvens.es] INFO: Saving data for 1875195: {'created_time': 1769544209.697042, 'last_price_update_time': 1769544209.697055, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875195') HTTP/1.1" 204 0
2026-01-27 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/051/94e12b7d941a4dabbff49c79fbf2f466/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:29 [ayvens.es] INFO: Found listing with ID: 1875205
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875205%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [ayvens.es] INFO: Scrape type for 1875205: 1
2026-01-27 20:03:29 [ayvens.es] INFO: Extracting data for car ID: 1875205
2026-01-27 20:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f11ccbc-c8db-5b14-ac35-ff8db60336fb with identifier: 1875205
2026-01-27 20:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f11ccbc-c8db-5b14-ac35-ff8db60336fb with scrape type 1
2026-01-27 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f11ccbc-c8db-5b14-ac35-ff8db60336fb
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F464%252Fa6deb3a2349941cd8d5f9e3a83f62606%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/464/a6deb3a2349941cd8d5f9e3a83f62606/images/large/1.jpg not downloaded yet
2026-01-27 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/042/be4f9cb104704724819efc94bbeccb61/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:29 [ayvens.es] INFO: Found listing with ID: 1875206
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875206%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [ayvens.es] INFO: Scrape type for 1875206: 1
2026-01-27 20:03:29 [ayvens.es] INFO: Extracting data for car ID: 1875206
2026-01-27 20:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e789f5f6-1799-54e4-b180-8d8b151708dd with identifier: 1875206
2026-01-27 20:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e789f5f6-1799-54e4-b180-8d8b151708dd with scrape type 1
2026-01-27 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e789f5f6-1799-54e4-b180-8d8b151708dd
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252F4f8b3ea0e7b94e1b850838281c0badfd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/4f8b3ea0e7b94e1b850838281c0badfd/images/large/1.jpg not downloaded yet
2026-01-27 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/624/c466c678198d480b85859ea83dd4011b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/806/344c3c7923db487291ab12fef84d7bd3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:29 [ayvens.es] INFO: Found listing with ID: 1875207
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875207%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [ayvens.es] INFO: Scrape type for 1875207: 1
2026-01-27 20:03:29 [ayvens.es] INFO: Extracting data for car ID: 1875207
2026-01-27 20:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c36d84e-bb69-5730-9438-585e64c86e97 with identifier: 1875207
2026-01-27 20:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c36d84e-bb69-5730-9438-585e64c86e97 with scrape type 1
2026-01-27 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6c36d84e-bb69-5730-9438-585e64c86e97
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F986%252F70c674b7634e4a1dbbe3191cc2403c3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/986/70c674b7634e4a1dbbe3191cc2403c3d/images/large/1.jpg not downloaded yet
2026-01-27 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724c1410>
2026-01-27 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90a087f1-bb01-5566-b373-149fd3066031/90a087f1-bb01-5566-b373-149fd3066031_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252F94e12b7d941a4dabbff49c79fbf2f466%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/94e12b7d941a4dabbff49c79fbf2f466/images/large/1.jpg saved to cache
2026-01-27 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90a087f1-bb01-5566-b373-149fd3066031
2026-01-27 20:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90a087f1-bb01-5566-b373-149fd3066031, skipping ID generation
2026-01-27 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a087f1-bb01-5566-b373-149fd3066031 with scrape type 1
2026-01-27 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 90a087f1-bb01-5566-b373-149fd3066031 from tracking dictionaries
2026-01-27 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90a087f1-bb01-5566-b373-149fd3066031 sending to next pipeline
2026-01-27 20:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 90a087f1-bb01-5566-b373-149fd3066031, identifier: 1875199
2026-01-27 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/737/6575ef76e372468ab9cf10c662f67604/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:30 [ayvens.es] INFO: Found listing with ID: 1875208
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875208%27 HTTP/1.1" 200 None
2026-01-27 20:03:30 [ayvens.es] INFO: Scrape type for 1875208: 1
2026-01-27 20:03:30 [ayvens.es] INFO: Extracting data for car ID: 1875208
2026-01-27 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89ef041d-eeaa-528a-9657-a91c5c723419 with identifier: 1875208
2026-01-27 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89ef041d-eeaa-528a-9657-a91c5c723419 with scrape type 1
2026-01-27 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89ef041d-eeaa-528a-9657-a91c5c723419
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F649%252Ff98f01534e6d43e2873efd78e52c3e8d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/649/f98f01534e6d43e2873efd78e52c3e8d/images/large/1.jpg not downloaded yet
2026-01-27 20:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 90a087f1-bb01-5566-b373-149fd3066031 with identifier: 1875199
2026-01-27 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 90a087f1-bb01-5566-b373-149fd3066031 with identifier: 1875199
2026-01-27 20:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 90a087f1-bb01-5566-b373-149fd3066031 with identifier: 1875199 to the API
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/051/94e12b7d941a4dabbff49c79fbf2f466/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '90a087f1-bb01-5566-b373-149fd3066031',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 97583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90a087f1-bb01-5566-b373-149fd3066031/90a087f1-bb01-5566-b373-149fd3066031_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/051/94e12b7d941a4dabbff49c79fbf2f466/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875199%27 HTTP/1.1" 200 None
2026-01-27 20:03:30 [ayvens.es] INFO: Saving data for 1875199: {'created_time': 1769544210.903135, 'last_price_update_time': 1769544210.903149, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875199') HTTP/1.1" 204 0
2026-01-27 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/308/6ada661d551e4623aa51abb1407e37d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/897/594fe032aade45b88b079ffcb6bae8af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:30 [ayvens.es] INFO: Found listing with ID: 1875209
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875209%27 HTTP/1.1" 200 None
2026-01-27 20:03:30 [ayvens.es] INFO: Scrape type for 1875209: 1
2026-01-27 20:03:30 [ayvens.es] INFO: Extracting data for car ID: 1875209
2026-01-27 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1 with identifier: 1875209
2026-01-27 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1 with scrape type 1
2026-01-27 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F242%252Ff787a939509149ff93e7d4294f34e39c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/242/f787a939509149ff93e7d4294f34e39c/images/large/1.jpg not downloaded yet
2026-01-27 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724fbb90>
2026-01-27 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21b91c4d-e679-51c4-bb21-15ec8ce9dbd0/21b91c4d-e679-51c4-bb21-15ec8ce9dbd0_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F042%252Fbe4f9cb104704724819efc94bbeccb61%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/042/be4f9cb104704724819efc94bbeccb61/images/large/1.jpg saved to cache
2026-01-27 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0
2026-01-27 20:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0, skipping ID generation
2026-01-27 20:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0 with scrape type 1
2026-01-27 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0 from tracking dictionaries
2026-01-27 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0 sending to next pipeline
2026-01-27 20:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0, identifier: 1875198
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572352910>
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde/1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F624%252Fc466c678198d480b85859ea83dd4011b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/624/c466c678198d480b85859ea83dd4011b/images/large/1.jpg saved to cache
2026-01-27 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde
2026-01-27 20:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde, skipping ID generation
2026-01-27 20:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde with scrape type 1
2026-01-27 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde from tracking dictionaries
2026-01-27 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde sending to next pipeline
2026-01-27 20:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde, identifier: 1875197
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572269750>
2026-01-27 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77d8edfc-50fb-5ba1-8255-162c475d9198/77d8edfc-50fb-5ba1-8255-162c475d9198_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F806%252F344c3c7923db487291ab12fef84d7bd3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/806/344c3c7923db487291ab12fef84d7bd3/images/large/1.jpg saved to cache
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77d8edfc-50fb-5ba1-8255-162c475d9198
2026-01-27 20:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77d8edfc-50fb-5ba1-8255-162c475d9198, skipping ID generation
2026-01-27 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d8edfc-50fb-5ba1-8255-162c475d9198 with scrape type 1
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 77d8edfc-50fb-5ba1-8255-162c475d9198 from tracking dictionaries
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77d8edfc-50fb-5ba1-8255-162c475d9198 sending to next pipeline
2026-01-27 20:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77d8edfc-50fb-5ba1-8255-162c475d9198, identifier: 1875201
2026-01-27 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572486890>
2026-01-27 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74699351-de2c-54e8-aaac-0330de752e66/74699351-de2c-54e8-aaac-0330de752e66_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F737%252F6575ef76e372468ab9cf10c662f67604%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/737/6575ef76e372468ab9cf10c662f67604/images/large/1.jpg saved to cache
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74699351-de2c-54e8-aaac-0330de752e66
2026-01-27 20:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74699351-de2c-54e8-aaac-0330de752e66, skipping ID generation
2026-01-27 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74699351-de2c-54e8-aaac-0330de752e66 with scrape type 1
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 74699351-de2c-54e8-aaac-0330de752e66 from tracking dictionaries
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74699351-de2c-54e8-aaac-0330de752e66 sending to next pipeline
2026-01-27 20:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 74699351-de2c-54e8-aaac-0330de752e66, identifier: 1875200
2026-01-27 20:03:32 [ayvens.es] INFO: Found listing with ID: 1875210
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875210%27 HTTP/1.1" 200 None
2026-01-27 20:03:32 [ayvens.es] INFO: Scrape type for 1875210: 1
2026-01-27 20:03:32 [ayvens.es] INFO: Extracting data for car ID: 1875210
2026-01-27 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3d241ee-96e9-5dbf-8061-f76281ac571f with identifier: 1875210
2026-01-27 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d241ee-96e9-5dbf-8061-f76281ac571f with scrape type 1
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b3d241ee-96e9-5dbf-8061-f76281ac571f
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F092f170e1263495c9584bb4ac1023cb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/092f170e1263495c9584bb4ac1023cb6/images/large/1.jpg not downloaded yet
2026-01-27 20:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0 with identifier: 1875198
2026-01-27 20:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0 with identifier: 1875198
2026-01-27 20:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 21b91c4d-e679-51c4-bb21-15ec8ce9dbd0 with identifier: 1875198 to the API
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/042/be4f9cb104704724819efc94bbeccb61/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '21b91c4d-e679-51c4-bb21-15ec8ce9dbd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 110684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21b91c4d-e679-51c4-bb21-15ec8ce9dbd0/21b91c4d-e679-51c4-bb21-15ec8ce9dbd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/042/be4f9cb104704724819efc94bbeccb61/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875198%27 HTTP/1.1" 200 None
2026-01-27 20:03:33 [ayvens.es] INFO: Saving data for 1875198: {'created_time': 1769544213.359889, 'last_price_update_time': 1769544213.359898, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875198') HTTP/1.1" 204 0
2026-01-27 20:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde with identifier: 1875197
2026-01-27 20:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde with identifier: 1875197
2026-01-27 20:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde with identifier: 1875197 to the API
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/624/c466c678198d480b85859ea83dd4011b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 109458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde/1dc52fc4-5dcb-5e5d-b7d2-4a65eed67cde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/624/c466c678198d480b85859ea83dd4011b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 66kW (90CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 66kW (90CV) -18',
 'vin': None,
 'year': 2018}
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875197%27 HTTP/1.1" 200 None
2026-01-27 20:03:33 [ayvens.es] INFO: Saving data for 1875197: {'created_time': 1769544213.749871, 'last_price_update_time': 1769544213.749885, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875197') HTTP/1.1" 204 0
2026-01-27 20:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77d8edfc-50fb-5ba1-8255-162c475d9198 with identifier: 1875201
2026-01-27 20:03:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77d8edfc-50fb-5ba1-8255-162c475d9198 with identifier: 1875201
2026-01-27 20:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77d8edfc-50fb-5ba1-8255-162c475d9198 with identifier: 1875201 to the API
2026-01-27 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/806/344c3c7923db487291ab12fef84d7bd3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Esmerald',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '77d8edfc-50fb-5ba1-8255-162c475d9198',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 116167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77d8edfc-50fb-5ba1-8255-162c475d9198/77d8edfc-50fb-5ba1-8255-162c475d9198_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/806/344c3c7923db487291ab12fef84d7bd3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 GT Line 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'GT Line 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875201%27 HTTP/1.1" 200 None
2026-01-27 20:03:34 [ayvens.es] INFO: Saving data for 1875201: {'created_time': 1769544214.177791, 'last_price_update_time': 1769544214.177804, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875201') HTTP/1.1" 204 0
2026-01-27 20:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 74699351-de2c-54e8-aaac-0330de752e66 with identifier: 1875200
2026-01-27 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 74699351-de2c-54e8-aaac-0330de752e66 with identifier: 1875200
2026-01-27 20:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 74699351-de2c-54e8-aaac-0330de752e66 with identifier: 1875200 to the API
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/737/6575ef76e372468ab9cf10c662f67604/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '74699351-de2c-54e8-aaac-0330de752e66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-30',
 'odometer': 54181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74699351-de2c-54e8-aaac-0330de752e66/74699351-de2c-54e8-aaac-0330de752e66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/737/6575ef76e372468ab9cf10c662f67604/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-30 e-SKYACTIV G MHEV 90kW Prime-line',
 'transmission': 'manual',
 'trim': 'e-SKYACTIV G MHEV 90kW Prime-line',
 'vin': None,
 'year': 2023}
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875200%27 HTTP/1.1" 200 None
2026-01-27 20:03:34 [ayvens.es] INFO: Saving data for 1875200: {'created_time': 1769544214.554219, 'last_price_update_time': 1769544214.554229, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875200') HTTP/1.1" 204 0
2026-01-27 20:03:34 [ayvens.es] INFO: Found listing with ID: 1875211
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875211%27 HTTP/1.1" 200 None
2026-01-27 20:03:34 [ayvens.es] INFO: Scrape type for 1875211: 1
2026-01-27 20:03:34 [ayvens.es] INFO: Extracting data for car ID: 1875211
2026-01-27 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b96c381f-5616-51a8-8adf-1fe52b3cd67a with identifier: 1875211
2026-01-27 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b96c381f-5616-51a8-8adf-1fe52b3cd67a with scrape type 1
2026-01-27 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b96c381f-5616-51a8-8adf-1fe52b3cd67a
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252F05364c9622784edf84a3977889ab2c1d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/05364c9622784edf84a3977889ab2c1d/images/large/1.jpg not downloaded yet
2026-01-27 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5727a0790>
2026-01-27 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b718177c-96bc-51c4-b5b5-2900d52fe3dc/b718177c-96bc-51c4-b5b5-2900d52fe3dc_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F6ada661d551e4623aa51abb1407e37d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/6ada661d551e4623aa51abb1407e37d1/images/large/1.jpg saved to cache
2026-01-27 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b718177c-96bc-51c4-b5b5-2900d52fe3dc
2026-01-27 20:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b718177c-96bc-51c4-b5b5-2900d52fe3dc, skipping ID generation
2026-01-27 20:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b718177c-96bc-51c4-b5b5-2900d52fe3dc with scrape type 1
2026-01-27 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b718177c-96bc-51c4-b5b5-2900d52fe3dc from tracking dictionaries
2026-01-27 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b718177c-96bc-51c4-b5b5-2900d52fe3dc sending to next pipeline
2026-01-27 20:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b718177c-96bc-51c4-b5b5-2900d52fe3dc, identifier: 1875196
2026-01-27 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5727a1e10>
2026-01-27 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c097d-0397-5af3-95e9-ddfb2556fe5c/fa2c097d-0397-5af3-95e9-ddfb2556fe5c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F594fe032aade45b88b079ffcb6bae8af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/594fe032aade45b88b079ffcb6bae8af/images/large/1.jpg saved to cache
2026-01-27 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa2c097d-0397-5af3-95e9-ddfb2556fe5c
2026-01-27 20:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa2c097d-0397-5af3-95e9-ddfb2556fe5c, skipping ID generation
2026-01-27 20:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2c097d-0397-5af3-95e9-ddfb2556fe5c with scrape type 1
2026-01-27 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fa2c097d-0397-5af3-95e9-ddfb2556fe5c from tracking dictionaries
2026-01-27 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa2c097d-0397-5af3-95e9-ddfb2556fe5c sending to next pipeline
2026-01-27 20:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fa2c097d-0397-5af3-95e9-ddfb2556fe5c, identifier: 1875202
2026-01-27 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/407/874197423fb443358afbff658d668dac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b718177c-96bc-51c4-b5b5-2900d52fe3dc with identifier: 1875196
2026-01-27 20:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b718177c-96bc-51c4-b5b5-2900d52fe3dc with identifier: 1875196
2026-01-27 20:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b718177c-96bc-51c4-b5b5-2900d52fe3dc with identifier: 1875196 to the API
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/308/6ada661d551e4623aa51abb1407e37d1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b718177c-96bc-51c4-b5b5-2900d52fe3dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 46588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b718177c-96bc-51c4-b5b5-2900d52fe3dc/b718177c-96bc-51c4-b5b5-2900d52fe3dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/6ada661d551e4623aa51abb1407e37d1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF R-Line 1.5 eTSI 110kW(150CV) DSG Variant',
 'transmission': 'manual',
 'trim': 'R-Line 1.5 eTSI 110kW(150CV) DSG Variant',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875196%27 HTTP/1.1" 200 None
2026-01-27 20:03:35 [ayvens.es] INFO: Saving data for 1875196: {'created_time': 1769544215.9094, 'last_price_update_time': 1769544215.909413, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875196') HTTP/1.1" 204 0
2026-01-27 20:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fa2c097d-0397-5af3-95e9-ddfb2556fe5c with identifier: 1875202
2026-01-27 20:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fa2c097d-0397-5af3-95e9-ddfb2556fe5c with identifier: 1875202
2026-01-27 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172484 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172484
2026-01-27 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fa2c097d-0397-5af3-95e9-ddfb2556fe5c spider: ayvens.es
2026-01-27 20:03:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: fa2c097d-0397-5af3-95e9-ddfb2556fe5c due to rule: high_mileage_for_country.json, error: 172484 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172484
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fa2c097d-0397-5af3-95e9-ddfb2556fe5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 172484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c097d-0397-5af3-95e9-ddfb2556fe5c/fa2c097d-0397-5af3-95e9-ddfb2556fe5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/897/594fe032aade45b88b079ffcb6bae8af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 2.0 TDI 110kW (150 CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150 CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875202%27 HTTP/1.1" 200 None
2026-01-27 20:03:36 [ayvens.es] INFO: Saving data for 1875202: {'created_time': 1769544216.158243, 'last_price_update_time': 1769544216.158256, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875202') HTTP/1.1" 204 0
2026-01-27 20:03:36 [ayvens.es] INFO: Found listing with ID: 1875212
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875212%27 HTTP/1.1" 200 None
2026-01-27 20:03:36 [ayvens.es] INFO: Scrape type for 1875212: 1
2026-01-27 20:03:36 [ayvens.es] INFO: Extracting data for car ID: 1875212
2026-01-27 20:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e406910f-2e91-56a7-a6f8-6977256653ef with identifier: 1875212
2026-01-27 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e406910f-2e91-56a7-a6f8-6977256653ef with scrape type 1
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e406910f-2e91-56a7-a6f8-6977256653ef
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F44a4fe338fdc45bc8b8ede1966271437%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/44a4fe338fdc45bc8b8ede1966271437/images/large/1.jpg not downloaded yet
2026-01-27 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/464/a6deb3a2349941cd8d5f9e3a83f62606/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/986/70c674b7634e4a1dbbe3191cc2403c3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:36 [ayvens.es] INFO: Found listing with ID: 1875213
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875213%27 HTTP/1.1" 200 None
2026-01-27 20:03:36 [ayvens.es] INFO: Scrape type for 1875213: 1
2026-01-27 20:03:36 [ayvens.es] INFO: Extracting data for car ID: 1875213
2026-01-27 20:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa74d26e-d4fe-531b-b426-9a50de4e577d with identifier: 1875213
2026-01-27 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa74d26e-d4fe-531b-b426-9a50de4e577d with scrape type 1
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aa74d26e-d4fe-531b-b426-9a50de4e577d
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F242%252Fd0738df11c8d40c6a00248953d01cb8f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/242/d0738df11c8d40c6a00248953d01cb8f/images/large/1.jpg not downloaded yet
2026-01-27 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/488/c11b2b172d5c417d8e83effaab359fac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572136210>
2026-01-27 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e860bea-cdb6-5373-914d-87df8adff03c/9e860bea-cdb6-5373-914d-87df8adff03c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F407%252F874197423fb443358afbff658d668dac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/407/874197423fb443358afbff658d668dac/images/large/1.jpg saved to cache
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e860bea-cdb6-5373-914d-87df8adff03c
2026-01-27 20:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e860bea-cdb6-5373-914d-87df8adff03c, skipping ID generation
2026-01-27 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e860bea-cdb6-5373-914d-87df8adff03c with scrape type 1
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9e860bea-cdb6-5373-914d-87df8adff03c from tracking dictionaries
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e860bea-cdb6-5373-914d-87df8adff03c sending to next pipeline
2026-01-27 20:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9e860bea-cdb6-5373-914d-87df8adff03c, identifier: 1875203
2026-01-27 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/056/4f8b3ea0e7b94e1b850838281c0badfd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:36 [ayvens.es] INFO: Found listing with ID: 1875214
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875214%27 HTTP/1.1" 200 None
2026-01-27 20:03:36 [ayvens.es] INFO: Scrape type for 1875214: 1
2026-01-27 20:03:36 [ayvens.es] INFO: Extracting data for car ID: 1875214
2026-01-27 20:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b87aef8-9e9c-530f-bac6-fc5f775d7950 with identifier: 1875214
2026-01-27 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b87aef8-9e9c-530f-bac6-fc5f775d7950 with scrape type 1
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7b87aef8-9e9c-530f-bac6-fc5f775d7950
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F016%252Ff9d4cba30c264c4a8d09c46ef8cb4c90%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/016/f9d4cba30c264c4a8d09c46ef8cb4c90/images/large/1.jpg not downloaded yet
2026-01-27 20:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9e860bea-cdb6-5373-914d-87df8adff03c with identifier: 1875203
2026-01-27 20:03:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9e860bea-cdb6-5373-914d-87df8adff03c with identifier: 1875203
2026-01-27 20:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9e860bea-cdb6-5373-914d-87df8adff03c with identifier: 1875203 to the API
2026-01-27 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/407/874197423fb443358afbff658d668dac/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Snow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9e860bea-cdb6-5373-914d-87df8adff03c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SORENTO',
 'odometer': 87047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e860bea-cdb6-5373-914d-87df8adff03c/9e860bea-cdb6-5373-914d-87df8adff03c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/407/874197423fb443358afbff658d668dac/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'KIA SORENTO 2.2 CRDi Emotion DCT 4x2 7pl (P.Luxury)',
 'transmission': 'manual',
 'trim': '2.2 CRDi Emotion DCT 4x2 7pl (P.Luxury)',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875203%27 HTTP/1.1" 200 None
2026-01-27 20:03:37 [ayvens.es] INFO: Saving data for 1875203: {'created_time': 1769544217.19163, 'last_price_update_time': 1769544217.191641, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875203') HTTP/1.1" 204 0
2026-01-27 20:03:37 [ayvens.es] INFO: Found listing with ID: 1875215
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875215%27 HTTP/1.1" 200 None
2026-01-27 20:03:37 [ayvens.es] INFO: Scrape type for 1875215: 1
2026-01-27 20:03:37 [ayvens.es] INFO: Extracting data for car ID: 1875215
2026-01-27 20:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc18567-4d69-58d4-9e00-09fc9d8982c8 with identifier: 1875215
2026-01-27 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc18567-4d69-58d4-9e00-09fc9d8982c8 with scrape type 1
2026-01-27 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5fc18567-4d69-58d4-9e00-09fc9d8982c8
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F345%252F46065b3c9a1c4dbbb33f61d3667945dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/345/46065b3c9a1c4dbbb33f61d3667945dc/images/large/1.jpg not downloaded yet
2026-01-27 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/242/f787a939509149ff93e7d4294f34e39c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/649/f98f01534e6d43e2873efd78e52c3e8d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d8fd0>
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f11ccbc-c8db-5b14-ac35-ff8db60336fb/0f11ccbc-c8db-5b14-ac35-ff8db60336fb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F464%252Fa6deb3a2349941cd8d5f9e3a83f62606%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/464/a6deb3a2349941cd8d5f9e3a83f62606/images/large/1.jpg saved to cache
2026-01-27 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f11ccbc-c8db-5b14-ac35-ff8db60336fb
2026-01-27 20:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f11ccbc-c8db-5b14-ac35-ff8db60336fb, skipping ID generation
2026-01-27 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f11ccbc-c8db-5b14-ac35-ff8db60336fb with scrape type 1
2026-01-27 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0f11ccbc-c8db-5b14-ac35-ff8db60336fb from tracking dictionaries
2026-01-27 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f11ccbc-c8db-5b14-ac35-ff8db60336fb sending to next pipeline
2026-01-27 20:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f11ccbc-c8db-5b14-ac35-ff8db60336fb, identifier: 1875205
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f79110>
2026-01-27 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c36d84e-bb69-5730-9438-585e64c86e97/6c36d84e-bb69-5730-9438-585e64c86e97_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F986%252F70c674b7634e4a1dbbe3191cc2403c3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/986/70c674b7634e4a1dbbe3191cc2403c3d/images/large/1.jpg saved to cache
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c36d84e-bb69-5730-9438-585e64c86e97
2026-01-27 20:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c36d84e-bb69-5730-9438-585e64c86e97, skipping ID generation
2026-01-27 20:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c36d84e-bb69-5730-9438-585e64c86e97 with scrape type 1
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6c36d84e-bb69-5730-9438-585e64c86e97 from tracking dictionaries
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c36d84e-bb69-5730-9438-585e64c86e97 sending to next pipeline
2026-01-27 20:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6c36d84e-bb69-5730-9438-585e64c86e97, identifier: 1875207
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721ab4d0>
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d1c2f0-cc11-5c3d-a962-1478da2452c0/c3d1c2f0-cc11-5c3d-a962-1478da2452c0_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F488%252Fc11b2b172d5c417d8e83effaab359fac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/488/c11b2b172d5c417d8e83effaab359fac/images/large/1.jpg saved to cache
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3d1c2f0-cc11-5c3d-a962-1478da2452c0
2026-01-27 20:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3d1c2f0-cc11-5c3d-a962-1478da2452c0, skipping ID generation
2026-01-27 20:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d1c2f0-cc11-5c3d-a962-1478da2452c0 with scrape type 1
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c3d1c2f0-cc11-5c3d-a962-1478da2452c0 from tracking dictionaries
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3d1c2f0-cc11-5c3d-a962-1478da2452c0 sending to next pipeline
2026-01-27 20:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3d1c2f0-cc11-5c3d-a962-1478da2452c0, identifier: 1875204
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a8e590>
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e789f5f6-1799-54e4-b180-8d8b151708dd/e789f5f6-1799-54e4-b180-8d8b151708dd_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252F4f8b3ea0e7b94e1b850838281c0badfd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/4f8b3ea0e7b94e1b850838281c0badfd/images/large/1.jpg saved to cache
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e789f5f6-1799-54e4-b180-8d8b151708dd
2026-01-27 20:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e789f5f6-1799-54e4-b180-8d8b151708dd, skipping ID generation
2026-01-27 20:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e789f5f6-1799-54e4-b180-8d8b151708dd with scrape type 1
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e789f5f6-1799-54e4-b180-8d8b151708dd from tracking dictionaries
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e789f5f6-1799-54e4-b180-8d8b151708dd sending to next pipeline
2026-01-27 20:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e789f5f6-1799-54e4-b180-8d8b151708dd, identifier: 1875206
2026-01-27 20:03:38 [ayvens.es] INFO: Found listing with ID: 1875216
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875216%27 HTTP/1.1" 200 None
2026-01-27 20:03:38 [ayvens.es] INFO: Scrape type for 1875216: 1
2026-01-27 20:03:38 [ayvens.es] INFO: Extracting data for car ID: 1875216
2026-01-27 20:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ded0bfe3-a350-55fc-b2f6-cbf548e1f7df with identifier: 1875216
2026-01-27 20:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ded0bfe3-a350-55fc-b2f6-cbf548e1f7df with scrape type 1
2026-01-27 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ded0bfe3-a350-55fc-b2f6-cbf548e1f7df
2026-01-27 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F374%252F5e10672d352e4702be2fab392a0f7481%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/374/5e10672d352e4702be2fab392a0f7481/images/large/1.jpg not downloaded yet
2026-01-27 20:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f11ccbc-c8db-5b14-ac35-ff8db60336fb with identifier: 1875205
2026-01-27 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f11ccbc-c8db-5b14-ac35-ff8db60336fb with identifier: 1875205
2026-01-27 20:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0f11ccbc-c8db-5b14-ac35-ff8db60336fb with identifier: 1875205 to the API
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/464/a6deb3a2349941cd8d5f9e3a83f62606/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f11ccbc-c8db-5b14-ac35-ff8db60336fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 42898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f11ccbc-c8db-5b14-ac35-ff8db60336fb/0f11ccbc-c8db-5b14-ac35-ff8db60336fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/464/a6deb3a2349941cd8d5f9e3a83f62606/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Equilibre Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875205%27 HTTP/1.1" 200 None
2026-01-27 20:03:39 [ayvens.es] INFO: Saving data for 1875205: {'created_time': 1769544219.530678, 'last_price_update_time': 1769544219.530692, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875205') HTTP/1.1" 204 0
2026-01-27 20:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6c36d84e-bb69-5730-9438-585e64c86e97 with identifier: 1875207
2026-01-27 20:03:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6c36d84e-bb69-5730-9438-585e64c86e97 with identifier: 1875207
2026-01-27 20:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6c36d84e-bb69-5730-9438-585e64c86e97 with identifier: 1875207 to the API
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/986/70c674b7634e4a1dbbe3191cc2403c3d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Narvik',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6c36d84e-bb69-5730-9438-585e64c86e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 128440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c36d84e-bb69-5730-9438-585e64c86e97/6c36d84e-bb69-5730-9438-585e64c86e97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/986/70c674b7634e4a1dbbe3191cc2403c3d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0D 110kW S 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0D 110kW S 4WD Auto',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875207%27 HTTP/1.1" 200 None
2026-01-27 20:03:39 [ayvens.es] INFO: Saving data for 1875207: {'created_time': 1769544219.955783, 'last_price_update_time': 1769544219.955795, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875207') HTTP/1.1" 204 0
2026-01-27 20:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3d1c2f0-cc11-5c3d-a962-1478da2452c0 with identifier: 1875204
2026-01-27 20:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3d1c2f0-cc11-5c3d-a962-1478da2452c0 with identifier: 1875204
2026-01-27 20:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3d1c2f0-cc11-5c3d-a962-1478da2452c0 with identifier: 1875204 to the API
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/488/c11b2b172d5c417d8e83effaab359fac/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c3d1c2f0-cc11-5c3d-a962-1478da2452c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 65859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d1c2f0-cc11-5c3d-a962-1478da2452c0/c3d1c2f0-cc11-5c3d-a962-1478da2452c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/488/c11b2b172d5c417d8e83effaab359fac/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT Shooting Brake',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT Shooting Brake',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875204%27 HTTP/1.1" 200 None
2026-01-27 20:03:40 [ayvens.es] INFO: Saving data for 1875204: {'created_time': 1769544220.394146, 'last_price_update_time': 1769544220.394158, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875204') HTTP/1.1" 204 0
2026-01-27 20:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e789f5f6-1799-54e4-b180-8d8b151708dd with identifier: 1875206
2026-01-27 20:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e789f5f6-1799-54e4-b180-8d8b151708dd with identifier: 1875206
2026-01-27 20:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e789f5f6-1799-54e4-b180-8d8b151708dd with identifier: 1875206 to the API
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/056/4f8b3ea0e7b94e1b850838281c0badfd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e789f5f6-1799-54e4-b180-8d8b151708dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 75890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e789f5f6-1799-54e4-b180-8d8b151708dd/e789f5f6-1799-54e4-b180-8d8b151708dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/4f8b3ea0e7b94e1b850838281c0badfd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 200 D DCT Shooting Brake',
 'transmission': 'manual',
 'trim': 'CLA 200 D DCT Shooting Brake',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875206%27 HTTP/1.1" 200 None
2026-01-27 20:03:40 [ayvens.es] INFO: Saving data for 1875206: {'created_time': 1769544220.830087, 'last_price_update_time': 1769544220.830102, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875206') HTTP/1.1" 204 0
2026-01-27 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/057/092f170e1263495c9584bb4ac1023cb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:40 [ayvens.es] INFO: Found listing with ID: 1875217
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875217%27 HTTP/1.1" 200 None
2026-01-27 20:03:40 [ayvens.es] INFO: Scrape type for 1875217: 1
2026-01-27 20:03:40 [ayvens.es] INFO: Extracting data for car ID: 1875217
2026-01-27 20:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40520264-2aab-57a4-ba6a-e1dc8d471f71 with identifier: 1875217
2026-01-27 20:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40520264-2aab-57a4-ba6a-e1dc8d471f71 with scrape type 1
2026-01-27 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 40520264-2aab-57a4-ba6a-e1dc8d471f71
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F842%252F4b32a602ed73464981b39211fc61f5e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/842/4b32a602ed73464981b39211fc61f5e4/images/large/1.jpg not downloaded yet
2026-01-27 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572128d10>
2026-01-27 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccd9cb-7c78-5a10-8180-22ad4fdd13b1/73ccd9cb-7c78-5a10-8180-22ad4fdd13b1_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F242%252Ff787a939509149ff93e7d4294f34e39c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/242/f787a939509149ff93e7d4294f34e39c/images/large/1.jpg saved to cache
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1
2026-01-27 20:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1, skipping ID generation
2026-01-27 20:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1 with scrape type 1
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1 from tracking dictionaries
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1 sending to next pipeline
2026-01-27 20:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1, identifier: 1875209
2026-01-27 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b23d90>
2026-01-27 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89ef041d-eeaa-528a-9657-a91c5c723419/89ef041d-eeaa-528a-9657-a91c5c723419_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F649%252Ff98f01534e6d43e2873efd78e52c3e8d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/649/f98f01534e6d43e2873efd78e52c3e8d/images/large/1.jpg saved to cache
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89ef041d-eeaa-528a-9657-a91c5c723419
2026-01-27 20:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89ef041d-eeaa-528a-9657-a91c5c723419, skipping ID generation
2026-01-27 20:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89ef041d-eeaa-528a-9657-a91c5c723419 with scrape type 1
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 89ef041d-eeaa-528a-9657-a91c5c723419 from tracking dictionaries
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89ef041d-eeaa-528a-9657-a91c5c723419 sending to next pipeline
2026-01-27 20:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89ef041d-eeaa-528a-9657-a91c5c723419, identifier: 1875208
2026-01-27 20:03:41 [ayvens.es] INFO: Found listing with ID: 1875218
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875218%27 HTTP/1.1" 200 None
2026-01-27 20:03:41 [ayvens.es] INFO: Scrape type for 1875218: 1
2026-01-27 20:03:41 [ayvens.es] INFO: Extracting data for car ID: 1875218
2026-01-27 20:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 736eb3e0-cadc-5453-b5ce-80d49b08745f with identifier: 1875218
2026-01-27 20:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 736eb3e0-cadc-5453-b5ce-80d49b08745f with scrape type 1
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 736eb3e0-cadc-5453-b5ce-80d49b08745f
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F288%252F856f582128114edcb91030ac9249c2bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/288/856f582128114edcb91030ac9249c2bd/images/large/1.jpg not downloaded yet
2026-01-27 20:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1 with identifier: 1875209
2026-01-27 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1 with identifier: 1875209
2026-01-27 20:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 73ccd9cb-7c78-5a10-8180-22ad4fdd13b1 with identifier: 1875209 to the API
2026-01-27 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/242/f787a939509149ff93e7d4294f34e39c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '73ccd9cb-7c78-5a10-8180-22ad4fdd13b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 36223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccd9cb-7c78-5a10-8180-22ad4fdd13b1/73ccd9cb-7c78-5a10-8180-22ad4fdd13b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/242/f787a939509149ff93e7d4294f34e39c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H STYLE E-CVT TOURING SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H STYLE E-CVT TOURING SPORT',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875209%27 HTTP/1.1" 200 None
2026-01-27 20:03:42 [ayvens.es] INFO: Saving data for 1875209: {'created_time': 1769544222.150748, 'last_price_update_time': 1769544222.150761, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875209') HTTP/1.1" 204 0
2026-01-27 20:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89ef041d-eeaa-528a-9657-a91c5c723419 with identifier: 1875208
2026-01-27 20:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89ef041d-eeaa-528a-9657-a91c5c723419 with identifier: 1875208
2026-01-27 20:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89ef041d-eeaa-528a-9657-a91c5c723419 with identifier: 1875208 to the API
2026-01-27 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/649/f98f01534e6d43e2873efd78e52c3e8d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89ef041d-eeaa-528a-9657-a91c5c723419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 93134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ef041d-eeaa-528a-9657-a91c5c723419/89ef041d-eeaa-528a-9657-a91c5c723419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/649/f98f01534e6d43e2873efd78e52c3e8d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875208%27 HTTP/1.1" 200 None
2026-01-27 20:03:43 [ayvens.es] INFO: Saving data for 1875208: {'created_time': 1769544223.058536, 'last_price_update_time': 1769544223.058547, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875208') HTTP/1.1" 204 0
2026-01-27 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/44a4fe338fdc45bc8b8ede1966271437/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/177/05364c9622784edf84a3977889ab2c1d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/016/f9d4cba30c264c4a8d09c46ef8cb4c90/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:43 [ayvens.es] INFO: Found listing with ID: 1875219
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875219%27 HTTP/1.1" 200 None
2026-01-27 20:03:43 [ayvens.es] INFO: Scrape type for 1875219: 1
2026-01-27 20:03:43 [ayvens.es] INFO: Extracting data for car ID: 1875219
2026-01-27 20:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c8be0c8-134c-5438-b6f8-2596d1799e2c with identifier: 1875219
2026-01-27 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c8be0c8-134c-5438-b6f8-2596d1799e2c with scrape type 1
2026-01-27 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5c8be0c8-134c-5438-b6f8-2596d1799e2c
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252F03f4a66d52d5456d850a177d93d8899c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/03f4a66d52d5456d850a177d93d8899c/images/large/1.jpg not downloaded yet
2026-01-27 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d19d0>
2026-01-27 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3d241ee-96e9-5dbf-8061-f76281ac571f/b3d241ee-96e9-5dbf-8061-f76281ac571f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F092f170e1263495c9584bb4ac1023cb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/092f170e1263495c9584bb4ac1023cb6/images/large/1.jpg saved to cache
2026-01-27 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3d241ee-96e9-5dbf-8061-f76281ac571f
2026-01-27 20:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3d241ee-96e9-5dbf-8061-f76281ac571f, skipping ID generation
2026-01-27 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d241ee-96e9-5dbf-8061-f76281ac571f with scrape type 1
2026-01-27 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b3d241ee-96e9-5dbf-8061-f76281ac571f from tracking dictionaries
2026-01-27 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3d241ee-96e9-5dbf-8061-f76281ac571f sending to next pipeline
2026-01-27 20:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b3d241ee-96e9-5dbf-8061-f76281ac571f, identifier: 1875210
2026-01-27 20:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b3d241ee-96e9-5dbf-8061-f76281ac571f with identifier: 1875210
2026-01-27 20:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b3d241ee-96e9-5dbf-8061-f76281ac571f with identifier: 1875210
2026-01-27 20:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b3d241ee-96e9-5dbf-8061-f76281ac571f with identifier: 1875210 to the API
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/057/092f170e1263495c9584bb4ac1023cb6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3d241ee-96e9-5dbf-8061-f76281ac571f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 65756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3d241ee-96e9-5dbf-8061-f76281ac571f/b3d241ee-96e9-5dbf-8061-f76281ac571f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/057/092f170e1263495c9584bb4ac1023cb6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK BlueHDi 96 kW Auto SO CHIC',
 'transmission': 'manual',
 'trim': 'BlueHDi 96 kW Auto SO CHIC',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875210%27 HTTP/1.1" 200 None
2026-01-27 20:03:44 [ayvens.es] INFO: Saving data for 1875210: {'created_time': 1769544224.054251, 'last_price_update_time': 1769544224.054264, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875210') HTTP/1.1" 204 0
2026-01-27 20:03:44 [ayvens.es] INFO: Found listing with ID: 1875220
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875220%27 HTTP/1.1" 200 None
2026-01-27 20:03:44 [ayvens.es] INFO: Scrape type for 1875220: 1
2026-01-27 20:03:44 [ayvens.es] INFO: Extracting data for car ID: 1875220
2026-01-27 20:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b4cb5b-3173-58cf-898d-ff4851f37121 with identifier: 1875220
2026-01-27 20:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b4cb5b-3173-58cf-898d-ff4851f37121 with scrape type 1
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 56b4cb5b-3173-58cf-898d-ff4851f37121
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F884%252F93b4b38a08cd40a1b52f94edeacf2178%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/884/93b4b38a08cd40a1b52f94edeacf2178/images/large/1.jpg not downloaded yet
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722af8d0>
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e406910f-2e91-56a7-a6f8-6977256653ef/e406910f-2e91-56a7-a6f8-6977256653ef_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F44a4fe338fdc45bc8b8ede1966271437%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/44a4fe338fdc45bc8b8ede1966271437/images/large/1.jpg saved to cache
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e406910f-2e91-56a7-a6f8-6977256653ef
2026-01-27 20:03:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e406910f-2e91-56a7-a6f8-6977256653ef, skipping ID generation
2026-01-27 20:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e406910f-2e91-56a7-a6f8-6977256653ef with scrape type 1
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e406910f-2e91-56a7-a6f8-6977256653ef from tracking dictionaries
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e406910f-2e91-56a7-a6f8-6977256653ef sending to next pipeline
2026-01-27 20:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e406910f-2e91-56a7-a6f8-6977256653ef, identifier: 1875212
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725afad0>
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b96c381f-5616-51a8-8adf-1fe52b3cd67a/b96c381f-5616-51a8-8adf-1fe52b3cd67a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252F05364c9622784edf84a3977889ab2c1d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/05364c9622784edf84a3977889ab2c1d/images/large/1.jpg saved to cache
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b96c381f-5616-51a8-8adf-1fe52b3cd67a
2026-01-27 20:03:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b96c381f-5616-51a8-8adf-1fe52b3cd67a, skipping ID generation
2026-01-27 20:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b96c381f-5616-51a8-8adf-1fe52b3cd67a with scrape type 1
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b96c381f-5616-51a8-8adf-1fe52b3cd67a from tracking dictionaries
2026-01-27 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b96c381f-5616-51a8-8adf-1fe52b3cd67a sending to next pipeline
2026-01-27 20:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b96c381f-5616-51a8-8adf-1fe52b3cd67a, identifier: 1875211
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725b5290>
2026-01-27 20:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b87aef8-9e9c-530f-bac6-fc5f775d7950/7b87aef8-9e9c-530f-bac6-fc5f775d7950_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F016%252Ff9d4cba30c264c4a8d09c46ef8cb4c90%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/016/f9d4cba30c264c4a8d09c46ef8cb4c90/images/large/1.jpg saved to cache
2026-01-27 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b87aef8-9e9c-530f-bac6-fc5f775d7950
2026-01-27 20:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b87aef8-9e9c-530f-bac6-fc5f775d7950, skipping ID generation
2026-01-27 20:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b87aef8-9e9c-530f-bac6-fc5f775d7950 with scrape type 1
2026-01-27 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7b87aef8-9e9c-530f-bac6-fc5f775d7950 from tracking dictionaries
2026-01-27 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b87aef8-9e9c-530f-bac6-fc5f775d7950 sending to next pipeline
2026-01-27 20:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7b87aef8-9e9c-530f-bac6-fc5f775d7950, identifier: 1875214
2026-01-27 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/242/d0738df11c8d40c6a00248953d01cb8f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:45 [ayvens.es] INFO: Found listing with ID: 1875221
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875221%27 HTTP/1.1" 200 None
2026-01-27 20:03:45 [ayvens.es] INFO: Scrape type for 1875221: 1
2026-01-27 20:03:45 [ayvens.es] INFO: Extracting data for car ID: 1875221
2026-01-27 20:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 866fa207-e0b4-53d9-a5b9-3f73cef15294 with identifier: 1875221
2026-01-27 20:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 866fa207-e0b4-53d9-a5b9-3f73cef15294 with scrape type 1
2026-01-27 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 866fa207-e0b4-53d9-a5b9-3f73cef15294
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F555%252F38e4282e75164026984d8abf3dc157c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/555/38e4282e75164026984d8abf3dc157c6/images/large/1.jpg not downloaded yet
2026-01-27 20:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e406910f-2e91-56a7-a6f8-6977256653ef with identifier: 1875212
2026-01-27 20:03:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e406910f-2e91-56a7-a6f8-6977256653ef with identifier: 1875212
2026-01-27 20:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e406910f-2e91-56a7-a6f8-6977256653ef with identifier: 1875212 to the API
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/735/44a4fe338fdc45bc8b8ede1966271437/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e406910f-2e91-56a7-a6f8-6977256653ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 40426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e406910f-2e91-56a7-a6f8-6977256653ef/e406910f-2e91-56a7-a6f8-6977256653ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/44a4fe338fdc45bc8b8ede1966271437/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A1 Sportback Adrenalin 30 TFSI 81kW S tron',
 'transmission': 'manual',
 'trim': 'Sportback Adrenalin 30 TFSI 81kW S tron',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875212%27 HTTP/1.1" 200 None
2026-01-27 20:03:45 [ayvens.es] INFO: Saving data for 1875212: {'created_time': 1769544225.75005, 'last_price_update_time': 1769544225.750062, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875212') HTTP/1.1" 204 0
2026-01-27 20:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b96c381f-5616-51a8-8adf-1fe52b3cd67a with identifier: 1875211
2026-01-27 20:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b96c381f-5616-51a8-8adf-1fe52b3cd67a with identifier: 1875211
2026-01-27 20:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b96c381f-5616-51a8-8adf-1fe52b3cd67a with identifier: 1875211 to the API
2026-01-27 20:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/177/05364c9622784edf84a3977889ab2c1d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b96c381f-5616-51a8-8adf-1fe52b3cd67a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 75222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b96c381f-5616-51a8-8adf-1fe52b3cd67a/b96c381f-5616-51a8-8adf-1fe52b3cd67a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/177/05364c9622784edf84a3977889ab2c1d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Life 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875211%27 HTTP/1.1" 200 None
2026-01-27 20:03:46 [ayvens.es] INFO: Saving data for 1875211: {'created_time': 1769544226.147889, 'last_price_update_time': 1769544226.147902, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875211') HTTP/1.1" 204 0
2026-01-27 20:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7b87aef8-9e9c-530f-bac6-fc5f775d7950 with identifier: 1875214
2026-01-27 20:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7b87aef8-9e9c-530f-bac6-fc5f775d7950 with identifier: 1875214
2026-01-27 20:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'azul', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'focus', 'trim': '1.5 ecoblue 88kw titanium auto sportb.', 'title': 'ford focus 1.5 ecoblue 88kw titanium auto sportb.', 'price': 0, 'odometer': 210155, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-17', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 115, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '7b87aef8-9e9c-530f-bac6-fc5f775d7950', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b87aef8-9e9c-530f-bac6-fc5f775d7950/7b87aef8-9e9c-530f-bac6-fc5f775d7950_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/016/f9d4cba30c264c4a8d09c46ef8cb4c90/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 304361}], 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'ford focus', 'sanitized_make': 'ford', 'odometer_in_km': 210155}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'color': 'azul',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '7b87aef8-9e9c-530f-bac6-fc5f775d7950',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford focus',
     'model': 'focus',
     'odometer': 210155,
     'odometer_in_km': 210155,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b87aef8-9e9c-530f-bac6-fc5f775d7950/7b87aef8-9e9c-530f-bac6-fc5f775d7950_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 304361,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/016/f9d4cba30c264c4a8d09c46ef8cb4c90/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-12-17',
     'sanitized_make': 'ford',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ford focus 1.5 ecoblue 88kw titanium auto sportb.',
     'transmission': 'manual',
     'trim': '1.5 ecoblue 88kw titanium auto sportb.',
     'vin': None,
     'year': 2019}
2026-01-27 20:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 7b87aef8-9e9c-530f-bac6-fc5f775d7950 spider: ayvens.es
2026-01-27 20:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7b87aef8-9e9c-530f-bac6-fc5f775d7950 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'azul', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'focus', 'trim': '1.5 ecoblue 88kw titanium auto sportb.', 'title': 'ford focus 1.5 ecoblue 88kw titanium auto sportb.', 'price': 0, 'odometer': 210155, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-17', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 115, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '7b87aef8-9e9c-530f-bac6-fc5f775d7950', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b87aef8-9e9c-530f-bac6-fc5f775d7950/7b87aef8-9e9c-530f-bac6-fc5f775d7950_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/016/f9d4cba30c264c4a8d09c46ef8cb4c90/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 304361}], 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'ford focus', 'sanitized_make': 'ford', 'odometer_in_km': 210155}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'color': 'azul',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '7b87aef8-9e9c-530f-bac6-fc5f775d7950',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford focus',
     'model': 'focus',
     'odometer': 210155,
     'odometer_in_km': 210155,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b87aef8-9e9c-530f-bac6-fc5f775d7950/7b87aef8-9e9c-530f-bac6-fc5f775d7950_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 304361,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/016/f9d4cba30c264c4a8d09c46ef8cb4c90/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-12-17',
     'sanitized_make': 'ford',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ford focus 1.5 ecoblue 88kw titanium auto sportb.',
     'transmission': 'manual',
     'trim': '1.5 ecoblue 88kw titanium auto sportb.',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b87aef8-9e9c-530f-bac6-fc5f775d7950',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 210155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b87aef8-9e9c-530f-bac6-fc5f775d7950/7b87aef8-9e9c-530f-bac6-fc5f775d7950_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/016/f9d4cba30c264c4a8d09c46ef8cb4c90/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Titanium Auto Sportb.',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Titanium Auto Sportb.',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875214%27 HTTP/1.1" 200 None
2026-01-27 20:03:46 [ayvens.es] INFO: Saving data for 1875214: {'created_time': 1769544226.425142, 'last_price_update_time': 1769544226.425153, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875214') HTTP/1.1" 204 0
2026-01-27 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/345/46065b3c9a1c4dbbb33f61d3667945dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:46 [ayvens.es] INFO: Found listing with ID: 1875222
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875222%27 HTTP/1.1" 200 None
2026-01-27 20:03:46 [ayvens.es] INFO: Scrape type for 1875222: 1
2026-01-27 20:03:46 [ayvens.es] INFO: Extracting data for car ID: 1875222
2026-01-27 20:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33afb77e-b416-5d5e-b4ad-7a6da51a453a with identifier: 1875222
2026-01-27 20:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33afb77e-b416-5d5e-b4ad-7a6da51a453a with scrape type 1
2026-01-27 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33afb77e-b416-5d5e-b4ad-7a6da51a453a
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252F7fc59fe7baf94ef694fff98e72df2ffb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/7fc59fe7baf94ef694fff98e72df2ffb/images/large/1.jpg not downloaded yet
2026-01-27 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57238d290>
2026-01-27 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa74d26e-d4fe-531b-b426-9a50de4e577d/aa74d26e-d4fe-531b-b426-9a50de4e577d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F242%252Fd0738df11c8d40c6a00248953d01cb8f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/242/d0738df11c8d40c6a00248953d01cb8f/images/large/1.jpg saved to cache
2026-01-27 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa74d26e-d4fe-531b-b426-9a50de4e577d
2026-01-27 20:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa74d26e-d4fe-531b-b426-9a50de4e577d, skipping ID generation
2026-01-27 20:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa74d26e-d4fe-531b-b426-9a50de4e577d with scrape type 1
2026-01-27 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aa74d26e-d4fe-531b-b426-9a50de4e577d from tracking dictionaries
2026-01-27 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa74d26e-d4fe-531b-b426-9a50de4e577d sending to next pipeline
2026-01-27 20:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aa74d26e-d4fe-531b-b426-9a50de4e577d, identifier: 1875213
2026-01-27 20:03:47 [ayvens.es] INFO: Found listing with ID: 1875223
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875223%27 HTTP/1.1" 200 None
2026-01-27 20:03:47 [ayvens.es] INFO: Scrape type for 1875223: 1
2026-01-27 20:03:47 [ayvens.es] INFO: Extracting data for car ID: 1875223
2026-01-27 20:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ade94e-785c-5658-b409-f08faf48a83c with identifier: 1875223
2026-01-27 20:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ade94e-785c-5658-b409-f08faf48a83c with scrape type 1
2026-01-27 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08ade94e-785c-5658-b409-f08faf48a83c
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252F84a4fb99c85b4f77b88ffead9f4934f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/84a4fb99c85b4f77b88ffead9f4934f7/images/large/1.jpg not downloaded yet
2026-01-27 20:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aa74d26e-d4fe-531b-b426-9a50de4e577d with identifier: 1875213
2026-01-27 20:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aa74d26e-d4fe-531b-b426-9a50de4e577d with identifier: 1875213
2026-01-27 20:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aa74d26e-d4fe-531b-b426-9a50de4e577d with identifier: 1875213 to the API
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/242/d0738df11c8d40c6a00248953d01cb8f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'aa74d26e-d4fe-531b-b426-9a50de4e577d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 45622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa74d26e-d4fe-531b-b426-9a50de4e577d/aa74d26e-d4fe-531b-b426-9a50de4e577d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/242/d0738df11c8d40c6a00248953d01cb8f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875213%27 HTTP/1.1" 200 None
2026-01-27 20:03:47 [ayvens.es] INFO: Saving data for 1875213: {'created_time': 1769544227.516952, 'last_price_update_time': 1769544227.516964, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875213') HTTP/1.1" 204 0
2026-01-27 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57095bb90>
2026-01-27 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fc18567-4d69-58d4-9e00-09fc9d8982c8/5fc18567-4d69-58d4-9e00-09fc9d8982c8_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F345%252F46065b3c9a1c4dbbb33f61d3667945dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/345/46065b3c9a1c4dbbb33f61d3667945dc/images/large/1.jpg saved to cache
2026-01-27 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fc18567-4d69-58d4-9e00-09fc9d8982c8
2026-01-27 20:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fc18567-4d69-58d4-9e00-09fc9d8982c8, skipping ID generation
2026-01-27 20:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc18567-4d69-58d4-9e00-09fc9d8982c8 with scrape type 1
2026-01-27 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5fc18567-4d69-58d4-9e00-09fc9d8982c8 from tracking dictionaries
2026-01-27 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fc18567-4d69-58d4-9e00-09fc9d8982c8 sending to next pipeline
2026-01-27 20:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5fc18567-4d69-58d4-9e00-09fc9d8982c8, identifier: 1875215
2026-01-27 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/288/856f582128114edcb91030ac9249c2bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/842/4b32a602ed73464981b39211fc61f5e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:47 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-01-27 20:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5fc18567-4d69-58d4-9e00-09fc9d8982c8 with identifier: 1875215
2026-01-27 20:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5fc18567-4d69-58d4-9e00-09fc9d8982c8 with identifier: 1875215
2026-01-27 20:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5fc18567-4d69-58d4-9e00-09fc9d8982c8 with identifier: 1875215 to the API
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/345/46065b3c9a1c4dbbb33f61d3667945dc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5fc18567-4d69-58d4-9e00-09fc9d8982c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 62707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fc18567-4d69-58d4-9e00-09fc9d8982c8/5fc18567-4d69-58d4-9e00-09fc9d8982c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/345/46065b3c9a1c4dbbb33f61d3667945dc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 2.0 TDI 110kW DSG-7 S&S Xcellence',
 'transmission': 'manual',
 'trim': 'ST 2.0 TDI 110kW DSG-7 S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875215%27 HTTP/1.1" 200 None
2026-01-27 20:03:48 [ayvens.es] INFO: Saving data for 1875215: {'created_time': 1769544228.362073, 'last_price_update_time': 1769544228.362086, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875215') HTTP/1.1" 204 0
2026-01-27 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/374/5e10672d352e4702be2fab392a0f7481/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/884/93b4b38a08cd40a1b52f94edeacf2178/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572315dd0>
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_736eb3e0-cadc-5453-b5ce-80d49b08745f/736eb3e0-cadc-5453-b5ce-80d49b08745f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F288%252F856f582128114edcb91030ac9249c2bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/288/856f582128114edcb91030ac9249c2bd/images/large/1.jpg saved to cache
2026-01-27 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 736eb3e0-cadc-5453-b5ce-80d49b08745f
2026-01-27 20:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 736eb3e0-cadc-5453-b5ce-80d49b08745f, skipping ID generation
2026-01-27 20:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 736eb3e0-cadc-5453-b5ce-80d49b08745f with scrape type 1
2026-01-27 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 736eb3e0-cadc-5453-b5ce-80d49b08745f from tracking dictionaries
2026-01-27 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 736eb3e0-cadc-5453-b5ce-80d49b08745f sending to next pipeline
2026-01-27 20:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 736eb3e0-cadc-5453-b5ce-80d49b08745f, identifier: 1875218
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57093ce90>
2026-01-27 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40520264-2aab-57a4-ba6a-e1dc8d471f71/40520264-2aab-57a4-ba6a-e1dc8d471f71_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F842%252F4b32a602ed73464981b39211fc61f5e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/842/4b32a602ed73464981b39211fc61f5e4/images/large/1.jpg saved to cache
2026-01-27 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40520264-2aab-57a4-ba6a-e1dc8d471f71
2026-01-27 20:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40520264-2aab-57a4-ba6a-e1dc8d471f71, skipping ID generation
2026-01-27 20:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40520264-2aab-57a4-ba6a-e1dc8d471f71 with scrape type 1
2026-01-27 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 40520264-2aab-57a4-ba6a-e1dc8d471f71 from tracking dictionaries
2026-01-27 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40520264-2aab-57a4-ba6a-e1dc8d471f71 sending to next pipeline
2026-01-27 20:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 40520264-2aab-57a4-ba6a-e1dc8d471f71, identifier: 1875217
2026-01-27 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/555/38e4282e75164026984d8abf3dc157c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 736eb3e0-cadc-5453-b5ce-80d49b08745f with identifier: 1875218
2026-01-27 20:03:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 736eb3e0-cadc-5453-b5ce-80d49b08745f with identifier: 1875218
2026-01-27 20:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 736eb3e0-cadc-5453-b5ce-80d49b08745f with identifier: 1875218 to the API
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/288/856f582128114edcb91030ac9249c2bd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '736eb3e0-cadc-5453-b5ce-80d49b08745f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 102930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_736eb3e0-cadc-5453-b5ce-80d49b08745f/736eb3e0-cadc-5453-b5ce-80d49b08745f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/288/856f582128114edcb91030ac9249c2bd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Lounge 1.2 8v 51KW (69 CV)',
 'transmission': 'manual',
 'trim': 'Lounge 1.2 8v 51KW (69 CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875218%27 HTTP/1.1" 200 None
2026-01-27 20:03:49 [ayvens.es] INFO: Saving data for 1875218: {'created_time': 1769544229.676502, 'last_price_update_time': 1769544229.676515, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875218') HTTP/1.1" 204 0
2026-01-27 20:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 40520264-2aab-57a4-ba6a-e1dc8d471f71 with identifier: 1875217
2026-01-27 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 40520264-2aab-57a4-ba6a-e1dc8d471f71 with identifier: 1875217
2026-01-27 20:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 40520264-2aab-57a4-ba6a-e1dc8d471f71 with identifier: 1875217 to the API
2026-01-27 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/842/4b32a602ed73464981b39211fc61f5e4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '40520264-2aab-57a4-ba6a-e1dc8d471f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 70570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40520264-2aab-57a4-ba6a-e1dc8d471f71/40520264-2aab-57a4-ba6a-e1dc8d471f71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/842/4b32a602ed73464981b39211fc61f5e4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Style',
 'transmission': 'manual',
 'trim': '2.5l 220H Style',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875217%27 HTTP/1.1" 200 None
2026-01-27 20:03:50 [ayvens.es] INFO: Saving data for 1875217: {'created_time': 1769544230.126753, 'last_price_update_time': 1769544230.126766, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875217') HTTP/1.1" 204 0
2026-01-27 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/722/03f4a66d52d5456d850a177d93d8899c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572270bd0>
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ded0bfe3-a350-55fc-b2f6-cbf548e1f7df/ded0bfe3-a350-55fc-b2f6-cbf548e1f7df_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F374%252F5e10672d352e4702be2fab392a0f7481%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/374/5e10672d352e4702be2fab392a0f7481/images/large/1.jpg saved to cache
2026-01-27 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ded0bfe3-a350-55fc-b2f6-cbf548e1f7df
2026-01-27 20:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ded0bfe3-a350-55fc-b2f6-cbf548e1f7df, skipping ID generation
2026-01-27 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ded0bfe3-a350-55fc-b2f6-cbf548e1f7df with scrape type 1
2026-01-27 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ded0bfe3-a350-55fc-b2f6-cbf548e1f7df from tracking dictionaries
2026-01-27 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ded0bfe3-a350-55fc-b2f6-cbf548e1f7df sending to next pipeline
2026-01-27 20:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ded0bfe3-a350-55fc-b2f6-cbf548e1f7df, identifier: 1875216
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572387210>
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b4cb5b-3173-58cf-898d-ff4851f37121/56b4cb5b-3173-58cf-898d-ff4851f37121_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F884%252F93b4b38a08cd40a1b52f94edeacf2178%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/884/93b4b38a08cd40a1b52f94edeacf2178/images/large/1.jpg saved to cache
2026-01-27 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56b4cb5b-3173-58cf-898d-ff4851f37121
2026-01-27 20:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56b4cb5b-3173-58cf-898d-ff4851f37121, skipping ID generation
2026-01-27 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b4cb5b-3173-58cf-898d-ff4851f37121 with scrape type 1
2026-01-27 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 56b4cb5b-3173-58cf-898d-ff4851f37121 from tracking dictionaries
2026-01-27 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56b4cb5b-3173-58cf-898d-ff4851f37121 sending to next pipeline
2026-01-27 20:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 56b4cb5b-3173-58cf-898d-ff4851f37121, identifier: 1875220
2026-01-27 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724f8c50>
2026-01-27 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_866fa207-e0b4-53d9-a5b9-3f73cef15294/866fa207-e0b4-53d9-a5b9-3f73cef15294_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F555%252F38e4282e75164026984d8abf3dc157c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/555/38e4282e75164026984d8abf3dc157c6/images/large/1.jpg saved to cache
2026-01-27 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 866fa207-e0b4-53d9-a5b9-3f73cef15294
2026-01-27 20:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 866fa207-e0b4-53d9-a5b9-3f73cef15294, skipping ID generation
2026-01-27 20:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 866fa207-e0b4-53d9-a5b9-3f73cef15294 with scrape type 1
2026-01-27 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 866fa207-e0b4-53d9-a5b9-3f73cef15294 from tracking dictionaries
2026-01-27 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 866fa207-e0b4-53d9-a5b9-3f73cef15294 sending to next pipeline
2026-01-27 20:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 866fa207-e0b4-53d9-a5b9-3f73cef15294, identifier: 1875221
2026-01-27 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ded0bfe3-a350-55fc-b2f6-cbf548e1f7df with identifier: 1875216
2026-01-27 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ded0bfe3-a350-55fc-b2f6-cbf548e1f7df with identifier: 1875216
2026-01-27 20:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ded0bfe3-a350-55fc-b2f6-cbf548e1f7df with identifier: 1875216 to the API
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/374/5e10672d352e4702be2fab392a0f7481/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ded0bfe3-a350-55fc-b2f6-cbf548e1f7df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 35751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ded0bfe3-a350-55fc-b2f6-cbf548e1f7df/ded0bfe3-a350-55fc-b2f6-cbf548e1f7df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/374/5e10672d352e4702be2fab392a0f7481/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875216%27 HTTP/1.1" 200 None
2026-01-27 20:03:51 [ayvens.es] INFO: Saving data for 1875216: {'created_time': 1769544231.898812, 'last_price_update_time': 1769544231.898827, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875216') HTTP/1.1" 204 0
2026-01-27 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 56b4cb5b-3173-58cf-898d-ff4851f37121 with identifier: 1875220
2026-01-27 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 56b4cb5b-3173-58cf-898d-ff4851f37121 with identifier: 1875220
2026-01-27 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152990 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152990
2026-01-27 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 56b4cb5b-3173-58cf-898d-ff4851f37121 spider: ayvens.es
2026-01-27 20:03:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 56b4cb5b-3173-58cf-898d-ff4851f37121 due to rule: high_mileage_for_country.json, error: 152990 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152990
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '56b4cb5b-3173-58cf-898d-ff4851f37121',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 152990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56b4cb5b-3173-58cf-898d-ff4851f37121/56b4cb5b-3173-58cf-898d-ff4851f37121_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/884/93b4b38a08cd40a1b52f94edeacf2178/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875220%27 HTTP/1.1" 200 None
2026-01-27 20:03:52 [ayvens.es] INFO: Saving data for 1875220: {'created_time': 1769544232.169913, 'last_price_update_time': 1769544232.169929, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875220') HTTP/1.1" 204 0
2026-01-27 20:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 866fa207-e0b4-53d9-a5b9-3f73cef15294 with identifier: 1875221
2026-01-27 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 866fa207-e0b4-53d9-a5b9-3f73cef15294 with identifier: 1875221
2026-01-27 20:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 866fa207-e0b4-53d9-a5b9-3f73cef15294 with identifier: 1875221 to the API
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/555/38e4282e75164026984d8abf3dc157c6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '866fa207-e0b4-53d9-a5b9-3f73cef15294',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 1',
 'odometer': 45814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866fa207-e0b4-53d9-a5b9-3f73cef15294/866fa207-e0b4-53d9-a5b9-3f73cef15294_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/555/38e4282e75164026984d8abf3dc157c6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 1 116d',
 'transmission': 'manual',
 'trim': '116d',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875221%27 HTTP/1.1" 200 None
2026-01-27 20:03:52 [ayvens.es] INFO: Saving data for 1875221: {'created_time': 1769544232.574109, 'last_price_update_time': 1769544232.574122, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875221') HTTP/1.1" 204 0
2026-01-27 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/805/7fc59fe7baf94ef694fff98e72df2ffb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57228a0d0>
2026-01-27 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c8be0c8-134c-5438-b6f8-2596d1799e2c/5c8be0c8-134c-5438-b6f8-2596d1799e2c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252F03f4a66d52d5456d850a177d93d8899c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/03f4a66d52d5456d850a177d93d8899c/images/large/1.jpg saved to cache
2026-01-27 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c8be0c8-134c-5438-b6f8-2596d1799e2c
2026-01-27 20:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c8be0c8-134c-5438-b6f8-2596d1799e2c, skipping ID generation
2026-01-27 20:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c8be0c8-134c-5438-b6f8-2596d1799e2c with scrape type 1
2026-01-27 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5c8be0c8-134c-5438-b6f8-2596d1799e2c from tracking dictionaries
2026-01-27 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c8be0c8-134c-5438-b6f8-2596d1799e2c sending to next pipeline
2026-01-27 20:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5c8be0c8-134c-5438-b6f8-2596d1799e2c, identifier: 1875219
2026-01-27 20:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5c8be0c8-134c-5438-b6f8-2596d1799e2c with identifier: 1875219
2026-01-27 20:03:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5c8be0c8-134c-5438-b6f8-2596d1799e2c with identifier: 1875219
2026-01-27 20:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5c8be0c8-134c-5438-b6f8-2596d1799e2c with identifier: 1875219 to the API
2026-01-27 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/722/03f4a66d52d5456d850a177d93d8899c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Sophistograu',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5c8be0c8-134c-5438-b6f8-2596d1799e2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 124915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c8be0c8-134c-5438-b6f8-2596d1799e2c/5c8be0c8-134c-5438-b6f8-2596d1799e2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/722/03f4a66d52d5456d850a177d93d8899c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875219%27 HTTP/1.1" 200 None
2026-01-27 20:03:54 [ayvens.es] INFO: Saving data for 1875219: {'created_time': 1769544234.787183, 'last_price_update_time': 1769544234.787197, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875219') HTTP/1.1" 204 0
2026-01-27 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/420/84a4fb99c85b4f77b88ffead9f4934f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57095bc10>
2026-01-27 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33afb77e-b416-5d5e-b4ad-7a6da51a453a/33afb77e-b416-5d5e-b4ad-7a6da51a453a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252F7fc59fe7baf94ef694fff98e72df2ffb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/7fc59fe7baf94ef694fff98e72df2ffb/images/large/1.jpg saved to cache
2026-01-27 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33afb77e-b416-5d5e-b4ad-7a6da51a453a
2026-01-27 20:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33afb77e-b416-5d5e-b4ad-7a6da51a453a, skipping ID generation
2026-01-27 20:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33afb77e-b416-5d5e-b4ad-7a6da51a453a with scrape type 1
2026-01-27 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 33afb77e-b416-5d5e-b4ad-7a6da51a453a from tracking dictionaries
2026-01-27 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33afb77e-b416-5d5e-b4ad-7a6da51a453a sending to next pipeline
2026-01-27 20:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 33afb77e-b416-5d5e-b4ad-7a6da51a453a, identifier: 1875222
2026-01-27 20:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 33afb77e-b416-5d5e-b4ad-7a6da51a453a with identifier: 1875222
2026-01-27 20:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 33afb77e-b416-5d5e-b4ad-7a6da51a453a with identifier: 1875222
2026-01-27 20:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 33afb77e-b416-5d5e-b4ad-7a6da51a453a with identifier: 1875222 to the API
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/805/7fc59fe7baf94ef694fff98e72df2ffb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '33afb77e-b416-5d5e-b4ad-7a6da51a453a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 35598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33afb77e-b416-5d5e-b4ad-7a6da51a453a/33afb77e-b416-5d5e-b4ad-7a6da51a453a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/805/7fc59fe7baf94ef694fff98e72df2ffb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875222%27 HTTP/1.1" 200 None
2026-01-27 20:03:55 [ayvens.es] INFO: Saving data for 1875222: {'created_time': 1769544235.648879, 'last_price_update_time': 1769544235.648893, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875222') HTTP/1.1" 204 0
2026-01-27 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5709131d0>
2026-01-27 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08ade94e-785c-5658-b409-f08faf48a83c/08ade94e-785c-5658-b409-f08faf48a83c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252F84a4fb99c85b4f77b88ffead9f4934f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/84a4fb99c85b4f77b88ffead9f4934f7/images/large/1.jpg saved to cache
2026-01-27 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08ade94e-785c-5658-b409-f08faf48a83c
2026-01-27 20:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08ade94e-785c-5658-b409-f08faf48a83c, skipping ID generation
2026-01-27 20:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ade94e-785c-5658-b409-f08faf48a83c with scrape type 1
2026-01-27 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08ade94e-785c-5658-b409-f08faf48a83c from tracking dictionaries
2026-01-27 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08ade94e-785c-5658-b409-f08faf48a83c sending to next pipeline
2026-01-27 20:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 08ade94e-785c-5658-b409-f08faf48a83c, identifier: 1875223
2026-01-27 20:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 08ade94e-785c-5658-b409-f08faf48a83c with identifier: 1875223
2026-01-27 20:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 08ade94e-785c-5658-b409-f08faf48a83c with identifier: 1875223
2026-01-27 20:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 08ade94e-785c-5658-b409-f08faf48a83c with identifier: 1875223 to the API
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/420/84a4fb99c85b4f77b88ffead9f4934f7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '08ade94e-785c-5658-b409-f08faf48a83c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 129713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ade94e-785c-5658-b409-f08faf48a83c/08ade94e-785c-5658-b409-f08faf48a83c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/420/84a4fb99c85b4f77b88ffead9f4934f7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Last Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Last Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875223%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Saving data for 1875223: {'created_time': 1769544236.428535, 'last_price_update_time': 1769544236.428547, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875223') HTTP/1.1" 204 0
2026-01-27 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875224
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875224%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Scrape type for 1875224: 1
2026-01-27 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1875224
2026-01-27 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f06668-6628-5ed1-a3ca-011d2f258128 with identifier: 1875224
2026-01-27 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f06668-6628-5ed1-a3ca-011d2f258128 with scrape type 1
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d1f06668-6628-5ed1-a3ca-011d2f258128
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252Fcfe6fbcb814e47ba94d525592124a6f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/cfe6fbcb814e47ba94d525592124a6f7/images/large/1.jpg not downloaded yet
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875225
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875225%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Scrape type for 1875225: 1
2026-01-27 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1875225
2026-01-27 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a9767a-f8a2-5b24-aab6-f80eb851289e with identifier: 1875225
2026-01-27 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a9767a-f8a2-5b24-aab6-f80eb851289e with scrape type 1
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 18a9767a-f8a2-5b24-aab6-f80eb851289e
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F691%252F777e3400b47d4609bc05bfab0365278a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/691/777e3400b47d4609bc05bfab0365278a/images/large/1.jpg not downloaded yet
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875226
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875226%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Scrape type for 1875226: 1
2026-01-27 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1875226
2026-01-27 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c280748f-12cc-5a4a-b3d0-0832183141ac with identifier: 1875226
2026-01-27 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c280748f-12cc-5a4a-b3d0-0832183141ac with scrape type 1
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c280748f-12cc-5a4a-b3d0-0832183141ac
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F878%252Fbc818027ced54eadbad2e8fdddf9f10d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/878/bc818027ced54eadbad2e8fdddf9f10d/images/large/1.jpg not downloaded yet
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875227
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875227%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Scrape type for 1875227: 1
2026-01-27 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1875227
2026-01-27 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41df1a3-7b12-5ac1-bff8-a673cda46308 with identifier: 1875227
2026-01-27 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41df1a3-7b12-5ac1-bff8-a673cda46308 with scrape type 1
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d41df1a3-7b12-5ac1-bff8-a673cda46308
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F093%252F06e0108de6f5406a8107afb03d501f72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/093/06e0108de6f5406a8107afb03d501f72/images/large/1.jpg not downloaded yet
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875228
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875228%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Scrape type for 1875228: 1
2026-01-27 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1875228
2026-01-27 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1656c713-a10a-5445-92d1-2d05a8fa9374 with identifier: 1875228
2026-01-27 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1656c713-a10a-5445-92d1-2d05a8fa9374 with scrape type 1
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1656c713-a10a-5445-92d1-2d05a8fa9374
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F869%252Fdee74bce1a3440c48825737c14f11398%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/869/dee74bce1a3440c48825737c14f11398/images/large/1.jpg not downloaded yet
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875229
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875229%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Scrape type for 1875229: 1
2026-01-27 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1875229
2026-01-27 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da510f82-85e0-5414-a1b4-718bba4278da with identifier: 1875229
2026-01-27 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da510f82-85e0-5414-a1b4-718bba4278da with scrape type 1
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da510f82-85e0-5414-a1b4-718bba4278da
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252F74ae5ce14db8445397192e147bab29b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/74ae5ce14db8445397192e147bab29b2/images/large/1.jpg not downloaded yet
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875230
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875230%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Scrape type for 1875230: 1
2026-01-27 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1875230
2026-01-27 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff8270c2-a83b-5504-b8d0-30bf364234e8 with identifier: 1875230
2026-01-27 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8270c2-a83b-5504-b8d0-30bf364234e8 with scrape type 1
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff8270c2-a83b-5504-b8d0-30bf364234e8
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F484%252Fa87b034580fb4dd59e7bf78628a7419e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/484/a87b034580fb4dd59e7bf78628a7419e/images/large/1.jpg not downloaded yet
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875231
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875231%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [ayvens.es] INFO: Scrape type for 1875231: 1
2026-01-27 20:03:56 [ayvens.es] INFO: Extracting data for car ID: 1875231
2026-01-27 20:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 911348e9-cdcd-53c2-b860-8765b46b9714 with identifier: 1875231
2026-01-27 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 911348e9-cdcd-53c2-b860-8765b46b9714 with scrape type 1
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 911348e9-cdcd-53c2-b860-8765b46b9714
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F971%252Ffbf41c7497b148fcb4ce42c283e6521a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/971/fbf41c7497b148fcb4ce42c283e6521a/images/large/1.jpg not downloaded yet
2026-01-27 20:03:56 [ayvens.es] INFO: Found listing with ID: 1875232
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875232%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [ayvens.es] INFO: Scrape type for 1875232: 1
2026-01-27 20:03:57 [ayvens.es] INFO: Extracting data for car ID: 1875232
2026-01-27 20:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4 with identifier: 1875232
2026-01-27 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4 with scrape type 1
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F268%252F7e16ba87480b4a1a810a66fb15f3bf67%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/268/7e16ba87480b4a1a810a66fb15f3bf67/images/large/1.jpg not downloaded yet
2026-01-27 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/803/cfe6fbcb814e47ba94d525592124a6f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:57 [ayvens.es] INFO: Found listing with ID: 1875233
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875233%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [ayvens.es] INFO: Scrape type for 1875233: 1
2026-01-27 20:03:57 [ayvens.es] INFO: Extracting data for car ID: 1875233
2026-01-27 20:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92635b15-9ab4-57a4-ba51-9043ac6233fb with identifier: 1875233
2026-01-27 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92635b15-9ab4-57a4-ba51-9043ac6233fb with scrape type 1
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92635b15-9ab4-57a4-ba51-9043ac6233fb
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F496%252F6c821acda27545eda7c1495123d19f82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/496/6c821acda27545eda7c1495123d19f82/images/large/1.jpg not downloaded yet
2026-01-27 20:03:57 [ayvens.es] INFO: Found listing with ID: 1875234
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875234%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [ayvens.es] INFO: Scrape type for 1875234: 1
2026-01-27 20:03:57 [ayvens.es] INFO: Extracting data for car ID: 1875234
2026-01-27 20:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f686ee9-b7ec-507c-bac9-c943ea8e92f5 with identifier: 1875234
2026-01-27 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f686ee9-b7ec-507c-bac9-c943ea8e92f5 with scrape type 1
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8f686ee9-b7ec-507c-bac9-c943ea8e92f5
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F497%252F1e5fd8c5654e4a17b0569bfb33038cda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/497/1e5fd8c5654e4a17b0569bfb33038cda/images/large/1.jpg not downloaded yet
2026-01-27 20:03:57 [ayvens.es] INFO: Found listing with ID: 1875235
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875235%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [ayvens.es] INFO: Scrape type for 1875235: 1
2026-01-27 20:03:57 [ayvens.es] INFO: Extracting data for car ID: 1875235
2026-01-27 20:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b5e02e-5461-528d-b9ce-be055209634c with identifier: 1875235
2026-01-27 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b5e02e-5461-528d-b9ce-be055209634c with scrape type 1
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 24b5e02e-5461-528d-b9ce-be055209634c
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Fb4a0d64f3ec64be19a3148ed97a03229%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/b4a0d64f3ec64be19a3148ed97a03229/images/large/1.jpg not downloaded yet
2026-01-27 20:03:57 [ayvens.es] INFO: Found listing with ID: 1875236
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875236%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [ayvens.es] INFO: Scrape type for 1875236: 1
2026-01-27 20:03:57 [ayvens.es] INFO: Extracting data for car ID: 1875236
2026-01-27 20:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68a5c382-e194-56a0-a2a2-f631f9fe838e with identifier: 1875236
2026-01-27 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a5c382-e194-56a0-a2a2-f631f9fe838e with scrape type 1
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68a5c382-e194-56a0-a2a2-f631f9fe838e
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252Fd52cf83f9051449d9e26705d9ed52d29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/d52cf83f9051449d9e26705d9ed52d29/images/large/1.jpg not downloaded yet
2026-01-27 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57236b6d0>
2026-01-27 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f06668-6628-5ed1-a3ca-011d2f258128/d1f06668-6628-5ed1-a3ca-011d2f258128_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252Fcfe6fbcb814e47ba94d525592124a6f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/cfe6fbcb814e47ba94d525592124a6f7/images/large/1.jpg saved to cache
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1f06668-6628-5ed1-a3ca-011d2f258128
2026-01-27 20:03:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1f06668-6628-5ed1-a3ca-011d2f258128, skipping ID generation
2026-01-27 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f06668-6628-5ed1-a3ca-011d2f258128 with scrape type 1
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d1f06668-6628-5ed1-a3ca-011d2f258128 from tracking dictionaries
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1f06668-6628-5ed1-a3ca-011d2f258128 sending to next pipeline
2026-01-27 20:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d1f06668-6628-5ed1-a3ca-011d2f258128, identifier: 1875224
2026-01-27 20:03:57 [ayvens.es] INFO: Found listing with ID: 1875237
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875237%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [ayvens.es] INFO: Scrape type for 1875237: 1
2026-01-27 20:03:57 [ayvens.es] INFO: Extracting data for car ID: 1875237
2026-01-27 20:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4456be8-46d0-50c0-9e46-df65aa331dce with identifier: 1875237
2026-01-27 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4456be8-46d0-50c0-9e46-df65aa331dce with scrape type 1
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f4456be8-46d0-50c0-9e46-df65aa331dce
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252Fc91e39fdae274b639194f47bf5a63c81%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/c91e39fdae274b639194f47bf5a63c81/images/large/1.jpg not downloaded yet
2026-01-27 20:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d1f06668-6628-5ed1-a3ca-011d2f258128 with identifier: 1875224
2026-01-27 20:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d1f06668-6628-5ed1-a3ca-011d2f258128 with identifier: 1875224
2026-01-27 20:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d1f06668-6628-5ed1-a3ca-011d2f258128 with identifier: 1875224 to the API
2026-01-27 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/803/cfe6fbcb814e47ba94d525592124a6f7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd1f06668-6628-5ed1-a3ca-011d2f258128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 126259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f06668-6628-5ed1-a3ca-011d2f258128/d1f06668-6628-5ed1-a3ca-011d2f258128_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/803/cfe6fbcb814e47ba94d525592124a6f7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 75KW (100CV) S&S Live Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 75KW (100CV) S&S Live Pack',
 'vin': None,
 'year': 2021}
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875224%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [ayvens.es] INFO: Saving data for 1875224: {'created_time': 1769544238.183037, 'last_price_update_time': 1769544238.183052, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875224') HTTP/1.1" 204 0
2026-01-27 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/024/74ae5ce14db8445397192e147bab29b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:58 [ayvens.es] INFO: Found listing with ID: 1875238
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875238%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [ayvens.es] INFO: Scrape type for 1875238: 1
2026-01-27 20:03:58 [ayvens.es] INFO: Extracting data for car ID: 1875238
2026-01-27 20:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70a92ae0-04d5-516c-a852-26fca3b8465c with identifier: 1875238
2026-01-27 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70a92ae0-04d5-516c-a852-26fca3b8465c with scrape type 1
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70a92ae0-04d5-516c-a852-26fca3b8465c
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F879%252F3a13634c2b6c4ef2acef4f08060aa5fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/879/3a13634c2b6c4ef2acef4f08060aa5fc/images/large/1.jpg not downloaded yet
2026-01-27 20:03:58 [ayvens.es] INFO: Found listing with ID: 1875239
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875239%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [ayvens.es] INFO: Scrape type for 1875239: 1
2026-01-27 20:03:58 [ayvens.es] INFO: Extracting data for car ID: 1875239
2026-01-27 20:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7fd630-24c9-5862-adee-900e0dd29343 with identifier: 1875239
2026-01-27 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7fd630-24c9-5862-adee-900e0dd29343 with scrape type 1
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6e7fd630-24c9-5862-adee-900e0dd29343
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F222%252F79aef1a3585a4d83937971f653a7c977%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/222/79aef1a3585a4d83937971f653a7c977/images/large/1.jpg not downloaded yet
2026-01-27 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/268/7e16ba87480b4a1a810a66fb15f3bf67/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/869/dee74bce1a3440c48825737c14f11398/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/093/06e0108de6f5406a8107afb03d501f72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:58 [ayvens.es] INFO: Found listing with ID: 1875240
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875240%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [ayvens.es] INFO: Scrape type for 1875240: 1
2026-01-27 20:03:58 [ayvens.es] INFO: Extracting data for car ID: 1875240
2026-01-27 20:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e with identifier: 1875240
2026-01-27 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e with scrape type 1
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F786%252F2d3bdaaf54784a5099767662dbffa49c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/786/2d3bdaaf54784a5099767662dbffa49c/images/large/1.jpg not downloaded yet
2026-01-27 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/691/777e3400b47d4609bc05bfab0365278a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/878/bc818027ced54eadbad2e8fdddf9f10d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:03:58 [ayvens.es] INFO: Found listing with ID: 1875241
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875241%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [ayvens.es] INFO: Scrape type for 1875241: 1
2026-01-27 20:03:58 [ayvens.es] INFO: Extracting data for car ID: 1875241
2026-01-27 20:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c38fe912-8beb-5ad4-96c4-7bf168b4f95d with identifier: 1875241
2026-01-27 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38fe912-8beb-5ad4-96c4-7bf168b4f95d with scrape type 1
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c38fe912-8beb-5ad4-96c4-7bf168b4f95d
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252F8c4a4a7190e94a0e8ee27cccdb82e210%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/8c4a4a7190e94a0e8ee27cccdb82e210/images/large/1.jpg not downloaded yet
2026-01-27 20:03:58 [ayvens.es] INFO: Found listing with ID: 1875242
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875242%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [ayvens.es] INFO: Scrape type for 1875242: 1
2026-01-27 20:03:58 [ayvens.es] INFO: Extracting data for car ID: 1875242
2026-01-27 20:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d95e2e-b51c-5bdd-acd8-64ab8057f920 with identifier: 1875242
2026-01-27 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d95e2e-b51c-5bdd-acd8-64ab8057f920 with scrape type 1
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e5d95e2e-b51c-5bdd-acd8-64ab8057f920
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F501%252F7881b13395054fb2a9b311d32d5ed1a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/501/7881b13395054fb2a9b311d32d5ed1a2/images/large/1.jpg not downloaded yet
2026-01-27 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57235fc90>
2026-01-27 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da510f82-85e0-5414-a1b4-718bba4278da/da510f82-85e0-5414-a1b4-718bba4278da_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252F74ae5ce14db8445397192e147bab29b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/74ae5ce14db8445397192e147bab29b2/images/large/1.jpg saved to cache
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da510f82-85e0-5414-a1b4-718bba4278da
2026-01-27 20:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da510f82-85e0-5414-a1b4-718bba4278da, skipping ID generation
2026-01-27 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da510f82-85e0-5414-a1b4-718bba4278da with scrape type 1
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item da510f82-85e0-5414-a1b4-718bba4278da from tracking dictionaries
2026-01-27 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da510f82-85e0-5414-a1b4-718bba4278da sending to next pipeline
2026-01-27 20:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da510f82-85e0-5414-a1b4-718bba4278da, identifier: 1875229
2026-01-27 20:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da510f82-85e0-5414-a1b4-718bba4278da with identifier: 1875229
2026-01-27 20:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da510f82-85e0-5414-a1b4-718bba4278da with identifier: 1875229
2026-01-27 20:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: da510f82-85e0-5414-a1b4-718bba4278da with identifier: 1875229 to the API
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/024/74ae5ce14db8445397192e147bab29b2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da510f82-85e0-5414-a1b4-718bba4278da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 112334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da510f82-85e0-5414-a1b4-718bba4278da/da510f82-85e0-5414-a1b4-718bba4278da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/74ae5ce14db8445397192e147bab29b2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'SW Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875229%27 HTTP/1.1" 200 None
2026-01-27 20:03:59 [ayvens.es] INFO: Saving data for 1875229: {'created_time': 1769544239.531367, 'last_price_update_time': 1769544239.531383, 'auction_closing_time': 1769601600.0}
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875229') HTTP/1.1" 204 0
2026-01-27 20:03:59 [ayvens.es] INFO: Found listing with ID: 1875243
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875243%27 HTTP/1.1" 200 None
2026-01-27 20:03:59 [ayvens.es] INFO: Scrape type for 1875243: 1
2026-01-27 20:03:59 [ayvens.es] INFO: Extracting data for car ID: 1875243
2026-01-27 20:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ee523f2-808a-56fd-b83e-fe86a4e39ffa with identifier: 1875243
2026-01-27 20:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ee523f2-808a-56fd-b83e-fe86a4e39ffa with scrape type 1
2026-01-27 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ee523f2-808a-56fd-b83e-fe86a4e39ffa
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252Fdcc7bb1b63f842d08a4239fae9b00831%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/dcc7bb1b63f842d08a4239fae9b00831/images/large/1.jpg not downloaded yet
2026-01-27 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572409150>
2026-01-27 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863dbc6c-a3e8-57b0-a71f-4c4273d9eef4/863dbc6c-a3e8-57b0-a71f-4c4273d9eef4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F268%252F7e16ba87480b4a1a810a66fb15f3bf67%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/268/7e16ba87480b4a1a810a66fb15f3bf67/images/large/1.jpg saved to cache
2026-01-27 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4
2026-01-27 20:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4, skipping ID generation
2026-01-27 20:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4 with scrape type 1
2026-01-27 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4 from tracking dictionaries
2026-01-27 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4 sending to next pipeline
2026-01-27 20:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4, identifier: 1875232
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57092c910>
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1656c713-a10a-5445-92d1-2d05a8fa9374/1656c713-a10a-5445-92d1-2d05a8fa9374_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F869%252Fdee74bce1a3440c48825737c14f11398%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/869/dee74bce1a3440c48825737c14f11398/images/large/1.jpg saved to cache
2026-01-27 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1656c713-a10a-5445-92d1-2d05a8fa9374
2026-01-27 20:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1656c713-a10a-5445-92d1-2d05a8fa9374, skipping ID generation
2026-01-27 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1656c713-a10a-5445-92d1-2d05a8fa9374 with scrape type 1
2026-01-27 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1656c713-a10a-5445-92d1-2d05a8fa9374 from tracking dictionaries
2026-01-27 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1656c713-a10a-5445-92d1-2d05a8fa9374 sending to next pipeline
2026-01-27 20:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1656c713-a10a-5445-92d1-2d05a8fa9374, identifier: 1875228
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572408850>
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d41df1a3-7b12-5ac1-bff8-a673cda46308/d41df1a3-7b12-5ac1-bff8-a673cda46308_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F093%252F06e0108de6f5406a8107afb03d501f72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/093/06e0108de6f5406a8107afb03d501f72/images/large/1.jpg saved to cache
2026-01-27 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d41df1a3-7b12-5ac1-bff8-a673cda46308
2026-01-27 20:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d41df1a3-7b12-5ac1-bff8-a673cda46308, skipping ID generation
2026-01-27 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41df1a3-7b12-5ac1-bff8-a673cda46308 with scrape type 1
2026-01-27 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d41df1a3-7b12-5ac1-bff8-a673cda46308 from tracking dictionaries
2026-01-27 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d41df1a3-7b12-5ac1-bff8-a673cda46308 sending to next pipeline
2026-01-27 20:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d41df1a3-7b12-5ac1-bff8-a673cda46308, identifier: 1875227
2026-01-27 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/484/a87b034580fb4dd59e7bf78628a7419e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4 with identifier: 1875232
2026-01-27 20:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4 with identifier: 1875232
2026-01-27 20:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 863dbc6c-a3e8-57b0-a71f-4c4273d9eef4 with identifier: 1875232 to the API
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/268/7e16ba87480b4a1a810a66fb15f3bf67/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '863dbc6c-a3e8-57b0-a71f-4c4273d9eef4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 118101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_863dbc6c-a3e8-57b0-a71f-4c4273d9eef4/863dbc6c-a3e8-57b0-a71f-4c4273d9eef4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/268/7e16ba87480b4a1a810a66fb15f3bf67/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875232%27 HTTP/1.1" 200 None
2026-01-27 20:04:01 [ayvens.es] INFO: Saving data for 1875232: {'created_time': 1769544241.40347, 'last_price_update_time': 1769544241.403481, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875232') HTTP/1.1" 204 0
2026-01-27 20:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1656c713-a10a-5445-92d1-2d05a8fa9374 with identifier: 1875228
2026-01-27 20:04:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1656c713-a10a-5445-92d1-2d05a8fa9374 with identifier: 1875228
2026-01-27 20:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1656c713-a10a-5445-92d1-2d05a8fa9374 with identifier: 1875228 to the API
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/869/dee74bce1a3440c48825737c14f11398/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Stonic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1656c713-a10a-5445-92d1-2d05a8fa9374',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 77526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1656c713-a10a-5445-92d1-2d05a8fa9374/1656c713-a10a-5445-92d1-2d05a8fa9374_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/869/dee74bce1a3440c48825737c14f11398/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875228%27 HTTP/1.1" 200 None
2026-01-27 20:04:01 [ayvens.es] INFO: Saving data for 1875228: {'created_time': 1769544241.818328, 'last_price_update_time': 1769544241.818342, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875228') HTTP/1.1" 204 0
2026-01-27 20:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d41df1a3-7b12-5ac1-bff8-a673cda46308 with identifier: 1875227
2026-01-27 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d41df1a3-7b12-5ac1-bff8-a673cda46308 with identifier: 1875227
2026-01-27 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170181 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170181
2026-01-27 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d41df1a3-7b12-5ac1-bff8-a673cda46308 spider: ayvens.es
2026-01-27 20:04:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d41df1a3-7b12-5ac1-bff8-a673cda46308 due to rule: high_mileage_for_country.json, error: 170181 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170181
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd41df1a3-7b12-5ac1-bff8-a673cda46308',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 170181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41df1a3-7b12-5ac1-bff8-a673cda46308/d41df1a3-7b12-5ac1-bff8-a673cda46308_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/093/06e0108de6f5406a8107afb03d501f72/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875227%27 HTTP/1.1" 200 None
2026-01-27 20:04:02 [ayvens.es] INFO: Saving data for 1875227: {'created_time': 1769544242.072546, 'last_price_update_time': 1769544242.072558, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875227') HTTP/1.1" 204 0
2026-01-27 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/496/6c821acda27545eda7c1495123d19f82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:02 [ayvens.es] INFO: Found listing with ID: 1875244
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875244%27 HTTP/1.1" 200 None
2026-01-27 20:04:02 [ayvens.es] INFO: Scrape type for 1875244: 1
2026-01-27 20:04:02 [ayvens.es] INFO: Extracting data for car ID: 1875244
2026-01-27 20:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eaa5924-e19c-5dde-8c61-51cbde4949cc with identifier: 1875244
2026-01-27 20:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eaa5924-e19c-5dde-8c61-51cbde4949cc with scrape type 1
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0eaa5924-e19c-5dde-8c61-51cbde4949cc
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F102%252F33509b090ded440dbdf520ed7241e2f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/102/33509b090ded440dbdf520ed7241e2f8/images/large/1.jpg not downloaded yet
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5723504d0>
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a9767a-f8a2-5b24-aab6-f80eb851289e/18a9767a-f8a2-5b24-aab6-f80eb851289e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F691%252F777e3400b47d4609bc05bfab0365278a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/691/777e3400b47d4609bc05bfab0365278a/images/large/1.jpg saved to cache
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18a9767a-f8a2-5b24-aab6-f80eb851289e
2026-01-27 20:04:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18a9767a-f8a2-5b24-aab6-f80eb851289e, skipping ID generation
2026-01-27 20:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a9767a-f8a2-5b24-aab6-f80eb851289e with scrape type 1
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 18a9767a-f8a2-5b24-aab6-f80eb851289e from tracking dictionaries
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18a9767a-f8a2-5b24-aab6-f80eb851289e sending to next pipeline
2026-01-27 20:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 18a9767a-f8a2-5b24-aab6-f80eb851289e, identifier: 1875225
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572289690>
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c280748f-12cc-5a4a-b3d0-0832183141ac/c280748f-12cc-5a4a-b3d0-0832183141ac_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F878%252Fbc818027ced54eadbad2e8fdddf9f10d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/878/bc818027ced54eadbad2e8fdddf9f10d/images/large/1.jpg saved to cache
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c280748f-12cc-5a4a-b3d0-0832183141ac
2026-01-27 20:04:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c280748f-12cc-5a4a-b3d0-0832183141ac, skipping ID generation
2026-01-27 20:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c280748f-12cc-5a4a-b3d0-0832183141ac with scrape type 1
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c280748f-12cc-5a4a-b3d0-0832183141ac from tracking dictionaries
2026-01-27 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c280748f-12cc-5a4a-b3d0-0832183141ac sending to next pipeline
2026-01-27 20:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c280748f-12cc-5a4a-b3d0-0832183141ac, identifier: 1875226
2026-01-27 20:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 18a9767a-f8a2-5b24-aab6-f80eb851289e with identifier: 1875225
2026-01-27 20:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 18a9767a-f8a2-5b24-aab6-f80eb851289e with identifier: 1875225
2026-01-27 20:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 74696, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-22', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '18a9767a-f8a2-5b24-aab6-f80eb851289e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a9767a-f8a2-5b24-aab6-f80eb851289e/18a9767a-f8a2-5b24-aab6-f80eb851289e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/691/777e3400b47d4609bc05bfab0365278a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 340097}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74696}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '18a9767a-f8a2-5b24-aab6-f80eb851289e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 74696,
     'odometer_in_km': 74696,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a9767a-f8a2-5b24-aab6-f80eb851289e/18a9767a-f8a2-5b24-aab6-f80eb851289e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 340097,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/691/777e3400b47d4609bc05bfab0365278a/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-22',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
2026-01-27 20:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 18a9767a-f8a2-5b24-aab6-f80eb851289e spider: ayvens.es
2026-01-27 20:04:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 18a9767a-f8a2-5b24-aab6-f80eb851289e due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': 'active puretech 100 s&s bvm6', 'title': 'peugeot 2008 active puretech 100 s&s bvm6', 'price': 0, 'odometer': 74696, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-22', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 122, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '18a9767a-f8a2-5b24-aab6-f80eb851289e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a9767a-f8a2-5b24-aab6-f80eb851289e/18a9767a-f8a2-5b24-aab6-f80eb851289e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/691/777e3400b47d4609bc05bfab0365278a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 340097}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 74696}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 122,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '18a9767a-f8a2-5b24-aab6-f80eb851289e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 74696,
     'odometer_in_km': 74696,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a9767a-f8a2-5b24-aab6-f80eb851289e/18a9767a-f8a2-5b24-aab6-f80eb851289e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 340097,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/691/777e3400b47d4609bc05bfab0365278a/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-22',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 active puretech 100 s&s bvm6',
     'transmission': 'manual',
     'trim': 'active puretech 100 s&s bvm6',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '18a9767a-f8a2-5b24-aab6-f80eb851289e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 74696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a9767a-f8a2-5b24-aab6-f80eb851289e/18a9767a-f8a2-5b24-aab6-f80eb851289e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/691/777e3400b47d4609bc05bfab0365278a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875225%27 HTTP/1.1" 200 None
2026-01-27 20:04:03 [ayvens.es] INFO: Saving data for 1875225: {'created_time': 1769544243.315352, 'last_price_update_time': 1769544243.315366, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875225') HTTP/1.1" 204 0
2026-01-27 20:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c280748f-12cc-5a4a-b3d0-0832183141ac with identifier: 1875226
2026-01-27 20:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c280748f-12cc-5a4a-b3d0-0832183141ac with identifier: 1875226
2026-01-27 20:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c280748f-12cc-5a4a-b3d0-0832183141ac with identifier: 1875226 to the API
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/878/bc818027ced54eadbad2e8fdddf9f10d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c280748f-12cc-5a4a-b3d0-0832183141ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 92747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c280748f-12cc-5a4a-b3d0-0832183141ac/c280748f-12cc-5a4a-b3d0-0832183141ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/878/bc818027ced54eadbad2e8fdddf9f10d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875226%27 HTTP/1.1" 200 None
2026-01-27 20:04:03 [ayvens.es] INFO: Saving data for 1875226: {'created_time': 1769544243.822024, 'last_price_update_time': 1769544243.822036, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875226') HTTP/1.1" 204 0
2026-01-27 20:04:03 [ayvens.es] INFO: Found listing with ID: 1875245
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875245%27 HTTP/1.1" 200 None
2026-01-27 20:04:03 [ayvens.es] INFO: Scrape type for 1875245: 1
2026-01-27 20:04:03 [ayvens.es] INFO: Extracting data for car ID: 1875245
2026-01-27 20:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5160a61c-6ad0-52c4-8240-51882da9aa3b with identifier: 1875245
2026-01-27 20:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5160a61c-6ad0-52c4-8240-51882da9aa3b with scrape type 1
2026-01-27 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5160a61c-6ad0-52c4-8240-51882da9aa3b
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F1b8a530e10eb44ad97f54a3e800b39c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/1b8a530e10eb44ad97f54a3e800b39c6/images/large/1.jpg not downloaded yet
2026-01-27 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57227ba50>
2026-01-27 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff8270c2-a83b-5504-b8d0-30bf364234e8/ff8270c2-a83b-5504-b8d0-30bf364234e8_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F484%252Fa87b034580fb4dd59e7bf78628a7419e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/484/a87b034580fb4dd59e7bf78628a7419e/images/large/1.jpg saved to cache
2026-01-27 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff8270c2-a83b-5504-b8d0-30bf364234e8
2026-01-27 20:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff8270c2-a83b-5504-b8d0-30bf364234e8, skipping ID generation
2026-01-27 20:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8270c2-a83b-5504-b8d0-30bf364234e8 with scrape type 1
2026-01-27 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ff8270c2-a83b-5504-b8d0-30bf364234e8 from tracking dictionaries
2026-01-27 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff8270c2-a83b-5504-b8d0-30bf364234e8 sending to next pipeline
2026-01-27 20:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff8270c2-a83b-5504-b8d0-30bf364234e8, identifier: 1875230
2026-01-27 20:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/497/1e5fd8c5654e4a17b0569bfb33038cda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff8270c2-a83b-5504-b8d0-30bf364234e8 with identifier: 1875230
2026-01-27 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff8270c2-a83b-5504-b8d0-30bf364234e8 with identifier: 1875230
2026-01-27 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150664 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150664
2026-01-27 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ff8270c2-a83b-5504-b8d0-30bf364234e8 spider: ayvens.es
2026-01-27 20:04:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ff8270c2-a83b-5504-b8d0-30bf364234e8 due to rule: high_mileage_for_country.json, error: 150664 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150664
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff8270c2-a83b-5504-b8d0-30bf364234e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 150664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff8270c2-a83b-5504-b8d0-30bf364234e8/ff8270c2-a83b-5504-b8d0-30bf364234e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/484/a87b034580fb4dd59e7bf78628a7419e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT R-Line 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875230%27 HTTP/1.1" 200 None
2026-01-27 20:04:04 [ayvens.es] INFO: Saving data for 1875230: {'created_time': 1769544244.557408, 'last_price_update_time': 1769544244.557421, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875230') HTTP/1.1" 204 0
2026-01-27 20:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57090f9d0>
2026-01-27 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92635b15-9ab4-57a4-ba51-9043ac6233fb/92635b15-9ab4-57a4-ba51-9043ac6233fb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F496%252F6c821acda27545eda7c1495123d19f82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/496/6c821acda27545eda7c1495123d19f82/images/large/1.jpg saved to cache
2026-01-27 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92635b15-9ab4-57a4-ba51-9043ac6233fb
2026-01-27 20:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92635b15-9ab4-57a4-ba51-9043ac6233fb, skipping ID generation
2026-01-27 20:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92635b15-9ab4-57a4-ba51-9043ac6233fb with scrape type 1
2026-01-27 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 92635b15-9ab4-57a4-ba51-9043ac6233fb from tracking dictionaries
2026-01-27 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92635b15-9ab4-57a4-ba51-9043ac6233fb sending to next pipeline
2026-01-27 20:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 92635b15-9ab4-57a4-ba51-9043ac6233fb, identifier: 1875233
2026-01-27 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/067/d52cf83f9051449d9e26705d9ed52d29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:05 [ayvens.es] INFO: Found listing with ID: 1875246
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875246%27 HTTP/1.1" 200 None
2026-01-27 20:04:05 [ayvens.es] INFO: Scrape type for 1875246: 1
2026-01-27 20:04:05 [ayvens.es] INFO: Extracting data for car ID: 1875246
2026-01-27 20:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9a96fe3-3931-524c-84a6-a59ae558d2e0 with identifier: 1875246
2026-01-27 20:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9a96fe3-3931-524c-84a6-a59ae558d2e0 with scrape type 1
2026-01-27 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e9a96fe3-3931-524c-84a6-a59ae558d2e0
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F975%252F6fb8cfff354140b3b31e862e60fed7dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/975/6fb8cfff354140b3b31e862e60fed7dd/images/large/1.jpg not downloaded yet
2026-01-27 20:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 92635b15-9ab4-57a4-ba51-9043ac6233fb with identifier: 1875233
2026-01-27 20:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 92635b15-9ab4-57a4-ba51-9043ac6233fb with identifier: 1875233
2026-01-27 20:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 92635b15-9ab4-57a4-ba51-9043ac6233fb with identifier: 1875233 to the API
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/496/6c821acda27545eda7c1495123d19f82/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '92635b15-9ab4-57a4-ba51-9043ac6233fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 75991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92635b15-9ab4-57a4-ba51-9043ac6233fb/92635b15-9ab4-57a4-ba51-9043ac6233fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/496/6c821acda27545eda7c1495123d19f82/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) GS-Line',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) GS-Line',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875233%27 HTTP/1.1" 200 None
2026-01-27 20:04:05 [ayvens.es] INFO: Saving data for 1875233: {'created_time': 1769544245.39684, 'last_price_update_time': 1769544245.396852, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875233') HTTP/1.1" 204 0
2026-01-27 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/365/b4a0d64f3ec64be19a3148ed97a03229/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/879/3a13634c2b6c4ef2acef4f08060aa5fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/971/fbf41c7497b148fcb4ce42c283e6521a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:05 [ayvens.es] INFO: Found listing with ID: 1875247
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875247%27 HTTP/1.1" 200 None
2026-01-27 20:04:05 [ayvens.es] INFO: Scrape type for 1875247: 1
2026-01-27 20:04:05 [ayvens.es] INFO: Extracting data for car ID: 1875247
2026-01-27 20:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42a82b42-b820-5a7e-a6ff-13873e05b75e with identifier: 1875247
2026-01-27 20:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a82b42-b820-5a7e-a6ff-13873e05b75e with scrape type 1
2026-01-27 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 42a82b42-b820-5a7e-a6ff-13873e05b75e
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252F7edace2d1ba54aab9e0bc80946d9aa07%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/7edace2d1ba54aab9e0bc80946d9aa07/images/large/1.jpg not downloaded yet
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724af150>
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f686ee9-b7ec-507c-bac9-c943ea8e92f5/8f686ee9-b7ec-507c-bac9-c943ea8e92f5_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F497%252F1e5fd8c5654e4a17b0569bfb33038cda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/497/1e5fd8c5654e4a17b0569bfb33038cda/images/large/1.jpg saved to cache
2026-01-27 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f686ee9-b7ec-507c-bac9-c943ea8e92f5
2026-01-27 20:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f686ee9-b7ec-507c-bac9-c943ea8e92f5, skipping ID generation
2026-01-27 20:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f686ee9-b7ec-507c-bac9-c943ea8e92f5 with scrape type 1
2026-01-27 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8f686ee9-b7ec-507c-bac9-c943ea8e92f5 from tracking dictionaries
2026-01-27 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f686ee9-b7ec-507c-bac9-c943ea8e92f5 sending to next pipeline
2026-01-27 20:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8f686ee9-b7ec-507c-bac9-c943ea8e92f5, identifier: 1875234
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57092b950>
2026-01-27 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a5c382-e194-56a0-a2a2-f631f9fe838e/68a5c382-e194-56a0-a2a2-f631f9fe838e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252Fd52cf83f9051449d9e26705d9ed52d29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/d52cf83f9051449d9e26705d9ed52d29/images/large/1.jpg saved to cache
2026-01-27 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68a5c382-e194-56a0-a2a2-f631f9fe838e
2026-01-27 20:04:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68a5c382-e194-56a0-a2a2-f631f9fe838e, skipping ID generation
2026-01-27 20:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a5c382-e194-56a0-a2a2-f631f9fe838e with scrape type 1
2026-01-27 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 68a5c382-e194-56a0-a2a2-f631f9fe838e from tracking dictionaries
2026-01-27 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68a5c382-e194-56a0-a2a2-f631f9fe838e sending to next pipeline
2026-01-27 20:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 68a5c382-e194-56a0-a2a2-f631f9fe838e, identifier: 1875236
2026-01-27 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/499/c91e39fdae274b639194f47bf5a63c81/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:06 [ayvens.es] INFO: Found listing with ID: 1875248
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875248%27 HTTP/1.1" 200 None
2026-01-27 20:04:06 [ayvens.es] INFO: Scrape type for 1875248: 1
2026-01-27 20:04:06 [ayvens.es] INFO: Extracting data for car ID: 1875248
2026-01-27 20:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84b952c-e838-59e4-9c64-9f972d3be951 with identifier: 1875248
2026-01-27 20:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84b952c-e838-59e4-9c64-9f972d3be951 with scrape type 1
2026-01-27 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d84b952c-e838-59e4-9c64-9f972d3be951
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F082%252F56fbaf8abacb455e8a3220df5cc394ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/082/56fbaf8abacb455e8a3220df5cc394ee/images/large/1.jpg not downloaded yet
2026-01-27 20:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8f686ee9-b7ec-507c-bac9-c943ea8e92f5 with identifier: 1875234
2026-01-27 20:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8f686ee9-b7ec-507c-bac9-c943ea8e92f5 with identifier: 1875234
2026-01-27 20:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8f686ee9-b7ec-507c-bac9-c943ea8e92f5 with identifier: 1875234 to the API
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/497/1e5fd8c5654e4a17b0569bfb33038cda/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '8f686ee9-b7ec-507c-bac9-c943ea8e92f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 125591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f686ee9-b7ec-507c-bac9-c943ea8e92f5/8f686ee9-b7ec-507c-bac9-c943ea8e92f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/497/1e5fd8c5654e4a17b0569bfb33038cda/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875234%27 HTTP/1.1" 200 None
2026-01-27 20:04:06 [ayvens.es] INFO: Saving data for 1875234: {'created_time': 1769544246.666792, 'last_price_update_time': 1769544246.666802, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875234') HTTP/1.1" 204 0
2026-01-27 20:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 68a5c382-e194-56a0-a2a2-f631f9fe838e with identifier: 1875236
2026-01-27 20:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 68a5c382-e194-56a0-a2a2-f631f9fe838e with identifier: 1875236
2026-01-27 20:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 68a5c382-e194-56a0-a2a2-f631f9fe838e with identifier: 1875236 to the API
2026-01-27 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/067/d52cf83f9051449d9e26705d9ed52d29/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '68a5c382-e194-56a0-a2a2-f631f9fe838e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 65261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68a5c382-e194-56a0-a2a2-f631f9fe838e/68a5c382-e194-56a0-a2a2-f631f9fe838e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/067/d52cf83f9051449d9e26705d9ed52d29/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 110kW DSG-7 S&S Xcellence',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW DSG-7 S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875236%27 HTTP/1.1" 200 None
2026-01-27 20:04:07 [ayvens.es] INFO: Saving data for 1875236: {'created_time': 1769544247.158122, 'last_price_update_time': 1769544247.158137, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875236') HTTP/1.1" 204 0
2026-01-27 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/786/2d3bdaaf54784a5099767662dbffa49c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:07 [ayvens.es] INFO: Found listing with ID: 1875249
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875249%27 HTTP/1.1" 200 None
2026-01-27 20:04:07 [ayvens.es] INFO: Scrape type for 1875249: 1
2026-01-27 20:04:07 [ayvens.es] INFO: Extracting data for car ID: 1875249
2026-01-27 20:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4ba25b2-6dbc-5f84-a971-afa9297a48c4 with identifier: 1875249
2026-01-27 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4ba25b2-6dbc-5f84-a971-afa9297a48c4 with scrape type 1
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c4ba25b2-6dbc-5f84-a971-afa9297a48c4
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F153%252F40ebd7b86ca04b5d8c41ffe0054bac01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/153/40ebd7b86ca04b5d8c41ffe0054bac01/images/large/1.jpg not downloaded yet
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a7a550>
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b5e02e-5461-528d-b9ce-be055209634c/24b5e02e-5461-528d-b9ce-be055209634c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Fb4a0d64f3ec64be19a3148ed97a03229%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/b4a0d64f3ec64be19a3148ed97a03229/images/large/1.jpg saved to cache
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24b5e02e-5461-528d-b9ce-be055209634c
2026-01-27 20:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24b5e02e-5461-528d-b9ce-be055209634c, skipping ID generation
2026-01-27 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b5e02e-5461-528d-b9ce-be055209634c with scrape type 1
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 24b5e02e-5461-528d-b9ce-be055209634c from tracking dictionaries
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24b5e02e-5461-528d-b9ce-be055209634c sending to next pipeline
2026-01-27 20:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 24b5e02e-5461-528d-b9ce-be055209634c, identifier: 1875235
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572652310>
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a92ae0-04d5-516c-a852-26fca3b8465c/70a92ae0-04d5-516c-a852-26fca3b8465c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F879%252F3a13634c2b6c4ef2acef4f08060aa5fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/879/3a13634c2b6c4ef2acef4f08060aa5fc/images/large/1.jpg saved to cache
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70a92ae0-04d5-516c-a852-26fca3b8465c
2026-01-27 20:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70a92ae0-04d5-516c-a852-26fca3b8465c, skipping ID generation
2026-01-27 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70a92ae0-04d5-516c-a852-26fca3b8465c with scrape type 1
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70a92ae0-04d5-516c-a852-26fca3b8465c from tracking dictionaries
2026-01-27 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70a92ae0-04d5-516c-a852-26fca3b8465c sending to next pipeline
2026-01-27 20:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70a92ae0-04d5-516c-a852-26fca3b8465c, identifier: 1875238
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722a0e10>
2026-01-27 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_911348e9-cdcd-53c2-b860-8765b46b9714/911348e9-cdcd-53c2-b860-8765b46b9714_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F971%252Ffbf41c7497b148fcb4ce42c283e6521a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/971/fbf41c7497b148fcb4ce42c283e6521a/images/large/1.jpg saved to cache
2026-01-27 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 911348e9-cdcd-53c2-b860-8765b46b9714
2026-01-27 20:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 911348e9-cdcd-53c2-b860-8765b46b9714, skipping ID generation
2026-01-27 20:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 911348e9-cdcd-53c2-b860-8765b46b9714 with scrape type 1
2026-01-27 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 911348e9-cdcd-53c2-b860-8765b46b9714 from tracking dictionaries
2026-01-27 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 911348e9-cdcd-53c2-b860-8765b46b9714 sending to next pipeline
2026-01-27 20:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 911348e9-cdcd-53c2-b860-8765b46b9714, identifier: 1875231
2026-01-27 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/406/8c4a4a7190e94a0e8ee27cccdb82e210/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 24b5e02e-5461-528d-b9ce-be055209634c with identifier: 1875235
2026-01-27 20:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 24b5e02e-5461-528d-b9ce-be055209634c with identifier: 1875235
2026-01-27 20:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 24b5e02e-5461-528d-b9ce-be055209634c with identifier: 1875235 to the API
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/365/b4a0d64f3ec64be19a3148ed97a03229/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '24b5e02e-5461-528d-b9ce-be055209634c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 118977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b5e02e-5461-528d-b9ce-be055209634c/24b5e02e-5461-528d-b9ce-be055209634c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/365/b4a0d64f3ec64be19a3148ed97a03229/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875235%27 HTTP/1.1" 200 None
2026-01-27 20:04:08 [ayvens.es] INFO: Saving data for 1875235: {'created_time': 1769544248.803227, 'last_price_update_time': 1769544248.803241, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875235') HTTP/1.1" 204 0
2026-01-27 20:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70a92ae0-04d5-516c-a852-26fca3b8465c with identifier: 1875238
2026-01-27 20:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70a92ae0-04d5-516c-a852-26fca3b8465c with identifier: 1875238
2026-01-27 20:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 70a92ae0-04d5-516c-a852-26fca3b8465c with identifier: 1875238 to the API
2026-01-27 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/879/3a13634c2b6c4ef2acef4f08060aa5fc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '70a92ae0-04d5-516c-a852-26fca3b8465c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 55446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70a92ae0-04d5-516c-a852-26fca3b8465c/70a92ae0-04d5-516c-a852-26fca3b8465c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/879/3a13634c2b6c4ef2acef4f08060aa5fc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875238%27 HTTP/1.1" 200 None
2026-01-27 20:04:09 [ayvens.es] INFO: Saving data for 1875238: {'created_time': 1769544249.251017, 'last_price_update_time': 1769544249.25103, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875238') HTTP/1.1" 204 0
2026-01-27 20:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 911348e9-cdcd-53c2-b860-8765b46b9714 with identifier: 1875231
2026-01-27 20:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 911348e9-cdcd-53c2-b860-8765b46b9714 with identifier: 1875231
2026-01-27 20:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 911348e9-cdcd-53c2-b860-8765b46b9714 with identifier: 1875231 to the API
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/971/fbf41c7497b148fcb4ce42c283e6521a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '911348e9-cdcd-53c2-b860-8765b46b9714',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 123038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_911348e9-cdcd-53c2-b860-8765b46b9714/911348e9-cdcd-53c2-b860-8765b46b9714_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/971/fbf41c7497b148fcb4ce42c283e6521a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 TSI 70kW (95CV) Style',
 'transmission': 'manual',
 'trim': '1.0 TSI 70kW (95CV) Style',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875231%27 HTTP/1.1" 200 None
2026-01-27 20:04:09 [ayvens.es] INFO: Saving data for 1875231: {'created_time': 1769544249.704524, 'last_price_update_time': 1769544249.704536, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875231') HTTP/1.1" 204 0
2026-01-27 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/222/79aef1a3585a4d83937971f653a7c977/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:09 [ayvens.es] INFO: Found listing with ID: 1875250
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875250%27 HTTP/1.1" 200 None
2026-01-27 20:04:09 [ayvens.es] INFO: Scrape type for 1875250: 1
2026-01-27 20:04:09 [ayvens.es] INFO: Extracting data for car ID: 1875250
2026-01-27 20:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e54487c-1b8e-541c-8369-22cbe9a915b8 with identifier: 1875250
2026-01-27 20:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e54487c-1b8e-541c-8369-22cbe9a915b8 with scrape type 1
2026-01-27 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5e54487c-1b8e-541c-8369-22cbe9a915b8
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F704%252Fe6c1b39b58aa45aa849649d0e066b99c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/704/e6c1b39b58aa45aa849649d0e066b99c/images/large/1.jpg not downloaded yet
2026-01-27 20:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d09d0>
2026-01-27 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4456be8-46d0-50c0-9e46-df65aa331dce/f4456be8-46d0-50c0-9e46-df65aa331dce_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252Fc91e39fdae274b639194f47bf5a63c81%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/c91e39fdae274b639194f47bf5a63c81/images/large/1.jpg saved to cache
2026-01-27 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4456be8-46d0-50c0-9e46-df65aa331dce
2026-01-27 20:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4456be8-46d0-50c0-9e46-df65aa331dce, skipping ID generation
2026-01-27 20:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4456be8-46d0-50c0-9e46-df65aa331dce with scrape type 1
2026-01-27 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f4456be8-46d0-50c0-9e46-df65aa331dce from tracking dictionaries
2026-01-27 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4456be8-46d0-50c0-9e46-df65aa331dce sending to next pipeline
2026-01-27 20:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f4456be8-46d0-50c0-9e46-df65aa331dce, identifier: 1875237
2026-01-27 20:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f4456be8-46d0-50c0-9e46-df65aa331dce with identifier: 1875237
2026-01-27 20:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f4456be8-46d0-50c0-9e46-df65aa331dce with identifier: 1875237
2026-01-27 20:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f4456be8-46d0-50c0-9e46-df65aa331dce with identifier: 1875237 to the API
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/499/c91e39fdae274b639194f47bf5a63c81/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f4456be8-46d0-50c0-9e46-df65aa331dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 74819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4456be8-46d0-50c0-9e46-df65aa331dce/f4456be8-46d0-50c0-9e46-df65aa331dce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/499/c91e39fdae274b639194f47bf5a63c81/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.6 TDI 85kW S&S Style Visio Ed Nav',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW S&S Style Visio Ed Nav',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875237%27 HTTP/1.1" 200 None
2026-01-27 20:04:10 [ayvens.es] INFO: Saving data for 1875237: {'created_time': 1769544250.541352, 'last_price_update_time': 1769544250.541363, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875237') HTTP/1.1" 204 0
2026-01-27 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/047/dcc7bb1b63f842d08a4239fae9b00831/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:10 [ayvens.es] INFO: Found listing with ID: 1875251
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875251%27 HTTP/1.1" 200 None
2026-01-27 20:04:10 [ayvens.es] INFO: Scrape type for 1875251: 1
2026-01-27 20:04:10 [ayvens.es] INFO: Extracting data for car ID: 1875251
2026-01-27 20:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 with identifier: 1875251
2026-01-27 20:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 with scrape type 1
2026-01-27 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 86ecb9c1-082b-574e-a51c-0c7cde20f3c6
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F6f8f0610023d407aa6913c91dc280f9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/6f8f0610023d407aa6913c91dc280f9f/images/large/1.jpg not downloaded yet
2026-01-27 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/501/7881b13395054fb2a9b311d32d5ed1a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725ccc50>
2026-01-27 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ef9e53-4995-51ed-96cf-5dfd8ad26c4e/17ef9e53-4995-51ed-96cf-5dfd8ad26c4e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F786%252F2d3bdaaf54784a5099767662dbffa49c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/786/2d3bdaaf54784a5099767662dbffa49c/images/large/1.jpg saved to cache
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e
2026-01-27 20:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e, skipping ID generation
2026-01-27 20:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e with scrape type 1
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e from tracking dictionaries
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e sending to next pipeline
2026-01-27 20:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e, identifier: 1875240
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572385c90>
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c38fe912-8beb-5ad4-96c4-7bf168b4f95d/c38fe912-8beb-5ad4-96c4-7bf168b4f95d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252F8c4a4a7190e94a0e8ee27cccdb82e210%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/8c4a4a7190e94a0e8ee27cccdb82e210/images/large/1.jpg saved to cache
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c38fe912-8beb-5ad4-96c4-7bf168b4f95d
2026-01-27 20:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c38fe912-8beb-5ad4-96c4-7bf168b4f95d, skipping ID generation
2026-01-27 20:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38fe912-8beb-5ad4-96c4-7bf168b4f95d with scrape type 1
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c38fe912-8beb-5ad4-96c4-7bf168b4f95d from tracking dictionaries
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c38fe912-8beb-5ad4-96c4-7bf168b4f95d sending to next pipeline
2026-01-27 20:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c38fe912-8beb-5ad4-96c4-7bf168b4f95d, identifier: 1875241
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57090c550>
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fd630-24c9-5862-adee-900e0dd29343/6e7fd630-24c9-5862-adee-900e0dd29343_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F222%252F79aef1a3585a4d83937971f653a7c977%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/222/79aef1a3585a4d83937971f653a7c977/images/large/1.jpg saved to cache
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e7fd630-24c9-5862-adee-900e0dd29343
2026-01-27 20:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e7fd630-24c9-5862-adee-900e0dd29343, skipping ID generation
2026-01-27 20:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7fd630-24c9-5862-adee-900e0dd29343 with scrape type 1
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6e7fd630-24c9-5862-adee-900e0dd29343 from tracking dictionaries
2026-01-27 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e7fd630-24c9-5862-adee-900e0dd29343 sending to next pipeline
2026-01-27 20:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6e7fd630-24c9-5862-adee-900e0dd29343, identifier: 1875239
2026-01-27 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/102/33509b090ded440dbdf520ed7241e2f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:12 [ayvens.es] INFO: Found listing with ID: 1875252
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875252%27 HTTP/1.1" 200 None
2026-01-27 20:04:12 [ayvens.es] INFO: Scrape type for 1875252: 1
2026-01-27 20:04:12 [ayvens.es] INFO: Extracting data for car ID: 1875252
2026-01-27 20:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc41b510-3d9d-5fad-8c79-e95b338be0cb with identifier: 1875252
2026-01-27 20:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc41b510-3d9d-5fad-8c79-e95b338be0cb with scrape type 1
2026-01-27 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc41b510-3d9d-5fad-8c79-e95b338be0cb
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F066%252F725bb84a2eb3418c9bcdb2222b1fe41d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/066/725bb84a2eb3418c9bcdb2222b1fe41d/images/large/1.jpg not downloaded yet
2026-01-27 20:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e with identifier: 1875240
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e with identifier: 1875240
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e spider: ayvens.es
2026-01-27 20:04:12 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 17ef9e53-4995-51ed-96cf-5dfd8ad26c4e due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '17ef9e53-4995-51ed-96cf-5dfd8ad26c4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 121638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ef9e53-4995-51ed-96cf-5dfd8ad26c4e/17ef9e53-4995-51ed-96cf-5dfd8ad26c4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/786/2d3bdaaf54784a5099767662dbffa49c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS (C) 1.5 TDCi E6 120cv Trend+',
 'transmission': 'manual',
 'trim': '(C) 1.5 TDCi E6 120cv Trend+',
 'vin': None,
 'year': 2016}
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875240%27 HTTP/1.1" 200 None
2026-01-27 20:04:12 [ayvens.es] INFO: Saving data for 1875240: {'created_time': 1769544252.327028, 'last_price_update_time': 1769544252.327041, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875240') HTTP/1.1" 204 0
2026-01-27 20:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c38fe912-8beb-5ad4-96c4-7bf168b4f95d with identifier: 1875241
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c38fe912-8beb-5ad4-96c4-7bf168b4f95d with identifier: 1875241
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 147304 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147304
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: c38fe912-8beb-5ad4-96c4-7bf168b4f95d spider: ayvens.es
2026-01-27 20:04:12 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c38fe912-8beb-5ad4-96c4-7bf168b4f95d due to rule: high_mileage_for_make.json, error: 147304 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147304
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c38fe912-8beb-5ad4-96c4-7bf168b4f95d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 147304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fe912-8beb-5ad4-96c4-7bf168b4f95d/c38fe912-8beb-5ad4-96c4-7bf168b4f95d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/406/8c4a4a7190e94a0e8ee27cccdb82e210/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875241%27 HTTP/1.1" 200 None
2026-01-27 20:04:12 [ayvens.es] INFO: Saving data for 1875241: {'created_time': 1769544252.593365, 'last_price_update_time': 1769544252.59338, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875241') HTTP/1.1" 204 0
2026-01-27 20:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6e7fd630-24c9-5862-adee-900e0dd29343 with identifier: 1875239
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6e7fd630-24c9-5862-adee-900e0dd29343 with identifier: 1875239
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-27 20:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6e7fd630-24c9-5862-adee-900e0dd29343 spider: ayvens.es
2026-01-27 20:04:12 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6e7fd630-24c9-5862-adee-900e0dd29343 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6e7fd630-24c9-5862-adee-900e0dd29343',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'PANDA',
 'odometer': 48301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fd630-24c9-5862-adee-900e0dd29343/6e7fd630-24c9-5862-adee-900e0dd29343_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/222/79aef1a3585a4d83937971f653a7c977/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT PANDA 1.2 Lounge 51kW (69CV)',
 'transmission': 'manual',
 'trim': '1.2 Lounge 51kW (69CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875239%27 HTTP/1.1" 200 None
2026-01-27 20:04:12 [ayvens.es] INFO: Saving data for 1875239: {'created_time': 1769544252.839002, 'last_price_update_time': 1769544252.839016, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875239') HTTP/1.1" 204 0
2026-01-27 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/1b8a530e10eb44ad97f54a3e800b39c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:12 [ayvens.es] INFO: Found listing with ID: 1875253
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875253%27 HTTP/1.1" 200 None
2026-01-27 20:04:12 [ayvens.es] INFO: Scrape type for 1875253: 1
2026-01-27 20:04:12 [ayvens.es] INFO: Extracting data for car ID: 1875253
2026-01-27 20:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c31c0c8-61a6-5906-8928-3a160b65eb0e with identifier: 1875253
2026-01-27 20:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c31c0c8-61a6-5906-8928-3a160b65eb0e with scrape type 1
2026-01-27 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3c31c0c8-61a6-5906-8928-3a160b65eb0e
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F866%252Fde891a78e31a4345ba664dd074b40c0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/866/de891a78e31a4345ba664dd074b40c0d/images/large/1.jpg not downloaded yet
2026-01-27 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/975/6fb8cfff354140b3b31e862e60fed7dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5727a0e10>
2026-01-27 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee523f2-808a-56fd-b83e-fe86a4e39ffa/6ee523f2-808a-56fd-b83e-fe86a4e39ffa_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252Fdcc7bb1b63f842d08a4239fae9b00831%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/dcc7bb1b63f842d08a4239fae9b00831/images/large/1.jpg saved to cache
2026-01-27 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ee523f2-808a-56fd-b83e-fe86a4e39ffa
2026-01-27 20:04:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ee523f2-808a-56fd-b83e-fe86a4e39ffa, skipping ID generation
2026-01-27 20:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ee523f2-808a-56fd-b83e-fe86a4e39ffa with scrape type 1
2026-01-27 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6ee523f2-808a-56fd-b83e-fe86a4e39ffa from tracking dictionaries
2026-01-27 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ee523f2-808a-56fd-b83e-fe86a4e39ffa sending to next pipeline
2026-01-27 20:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6ee523f2-808a-56fd-b83e-fe86a4e39ffa, identifier: 1875243
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57213ee10>
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d95e2e-b51c-5bdd-acd8-64ab8057f920/e5d95e2e-b51c-5bdd-acd8-64ab8057f920_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F501%252F7881b13395054fb2a9b311d32d5ed1a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/501/7881b13395054fb2a9b311d32d5ed1a2/images/large/1.jpg saved to cache
2026-01-27 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5d95e2e-b51c-5bdd-acd8-64ab8057f920
2026-01-27 20:04:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5d95e2e-b51c-5bdd-acd8-64ab8057f920, skipping ID generation
2026-01-27 20:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d95e2e-b51c-5bdd-acd8-64ab8057f920 with scrape type 1
2026-01-27 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e5d95e2e-b51c-5bdd-acd8-64ab8057f920 from tracking dictionaries
2026-01-27 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5d95e2e-b51c-5bdd-acd8-64ab8057f920 sending to next pipeline
2026-01-27 20:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e5d95e2e-b51c-5bdd-acd8-64ab8057f920, identifier: 1875242
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57267c610>
2026-01-27 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaa5924-e19c-5dde-8c61-51cbde4949cc/0eaa5924-e19c-5dde-8c61-51cbde4949cc_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F102%252F33509b090ded440dbdf520ed7241e2f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/102/33509b090ded440dbdf520ed7241e2f8/images/large/1.jpg saved to cache
2026-01-27 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eaa5924-e19c-5dde-8c61-51cbde4949cc
2026-01-27 20:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eaa5924-e19c-5dde-8c61-51cbde4949cc, skipping ID generation
2026-01-27 20:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eaa5924-e19c-5dde-8c61-51cbde4949cc with scrape type 1
2026-01-27 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0eaa5924-e19c-5dde-8c61-51cbde4949cc from tracking dictionaries
2026-01-27 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eaa5924-e19c-5dde-8c61-51cbde4949cc sending to next pipeline
2026-01-27 20:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0eaa5924-e19c-5dde-8c61-51cbde4949cc, identifier: 1875244
2026-01-27 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/682/7edace2d1ba54aab9e0bc80946d9aa07/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:14 [ayvens.es] INFO: Found listing with ID: 1875254
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875254%27 HTTP/1.1" 200 None
2026-01-27 20:04:14 [ayvens.es] INFO: Scrape type for 1875254: 1
2026-01-27 20:04:14 [ayvens.es] INFO: Extracting data for car ID: 1875254
2026-01-27 20:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77e854fd-27e9-5f4c-864d-a442168f6590 with identifier: 1875254
2026-01-27 20:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77e854fd-27e9-5f4c-864d-a442168f6590 with scrape type 1
2026-01-27 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77e854fd-27e9-5f4c-864d-a442168f6590
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F231%252Fc7003d354fc943b7a7d445be8966f5cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/231/c7003d354fc943b7a7d445be8966f5cd/images/large/1.jpg not downloaded yet
2026-01-27 20:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6ee523f2-808a-56fd-b83e-fe86a4e39ffa with identifier: 1875243
2026-01-27 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6ee523f2-808a-56fd-b83e-fe86a4e39ffa with identifier: 1875243
2026-01-27 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134623 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134623
2026-01-27 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 6ee523f2-808a-56fd-b83e-fe86a4e39ffa spider: ayvens.es
2026-01-27 20:04:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6ee523f2-808a-56fd-b83e-fe86a4e39ffa due to rule: high_mileage_for_make.json, error: 134623 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134623
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6ee523f2-808a-56fd-b83e-fe86a4e39ffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 134623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee523f2-808a-56fd-b83e-fe86a4e39ffa/6ee523f2-808a-56fd-b83e-fe86a4e39ffa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/047/dcc7bb1b63f842d08a4239fae9b00831/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875243%27 HTTP/1.1" 200 None
2026-01-27 20:04:14 [ayvens.es] INFO: Saving data for 1875243: {'created_time': 1769544254.605436, 'last_price_update_time': 1769544254.605446, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875243') HTTP/1.1" 204 0
2026-01-27 20:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e5d95e2e-b51c-5bdd-acd8-64ab8057f920 with identifier: 1875242
2026-01-27 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e5d95e2e-b51c-5bdd-acd8-64ab8057f920 with identifier: 1875242
2026-01-27 20:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e5d95e2e-b51c-5bdd-acd8-64ab8057f920 with identifier: 1875242 to the API
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/501/7881b13395054fb2a9b311d32d5ed1a2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e5d95e2e-b51c-5bdd-acd8-64ab8057f920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 123553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d95e2e-b51c-5bdd-acd8-64ab8057f920/e5d95e2e-b51c-5bdd-acd8-64ab8057f920_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/501/7881b13395054fb2a9b311d32d5ed1a2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) Emotion',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Emotion',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875242%27 HTTP/1.1" 200 None
2026-01-27 20:04:15 [ayvens.es] INFO: Saving data for 1875242: {'created_time': 1769544255.02982, 'last_price_update_time': 1769544255.029834, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875242') HTTP/1.1" 204 0
2026-01-27 20:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0eaa5924-e19c-5dde-8c61-51cbde4949cc with identifier: 1875244
2026-01-27 20:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0eaa5924-e19c-5dde-8c61-51cbde4949cc with identifier: 1875244
2026-01-27 20:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'puretech 60kw (83cv) c-series', 'title': 'citroën c3 puretech 60kw (83cv) c-series', 'price': 0, 'odometer': 27972, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-22', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 130, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0eaa5924-e19c-5dde-8c61-51cbde4949cc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaa5924-e19c-5dde-8c61-51cbde4949cc/0eaa5924-e19c-5dde-8c61-51cbde4949cc_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/102/33509b090ded440dbdf520ed7241e2f8/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411303}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 27972}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'color': 'gris',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '0eaa5924-e19c-5dde-8c61-51cbde4949cc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c3',
     'model': 'c3',
     'odometer': 27972,
     'odometer_in_km': 27972,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaa5924-e19c-5dde-8c61-51cbde4949cc/0eaa5924-e19c-5dde-8c61-51cbde4949cc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 411303,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/102/33509b090ded440dbdf520ed7241e2f8/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-22',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c3 puretech 60kw (83cv) c-series',
     'transmission': 'manual',
     'trim': 'puretech 60kw (83cv) c-series',
     'vin': None,
     'year': 2020}
2026-01-27 20:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0eaa5924-e19c-5dde-8c61-51cbde4949cc spider: ayvens.es
2026-01-27 20:04:15 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0eaa5924-e19c-5dde-8c61-51cbde4949cc due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'puretech 60kw (83cv) c-series', 'title': 'citroën c3 puretech 60kw (83cv) c-series', 'price': 0, 'odometer': 27972, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-22', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 130, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0eaa5924-e19c-5dde-8c61-51cbde4949cc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaa5924-e19c-5dde-8c61-51cbde4949cc/0eaa5924-e19c-5dde-8c61-51cbde4949cc_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/102/33509b090ded440dbdf520ed7241e2f8/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411303}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 27972}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'color': 'gris',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '0eaa5924-e19c-5dde-8c61-51cbde4949cc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c3',
     'model': 'c3',
     'odometer': 27972,
     'odometer_in_km': 27972,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaa5924-e19c-5dde-8c61-51cbde4949cc/0eaa5924-e19c-5dde-8c61-51cbde4949cc_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 411303,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/102/33509b090ded440dbdf520ed7241e2f8/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-22',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c3 puretech 60kw (83cv) c-series',
     'transmission': 'manual',
     'trim': 'puretech 60kw (83cv) c-series',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0eaa5924-e19c-5dde-8c61-51cbde4949cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 27972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaa5924-e19c-5dde-8c61-51cbde4949cc/0eaa5924-e19c-5dde-8c61-51cbde4949cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/102/33509b090ded440dbdf520ed7241e2f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 PureTech 60KW (83CV) C-Series',
 'transmission': 'manual',
 'trim': 'PureTech 60KW (83CV) C-Series',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875244%27 HTTP/1.1" 200 None
2026-01-27 20:04:15 [ayvens.es] INFO: Saving data for 1875244: {'created_time': 1769544255.277445, 'last_price_update_time': 1769544255.277455, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875244') HTTP/1.1" 204 0
2026-01-27 20:04:15 [ayvens.es] INFO: Found listing with ID: 1875255
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875255%27 HTTP/1.1" 200 None
2026-01-27 20:04:15 [ayvens.es] INFO: Scrape type for 1875255: 1
2026-01-27 20:04:15 [ayvens.es] INFO: Extracting data for car ID: 1875255
2026-01-27 20:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7dd7f3-9fda-54d0-beff-5fb16092289c with identifier: 1875255
2026-01-27 20:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7dd7f3-9fda-54d0-beff-5fb16092289c with scrape type 1
2026-01-27 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8c7dd7f3-9fda-54d0-beff-5fb16092289c
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F570%252F1e70c63155184505b588b89b8bc8aeaf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/570/1e70c63155184505b588b89b8bc8aeaf/images/large/1.jpg not downloaded yet
2026-01-27 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/082/56fbaf8abacb455e8a3220df5cc394ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57091a250>
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5160a61c-6ad0-52c4-8240-51882da9aa3b/5160a61c-6ad0-52c4-8240-51882da9aa3b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F1b8a530e10eb44ad97f54a3e800b39c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/1b8a530e10eb44ad97f54a3e800b39c6/images/large/1.jpg saved to cache
2026-01-27 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5160a61c-6ad0-52c4-8240-51882da9aa3b
2026-01-27 20:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5160a61c-6ad0-52c4-8240-51882da9aa3b, skipping ID generation
2026-01-27 20:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5160a61c-6ad0-52c4-8240-51882da9aa3b with scrape type 1
2026-01-27 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5160a61c-6ad0-52c4-8240-51882da9aa3b from tracking dictionaries
2026-01-27 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5160a61c-6ad0-52c4-8240-51882da9aa3b sending to next pipeline
2026-01-27 20:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5160a61c-6ad0-52c4-8240-51882da9aa3b, identifier: 1875245
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572279c50>
2026-01-27 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a96fe3-3931-524c-84a6-a59ae558d2e0/e9a96fe3-3931-524c-84a6-a59ae558d2e0_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F975%252F6fb8cfff354140b3b31e862e60fed7dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/975/6fb8cfff354140b3b31e862e60fed7dd/images/large/1.jpg saved to cache
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9a96fe3-3931-524c-84a6-a59ae558d2e0
2026-01-27 20:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9a96fe3-3931-524c-84a6-a59ae558d2e0, skipping ID generation
2026-01-27 20:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9a96fe3-3931-524c-84a6-a59ae558d2e0 with scrape type 1
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e9a96fe3-3931-524c-84a6-a59ae558d2e0 from tracking dictionaries
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9a96fe3-3931-524c-84a6-a59ae558d2e0 sending to next pipeline
2026-01-27 20:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e9a96fe3-3931-524c-84a6-a59ae558d2e0, identifier: 1875246
2026-01-27 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57258cc50>
2026-01-27 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a82b42-b820-5a7e-a6ff-13873e05b75e/42a82b42-b820-5a7e-a6ff-13873e05b75e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252F7edace2d1ba54aab9e0bc80946d9aa07%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/7edace2d1ba54aab9e0bc80946d9aa07/images/large/1.jpg saved to cache
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42a82b42-b820-5a7e-a6ff-13873e05b75e
2026-01-27 20:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42a82b42-b820-5a7e-a6ff-13873e05b75e, skipping ID generation
2026-01-27 20:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a82b42-b820-5a7e-a6ff-13873e05b75e with scrape type 1
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 42a82b42-b820-5a7e-a6ff-13873e05b75e from tracking dictionaries
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42a82b42-b820-5a7e-a6ff-13873e05b75e sending to next pipeline
2026-01-27 20:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 42a82b42-b820-5a7e-a6ff-13873e05b75e, identifier: 1875247
2026-01-27 20:04:16 [ayvens.es] INFO: Found listing with ID: 1875256
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875256%27 HTTP/1.1" 200 None
2026-01-27 20:04:16 [ayvens.es] INFO: Scrape type for 1875256: 1
2026-01-27 20:04:16 [ayvens.es] INFO: Extracting data for car ID: 1875256
2026-01-27 20:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f99226c-4e6c-5758-bc9b-45e85b99b0d8 with identifier: 1875256
2026-01-27 20:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f99226c-4e6c-5758-bc9b-45e85b99b0d8 with scrape type 1
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f99226c-4e6c-5758-bc9b-45e85b99b0d8
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F043%252Ff02b4add8c0c4acbac8ac8c087c90e45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/043/f02b4add8c0c4acbac8ac8c087c90e45/images/large/1.jpg not downloaded yet
2026-01-27 20:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5160a61c-6ad0-52c4-8240-51882da9aa3b with identifier: 1875245
2026-01-27 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5160a61c-6ad0-52c4-8240-51882da9aa3b with identifier: 1875245
2026-01-27 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152097 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152097
2026-01-27 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5160a61c-6ad0-52c4-8240-51882da9aa3b spider: ayvens.es
2026-01-27 20:04:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 5160a61c-6ad0-52c4-8240-51882da9aa3b due to rule: high_mileage_for_country.json, error: 152097 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152097
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5160a61c-6ad0-52c4-8240-51882da9aa3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 152097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5160a61c-6ad0-52c4-8240-51882da9aa3b/5160a61c-6ad0-52c4-8240-51882da9aa3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/1b8a530e10eb44ad97f54a3e800b39c6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.0 EcoBlue MHEV 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Titanium 2.0 EcoBlue MHEV 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875245%27 HTTP/1.1" 200 None
2026-01-27 20:04:16 [ayvens.es] INFO: Saving data for 1875245: {'created_time': 1769544256.897215, 'last_price_update_time': 1769544256.897229, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875245') HTTP/1.1" 204 0
2026-01-27 20:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e9a96fe3-3931-524c-84a6-a59ae558d2e0 with identifier: 1875246
2026-01-27 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e9a96fe3-3931-524c-84a6-a59ae558d2e0 with identifier: 1875246
2026-01-27 20:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '5008', 'trim': '1.5 bluehdi 96kw (130cv) s&s allure', 'title': 'peugeot 5008 1.5 bluehdi 96kw (130cv) s&s allure', 'price': 0, 'odometer': 202018, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-29', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 134, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e9a96fe3-3931-524c-84a6-a59ae558d2e0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a96fe3-3931-524c-84a6-a59ae558d2e0/e9a96fe3-3931-524c-84a6-a59ae558d2e0_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/975/6fb8cfff354140b3b31e862e60fed7dd/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 392643}], 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 202018}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'e9a96fe3-3931-524c-84a6-a59ae558d2e0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 202018,
     'odometer_in_km': 202018,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a96fe3-3931-524c-84a6-a59ae558d2e0/e9a96fe3-3931-524c-84a6-a59ae558d2e0_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 392643,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/975/6fb8cfff354140b3b31e862e60fed7dd/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-29',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.5 bluehdi 96kw (130cv) s&s allure',
     'transmission': 'manual',
     'trim': '1.5 bluehdi 96kw (130cv) s&s allure',
     'vin': None,
     'year': 2021}
2026-01-27 20:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: e9a96fe3-3931-524c-84a6-a59ae558d2e0 spider: ayvens.es
2026-01-27 20:04:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e9a96fe3-3931-524c-84a6-a59ae558d2e0 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '5008', 'trim': '1.5 bluehdi 96kw (130cv) s&s allure', 'title': 'peugeot 5008 1.5 bluehdi 96kw (130cv) s&s allure', 'price': 0, 'odometer': 202018, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-29', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 134, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e9a96fe3-3931-524c-84a6-a59ae558d2e0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a96fe3-3931-524c-84a6-a59ae558d2e0/e9a96fe3-3931-524c-84a6-a59ae558d2e0_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/975/6fb8cfff354140b3b31e862e60fed7dd/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 392643}], 'current_year_diff': 5, 'age_in_months': 50, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 202018}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'e9a96fe3-3931-524c-84a6-a59ae558d2e0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 202018,
     'odometer_in_km': 202018,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a96fe3-3931-524c-84a6-a59ae558d2e0/e9a96fe3-3931-524c-84a6-a59ae558d2e0_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 392643,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/975/6fb8cfff354140b3b31e862e60fed7dd/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-29',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.5 bluehdi 96kw (130cv) s&s allure',
     'transmission': 'manual',
     'trim': '1.5 bluehdi 96kw (130cv) s&s allure',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9a96fe3-3931-524c-84a6-a59ae558d2e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 202018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a96fe3-3931-524c-84a6-a59ae558d2e0/e9a96fe3-3931-524c-84a6-a59ae558d2e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/975/6fb8cfff354140b3b31e862e60fed7dd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875246%27 HTTP/1.1" 200 None
2026-01-27 20:04:17 [ayvens.es] INFO: Saving data for 1875246: {'created_time': 1769544257.134843, 'last_price_update_time': 1769544257.134858, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875246') HTTP/1.1" 204 0
2026-01-27 20:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 42a82b42-b820-5a7e-a6ff-13873e05b75e with identifier: 1875247
2026-01-27 20:04:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 42a82b42-b820-5a7e-a6ff-13873e05b75e with identifier: 1875247
2026-01-27 20:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 42a82b42-b820-5a7e-a6ff-13873e05b75e with identifier: 1875247 to the API
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/682/7edace2d1ba54aab9e0bc80946d9aa07/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Nolita',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '42a82b42-b820-5a7e-a6ff-13873e05b75e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 84191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a82b42-b820-5a7e-a6ff-13873e05b75e/42a82b42-b820-5a7e-a6ff-13873e05b75e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/682/7edace2d1ba54aab9e0bc80946d9aa07/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 S AUTO 4WD MHEV',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875247%27 HTTP/1.1" 200 None
2026-01-27 20:04:17 [ayvens.es] INFO: Saving data for 1875247: {'created_time': 1769544257.682381, 'last_price_update_time': 1769544257.682391, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875247') HTTP/1.1" 204 0
2026-01-27 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/153/40ebd7b86ca04b5d8c41ffe0054bac01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:17 [ayvens.es] INFO: Found listing with ID: 1875257
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875257%27 HTTP/1.1" 200 None
2026-01-27 20:04:17 [ayvens.es] INFO: Scrape type for 1875257: 1
2026-01-27 20:04:17 [ayvens.es] INFO: Extracting data for car ID: 1875257
2026-01-27 20:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2e6f220-d394-5997-a19c-a516a9943e9b with identifier: 1875257
2026-01-27 20:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e6f220-d394-5997-a19c-a516a9943e9b with scrape type 1
2026-01-27 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2e6f220-d394-5997-a19c-a516a9943e9b
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F577%252Fb80dbf3160f94c789f1487c11656fae6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/577/b80dbf3160f94c789f1487c11656fae6/images/large/1.jpg not downloaded yet
2026-01-27 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/856/6f8f0610023d407aa6913c91dc280f9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724aea50>
2026-01-27 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d84b952c-e838-59e4-9c64-9f972d3be951/d84b952c-e838-59e4-9c64-9f972d3be951_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F082%252F56fbaf8abacb455e8a3220df5cc394ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/082/56fbaf8abacb455e8a3220df5cc394ee/images/large/1.jpg saved to cache
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d84b952c-e838-59e4-9c64-9f972d3be951
2026-01-27 20:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d84b952c-e838-59e4-9c64-9f972d3be951, skipping ID generation
2026-01-27 20:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84b952c-e838-59e4-9c64-9f972d3be951 with scrape type 1
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d84b952c-e838-59e4-9c64-9f972d3be951 from tracking dictionaries
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d84b952c-e838-59e4-9c64-9f972d3be951 sending to next pipeline
2026-01-27 20:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d84b952c-e838-59e4-9c64-9f972d3be951, identifier: 1875248
2026-01-27 20:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/704/e6c1b39b58aa45aa849649d0e066b99c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:18 [ayvens.es] INFO: Found listing with ID: 1875258
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875258%27 HTTP/1.1" 200 None
2026-01-27 20:04:18 [ayvens.es] INFO: Scrape type for 1875258: 1
2026-01-27 20:04:18 [ayvens.es] INFO: Extracting data for car ID: 1875258
2026-01-27 20:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69f537ad-1a86-5c40-854e-a77ea734810e with identifier: 1875258
2026-01-27 20:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69f537ad-1a86-5c40-854e-a77ea734810e with scrape type 1
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69f537ad-1a86-5c40-854e-a77ea734810e
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F845%252F9963a0cef6774459ab74dd7695c936d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/845/9963a0cef6774459ab74dd7695c936d5/images/large/1.jpg not downloaded yet
2026-01-27 20:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d84b952c-e838-59e4-9c64-9f972d3be951 with identifier: 1875248
2026-01-27 20:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d84b952c-e838-59e4-9c64-9f972d3be951 with identifier: 1875248
2026-01-27 20:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d84b952c-e838-59e4-9c64-9f972d3be951 with identifier: 1875248 to the API
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/082/56fbaf8abacb455e8a3220df5cc394ee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd84b952c-e838-59e4-9c64-9f972d3be951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 65938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d84b952c-e838-59e4-9c64-9f972d3be951/d84b952c-e838-59e4-9c64-9f972d3be951_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/082/56fbaf8abacb455e8a3220df5cc394ee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875248%27 HTTP/1.1" 200 None
2026-01-27 20:04:18 [ayvens.es] INFO: Saving data for 1875248: {'created_time': 1769544258.627219, 'last_price_update_time': 1769544258.627229, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875248') HTTP/1.1" 204 0
2026-01-27 20:04:18 [ayvens.es] INFO: Found listing with ID: 1875259
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875259%27 HTTP/1.1" 200 None
2026-01-27 20:04:18 [ayvens.es] INFO: Scrape type for 1875259: 1
2026-01-27 20:04:18 [ayvens.es] INFO: Extracting data for car ID: 1875259
2026-01-27 20:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841c37f9-595b-5e6a-8df5-e94c9ce8000e with identifier: 1875259
2026-01-27 20:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841c37f9-595b-5e6a-8df5-e94c9ce8000e with scrape type 1
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 841c37f9-595b-5e6a-8df5-e94c9ce8000e
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F287%252F133b03a1451a44ce8d5c70cfa817c43a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/287/133b03a1451a44ce8d5c70cfa817c43a/images/large/1.jpg not downloaded yet
2026-01-27 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724ce510>
2026-01-27 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4ba25b2-6dbc-5f84-a971-afa9297a48c4/c4ba25b2-6dbc-5f84-a971-afa9297a48c4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F153%252F40ebd7b86ca04b5d8c41ffe0054bac01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/153/40ebd7b86ca04b5d8c41ffe0054bac01/images/large/1.jpg saved to cache
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4ba25b2-6dbc-5f84-a971-afa9297a48c4
2026-01-27 20:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4ba25b2-6dbc-5f84-a971-afa9297a48c4, skipping ID generation
2026-01-27 20:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4ba25b2-6dbc-5f84-a971-afa9297a48c4 with scrape type 1
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c4ba25b2-6dbc-5f84-a971-afa9297a48c4 from tracking dictionaries
2026-01-27 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4ba25b2-6dbc-5f84-a971-afa9297a48c4 sending to next pipeline
2026-01-27 20:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c4ba25b2-6dbc-5f84-a971-afa9297a48c4, identifier: 1875249
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57258fbd0>
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ecb9c1-082b-574e-a51c-0c7cde20f3c6/86ecb9c1-082b-574e-a51c-0c7cde20f3c6_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F6f8f0610023d407aa6913c91dc280f9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/6f8f0610023d407aa6913c91dc280f9f/images/large/1.jpg saved to cache
2026-01-27 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86ecb9c1-082b-574e-a51c-0c7cde20f3c6
2026-01-27 20:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86ecb9c1-082b-574e-a51c-0c7cde20f3c6, skipping ID generation
2026-01-27 20:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 with scrape type 1
2026-01-27 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 from tracking dictionaries
2026-01-27 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 sending to next pipeline
2026-01-27 20:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 86ecb9c1-082b-574e-a51c-0c7cde20f3c6, identifier: 1875251
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5727a2050>
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e54487c-1b8e-541c-8369-22cbe9a915b8/5e54487c-1b8e-541c-8369-22cbe9a915b8_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F704%252Fe6c1b39b58aa45aa849649d0e066b99c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/704/e6c1b39b58aa45aa849649d0e066b99c/images/large/1.jpg saved to cache
2026-01-27 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e54487c-1b8e-541c-8369-22cbe9a915b8
2026-01-27 20:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e54487c-1b8e-541c-8369-22cbe9a915b8, skipping ID generation
2026-01-27 20:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e54487c-1b8e-541c-8369-22cbe9a915b8 with scrape type 1
2026-01-27 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5e54487c-1b8e-541c-8369-22cbe9a915b8 from tracking dictionaries
2026-01-27 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e54487c-1b8e-541c-8369-22cbe9a915b8 sending to next pipeline
2026-01-27 20:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5e54487c-1b8e-541c-8369-22cbe9a915b8, identifier: 1875250
2026-01-27 20:04:20 [ayvens.es] INFO: Found listing with ID: 1875260
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875260%27 HTTP/1.1" 200 None
2026-01-27 20:04:20 [ayvens.es] INFO: Scrape type for 1875260: 1
2026-01-27 20:04:20 [ayvens.es] INFO: Extracting data for car ID: 1875260
2026-01-27 20:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43781666-e10f-52e5-84f7-0e5786991abe with identifier: 1875260
2026-01-27 20:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43781666-e10f-52e5-84f7-0e5786991abe with scrape type 1
2026-01-27 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 43781666-e10f-52e5-84f7-0e5786991abe
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F238%252Fd682c9bd594846e9ac5bb08d0c8b06f6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/238/d682c9bd594846e9ac5bb08d0c8b06f6/images/large/1.jpg not downloaded yet
2026-01-27 20:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c4ba25b2-6dbc-5f84-a971-afa9297a48c4 with identifier: 1875249
2026-01-27 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c4ba25b2-6dbc-5f84-a971-afa9297a48c4 with identifier: 1875249
2026-01-27 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159339 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159339
2026-01-27 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c4ba25b2-6dbc-5f84-a971-afa9297a48c4 spider: ayvens.es
2026-01-27 20:04:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c4ba25b2-6dbc-5f84-a971-afa9297a48c4 due to rule: high_mileage_for_country.json, error: 159339 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159339
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c4ba25b2-6dbc-5f84-a971-afa9297a48c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 159339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4ba25b2-6dbc-5f84-a971-afa9297a48c4/c4ba25b2-6dbc-5f84-a971-afa9297a48c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/153/40ebd7b86ca04b5d8c41ffe0054bac01/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2023}
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875249%27 HTTP/1.1" 200 None
2026-01-27 20:04:20 [ayvens.es] INFO: Saving data for 1875249: {'created_time': 1769544260.317276, 'last_price_update_time': 1769544260.31729, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875249') HTTP/1.1" 204 0
2026-01-27 20:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 with identifier: 1875251
2026-01-27 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 with identifier: 1875251
2026-01-27 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165947 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165947
2026-01-27 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 spider: ayvens.es
2026-01-27 20:04:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 86ecb9c1-082b-574e-a51c-0c7cde20f3c6 due to rule: high_mileage_for_country.json, error: 165947 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165947
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'Mineralweiss',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '86ecb9c1-082b-574e-a51c-0c7cde20f3c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 165947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ecb9c1-082b-574e-a51c-0c7cde20f3c6/86ecb9c1-082b-574e-a51c-0c7cde20f3c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/856/6f8f0610023d407aa6913c91dc280f9f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive25e',
 'transmission': 'manual',
 'trim': 'xDrive25e',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875251%27 HTTP/1.1" 200 None
2026-01-27 20:04:20 [ayvens.es] INFO: Saving data for 1875251: {'created_time': 1769544260.662339, 'last_price_update_time': 1769544260.662349, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875251') HTTP/1.1" 204 0
2026-01-27 20:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5e54487c-1b8e-541c-8369-22cbe9a915b8 with identifier: 1875250
2026-01-27 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5e54487c-1b8e-541c-8369-22cbe9a915b8 with identifier: 1875250
2026-01-27 20:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5e54487c-1b8e-541c-8369-22cbe9a915b8 with identifier: 1875250 to the API
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/704/e6c1b39b58aa45aa849649d0e066b99c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5e54487c-1b8e-541c-8369-22cbe9a915b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 110925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e54487c-1b8e-541c-8369-22cbe9a915b8/5e54487c-1b8e-541c-8369-22cbe9a915b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/704/e6c1b39b58aa45aa849649d0e066b99c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+ Sportbreak',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+ Sportbreak',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875250%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [ayvens.es] INFO: Saving data for 1875250: {'created_time': 1769544261.049159, 'last_price_update_time': 1769544261.049172, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875250') HTTP/1.1" 204 0
2026-01-27 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/570/1e70c63155184505b588b89b8bc8aeaf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:21 [ayvens.es] INFO: Found listing with ID: 1875261
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875261%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [ayvens.es] INFO: Scrape type for 1875261: 1
2026-01-27 20:04:21 [ayvens.es] INFO: Extracting data for car ID: 1875261
2026-01-27 20:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7 with identifier: 1875261
2026-01-27 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7 with scrape type 1
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252Fb4bc5e9f6fd74522a679c02166e14a4a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/b4bc5e9f6fd74522a679c02166e14a4a/images/large/1.jpg not downloaded yet
2026-01-27 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/866/de891a78e31a4345ba664dd074b40c0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/066/725bb84a2eb3418c9bcdb2222b1fe41d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:21 [ayvens.es] INFO: Found listing with ID: 1875262
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875262%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [ayvens.es] INFO: Scrape type for 1875262: 1
2026-01-27 20:04:21 [ayvens.es] INFO: Extracting data for car ID: 1875262
2026-01-27 20:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13afcb24-13d7-5076-a795-8f975b92f9d3 with identifier: 1875262
2026-01-27 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13afcb24-13d7-5076-a795-8f975b92f9d3 with scrape type 1
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13afcb24-13d7-5076-a795-8f975b92f9d3
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F483%252Fe955d9302382400d9484e086643b82f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/483/e955d9302382400d9484e086643b82f9/images/large/1.jpg not downloaded yet
2026-01-27 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/043/f02b4add8c0c4acbac8ac8c087c90e45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/231/c7003d354fc943b7a7d445be8966f5cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/577/b80dbf3160f94c789f1487c11656fae6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:21 [ayvens.es] INFO: Found listing with ID: 1875263
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875263%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [ayvens.es] INFO: Scrape type for 1875263: 1
2026-01-27 20:04:21 [ayvens.es] INFO: Extracting data for car ID: 1875263
2026-01-27 20:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d62c2646-e89c-5e1b-b413-4fba082bde3f with identifier: 1875263
2026-01-27 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62c2646-e89c-5e1b-b413-4fba082bde3f with scrape type 1
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d62c2646-e89c-5e1b-b413-4fba082bde3f
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252F56a5ec6be18d45b9a98dc339a458db29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/56a5ec6be18d45b9a98dc339a458db29/images/large/1.jpg not downloaded yet
2026-01-27 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571baa890>
2026-01-27 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7dd7f3-9fda-54d0-beff-5fb16092289c/8c7dd7f3-9fda-54d0-beff-5fb16092289c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F570%252F1e70c63155184505b588b89b8bc8aeaf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/570/1e70c63155184505b588b89b8bc8aeaf/images/large/1.jpg saved to cache
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c7dd7f3-9fda-54d0-beff-5fb16092289c
2026-01-27 20:04:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c7dd7f3-9fda-54d0-beff-5fb16092289c, skipping ID generation
2026-01-27 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7dd7f3-9fda-54d0-beff-5fb16092289c with scrape type 1
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8c7dd7f3-9fda-54d0-beff-5fb16092289c from tracking dictionaries
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c7dd7f3-9fda-54d0-beff-5fb16092289c sending to next pipeline
2026-01-27 20:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8c7dd7f3-9fda-54d0-beff-5fb16092289c, identifier: 1875255
2026-01-27 20:04:21 [ayvens.es] INFO: Found listing with ID: 1875264
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875264%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [ayvens.es] INFO: Scrape type for 1875264: 1
2026-01-27 20:04:21 [ayvens.es] INFO: Extracting data for car ID: 1875264
2026-01-27 20:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a564a6f-85af-5afa-bfca-03b394fd194a with identifier: 1875264
2026-01-27 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a564a6f-85af-5afa-bfca-03b394fd194a with scrape type 1
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a564a6f-85af-5afa-bfca-03b394fd194a
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252F637471b8a2584a029fd8b8017dcb0578%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/637471b8a2584a029fd8b8017dcb0578/images/large/1.jpg not downloaded yet
2026-01-27 20:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8c7dd7f3-9fda-54d0-beff-5fb16092289c with identifier: 1875255
2026-01-27 20:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8c7dd7f3-9fda-54d0-beff-5fb16092289c with identifier: 1875255
2026-01-27 20:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8c7dd7f3-9fda-54d0-beff-5fb16092289c with identifier: 1875255 to the API
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/570/1e70c63155184505b588b89b8bc8aeaf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c7dd7f3-9fda-54d0-beff-5fb16092289c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 69914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7dd7f3-9fda-54d0-beff-5fb16092289c/8c7dd7f3-9fda-54d0-beff-5fb16092289c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/570/1e70c63155184505b588b89b8bc8aeaf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875255%27 HTTP/1.1" 200 None
2026-01-27 20:04:22 [ayvens.es] INFO: Saving data for 1875255: {'created_time': 1769544262.023467, 'last_price_update_time': 1769544262.023481, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875255') HTTP/1.1" 204 0
2026-01-27 20:04:22 [ayvens.es] INFO: Found listing with ID: 1875265
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875265%27 HTTP/1.1" 200 None
2026-01-27 20:04:22 [ayvens.es] INFO: Scrape type for 1875265: 1
2026-01-27 20:04:22 [ayvens.es] INFO: Extracting data for car ID: 1875265
2026-01-27 20:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2b161b5-7cb7-582d-a579-28c9249529af with identifier: 1875265
2026-01-27 20:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b161b5-7cb7-582d-a579-28c9249529af with scrape type 1
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c2b161b5-7cb7-582d-a579-28c9249529af
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252Fb99ea83843a14659a49a064cf19cf42e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/b99ea83843a14659a49a064cf19cf42e/images/large/1.jpg not downloaded yet
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724485d0>
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31c0c8-61a6-5906-8928-3a160b65eb0e/3c31c0c8-61a6-5906-8928-3a160b65eb0e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F866%252Fde891a78e31a4345ba664dd074b40c0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/866/de891a78e31a4345ba664dd074b40c0d/images/large/1.jpg saved to cache
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c31c0c8-61a6-5906-8928-3a160b65eb0e
2026-01-27 20:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c31c0c8-61a6-5906-8928-3a160b65eb0e, skipping ID generation
2026-01-27 20:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c31c0c8-61a6-5906-8928-3a160b65eb0e with scrape type 1
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3c31c0c8-61a6-5906-8928-3a160b65eb0e from tracking dictionaries
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c31c0c8-61a6-5906-8928-3a160b65eb0e sending to next pipeline
2026-01-27 20:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3c31c0c8-61a6-5906-8928-3a160b65eb0e, identifier: 1875253
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b3d6d0>
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc41b510-3d9d-5fad-8c79-e95b338be0cb/fc41b510-3d9d-5fad-8c79-e95b338be0cb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F066%252F725bb84a2eb3418c9bcdb2222b1fe41d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/066/725bb84a2eb3418c9bcdb2222b1fe41d/images/large/1.jpg saved to cache
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc41b510-3d9d-5fad-8c79-e95b338be0cb
2026-01-27 20:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc41b510-3d9d-5fad-8c79-e95b338be0cb, skipping ID generation
2026-01-27 20:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc41b510-3d9d-5fad-8c79-e95b338be0cb with scrape type 1
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc41b510-3d9d-5fad-8c79-e95b338be0cb from tracking dictionaries
2026-01-27 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc41b510-3d9d-5fad-8c79-e95b338be0cb sending to next pipeline
2026-01-27 20:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fc41b510-3d9d-5fad-8c79-e95b338be0cb, identifier: 1875252
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a188d0>
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f99226c-4e6c-5758-bc9b-45e85b99b0d8/1f99226c-4e6c-5758-bc9b-45e85b99b0d8_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F043%252Ff02b4add8c0c4acbac8ac8c087c90e45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/043/f02b4add8c0c4acbac8ac8c087c90e45/images/large/1.jpg saved to cache
2026-01-27 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f99226c-4e6c-5758-bc9b-45e85b99b0d8
2026-01-27 20:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f99226c-4e6c-5758-bc9b-45e85b99b0d8, skipping ID generation
2026-01-27 20:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f99226c-4e6c-5758-bc9b-45e85b99b0d8 with scrape type 1
2026-01-27 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1f99226c-4e6c-5758-bc9b-45e85b99b0d8 from tracking dictionaries
2026-01-27 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f99226c-4e6c-5758-bc9b-45e85b99b0d8 sending to next pipeline
2026-01-27 20:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f99226c-4e6c-5758-bc9b-45e85b99b0d8, identifier: 1875256
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572129590>
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77e854fd-27e9-5f4c-864d-a442168f6590/77e854fd-27e9-5f4c-864d-a442168f6590_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F231%252Fc7003d354fc943b7a7d445be8966f5cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/231/c7003d354fc943b7a7d445be8966f5cd/images/large/1.jpg saved to cache
2026-01-27 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77e854fd-27e9-5f4c-864d-a442168f6590
2026-01-27 20:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77e854fd-27e9-5f4c-864d-a442168f6590, skipping ID generation
2026-01-27 20:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77e854fd-27e9-5f4c-864d-a442168f6590 with scrape type 1
2026-01-27 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 77e854fd-27e9-5f4c-864d-a442168f6590 from tracking dictionaries
2026-01-27 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77e854fd-27e9-5f4c-864d-a442168f6590 sending to next pipeline
2026-01-27 20:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77e854fd-27e9-5f4c-864d-a442168f6590, identifier: 1875254
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725a2dd0>
2026-01-27 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e6f220-d394-5997-a19c-a516a9943e9b/f2e6f220-d394-5997-a19c-a516a9943e9b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F577%252Fb80dbf3160f94c789f1487c11656fae6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/577/b80dbf3160f94c789f1487c11656fae6/images/large/1.jpg saved to cache
2026-01-27 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2e6f220-d394-5997-a19c-a516a9943e9b
2026-01-27 20:04:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2e6f220-d394-5997-a19c-a516a9943e9b, skipping ID generation
2026-01-27 20:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e6f220-d394-5997-a19c-a516a9943e9b with scrape type 1
2026-01-27 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2e6f220-d394-5997-a19c-a516a9943e9b from tracking dictionaries
2026-01-27 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2e6f220-d394-5997-a19c-a516a9943e9b sending to next pipeline
2026-01-27 20:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2e6f220-d394-5997-a19c-a516a9943e9b, identifier: 1875257
2026-01-27 20:04:24 [ayvens.es] INFO: Found listing with ID: 1875266
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875266%27 HTTP/1.1" 200 None
2026-01-27 20:04:24 [ayvens.es] INFO: Scrape type for 1875266: 1
2026-01-27 20:04:24 [ayvens.es] INFO: Extracting data for car ID: 1875266
2026-01-27 20:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46961cdb-7e25-5a5d-9515-cc98512038f4 with identifier: 1875266
2026-01-27 20:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46961cdb-7e25-5a5d-9515-cc98512038f4 with scrape type 1
2026-01-27 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 46961cdb-7e25-5a5d-9515-cc98512038f4
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F462%252F63b59294802a4d7aba2482f9b2b92fd0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/462/63b59294802a4d7aba2482f9b2b92fd0/images/large/1.jpg not downloaded yet
2026-01-27 20:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3c31c0c8-61a6-5906-8928-3a160b65eb0e with identifier: 1875253
2026-01-27 20:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3c31c0c8-61a6-5906-8928-3a160b65eb0e with identifier: 1875253
2026-01-27 20:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3c31c0c8-61a6-5906-8928-3a160b65eb0e with identifier: 1875253 to the API
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/866/de891a78e31a4345ba664dd074b40c0d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3c31c0c8-61a6-5906-8928-3a160b65eb0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 69342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31c0c8-61a6-5906-8928-3a160b65eb0e/3c31c0c8-61a6-5906-8928-3a160b65eb0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/866/de891a78e31a4345ba664dd074b40c0d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 D4 Business Plus',
 'transmission': 'manual',
 'trim': '2.0 D4 Business Plus',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875253%27 HTTP/1.1" 200 None
2026-01-27 20:04:24 [ayvens.es] INFO: Saving data for 1875253: {'created_time': 1769544264.747926, 'last_price_update_time': 1769544264.747936, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875253') HTTP/1.1" 204 0
2026-01-27 20:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fc41b510-3d9d-5fad-8c79-e95b338be0cb with identifier: 1875252
2026-01-27 20:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fc41b510-3d9d-5fad-8c79-e95b338be0cb with identifier: 1875252
2026-01-27 20:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fc41b510-3d9d-5fad-8c79-e95b338be0cb with identifier: 1875252 to the API
2026-01-27 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/066/725bb84a2eb3418c9bcdb2222b1fe41d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fc41b510-3d9d-5fad-8c79-e95b338be0cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 137342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc41b510-3d9d-5fad-8c79-e95b338be0cb/fc41b510-3d9d-5fad-8c79-e95b338be0cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/066/725bb84a2eb3418c9bcdb2222b1fe41d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 (O) 2.0 D3 Business Plus Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 D3 Business Plus Auto',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875252%27 HTTP/1.1" 200 None
2026-01-27 20:04:25 [ayvens.es] INFO: Saving data for 1875252: {'created_time': 1769544265.14678, 'last_price_update_time': 1769544265.146792, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875252') HTTP/1.1" 204 0
2026-01-27 20:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f99226c-4e6c-5758-bc9b-45e85b99b0d8 with identifier: 1875256
2026-01-27 20:04:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f99226c-4e6c-5758-bc9b-45e85b99b0d8 with identifier: 1875256
2026-01-27 20:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f99226c-4e6c-5758-bc9b-45e85b99b0d8 with identifier: 1875256 to the API
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/043/f02b4add8c0c4acbac8ac8c087c90e45/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Denim',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1f99226c-4e6c-5758-bc9b-45e85b99b0d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 94466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f99226c-4e6c-5758-bc9b-45e85b99b0d8/1f99226c-4e6c-5758-bc9b-45e85b99b0d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/043/f02b4add8c0c4acbac8ac8c087c90e45/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 T8 AWD Recharge Inscription Auto',
 'transmission': 'manual',
 'trim': '2.0 T8 AWD Recharge Inscription Auto',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875256%27 HTTP/1.1" 200 None
2026-01-27 20:04:25 [ayvens.es] INFO: Saving data for 1875256: {'created_time': 1769544265.571077, 'last_price_update_time': 1769544265.571088, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875256') HTTP/1.1" 204 0
2026-01-27 20:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77e854fd-27e9-5f4c-864d-a442168f6590 with identifier: 1875254
2026-01-27 20:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77e854fd-27e9-5f4c-864d-a442168f6590 with identifier: 1875254
2026-01-27 20:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77e854fd-27e9-5f4c-864d-a442168f6590 with identifier: 1875254 to the API
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/231/c7003d354fc943b7a7d445be8966f5cd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '77e854fd-27e9-5f4c-864d-a442168f6590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 68626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77e854fd-27e9-5f4c-864d-a442168f6590/77e854fd-27e9-5f4c-864d-a442168f6590_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/231/c7003d354fc943b7a7d445be8966f5cd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 B4 G AWD Plus Dark Auto',
 'transmission': 'manual',
 'trim': '2.0 B4 G AWD Plus Dark Auto',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875254%27 HTTP/1.1" 200 None
2026-01-27 20:04:25 [ayvens.es] INFO: Saving data for 1875254: {'created_time': 1769544265.992805, 'last_price_update_time': 1769544265.992816, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875254') HTTP/1.1" 204 0
2026-01-27 20:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2e6f220-d394-5997-a19c-a516a9943e9b with identifier: 1875257
2026-01-27 20:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2e6f220-d394-5997-a19c-a516a9943e9b with identifier: 1875257
2026-01-27 20:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2e6f220-d394-5997-a19c-a516a9943e9b with identifier: 1875257 to the API
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/577/b80dbf3160f94c789f1487c11656fae6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f2e6f220-d394-5997-a19c-a516a9943e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 120468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e6f220-d394-5997-a19c-a516a9943e9b/f2e6f220-d394-5997-a19c-a516a9943e9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/577/b80dbf3160f94c789f1487c11656fae6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 (O) 1.5 T2 Momentum Core',
 'transmission': 'manual',
 'trim': '(O) 1.5 T2 Momentum Core',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875257%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [ayvens.es] INFO: Saving data for 1875257: {'created_time': 1769544266.423785, 'last_price_update_time': 1769544266.423799, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875257') HTTP/1.1" 204 0
2026-01-27 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/238/d682c9bd594846e9ac5bb08d0c8b06f6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:26 [ayvens.es] INFO: Found listing with ID: 1875267
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875267%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [ayvens.es] INFO: Scrape type for 1875267: 1
2026-01-27 20:04:26 [ayvens.es] INFO: Extracting data for car ID: 1875267
2026-01-27 20:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55ae06f5-ac20-504f-91d5-80fdd5405d6b with identifier: 1875267
2026-01-27 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55ae06f5-ac20-504f-91d5-80fdd5405d6b with scrape type 1
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 55ae06f5-ac20-504f-91d5-80fdd5405d6b
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F914%252F8b167a8a071c49bcbc41cb3b892feb20%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/914/8b167a8a071c49bcbc41cb3b892feb20/images/large/1.jpg not downloaded yet
2026-01-27 20:04:26 [ayvens.es] INFO: Found listing with ID: 1875268
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875268%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [ayvens.es] INFO: Scrape type for 1875268: 1
2026-01-27 20:04:26 [ayvens.es] INFO: Extracting data for car ID: 1875268
2026-01-27 20:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 797b89ad-f1c2-59bd-983f-57dd50be6631 with identifier: 1875268
2026-01-27 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 797b89ad-f1c2-59bd-983f-57dd50be6631 with scrape type 1
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 797b89ad-f1c2-59bd-983f-57dd50be6631
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F600%252Fad643e73d65d48d5b6239ebcc8059b30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/600/ad643e73d65d48d5b6239ebcc8059b30/images/large/1.jpg not downloaded yet
2026-01-27 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/287/133b03a1451a44ce8d5c70cfa817c43a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/483/e955d9302382400d9484e086643b82f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:26 [ayvens.es] INFO: Found listing with ID: 1875269
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875269%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [ayvens.es] INFO: Scrape type for 1875269: 1
2026-01-27 20:04:26 [ayvens.es] INFO: Extracting data for car ID: 1875269
2026-01-27 20:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21378168-77db-543a-9fd1-8f78ef4efac4 with identifier: 1875269
2026-01-27 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21378168-77db-543a-9fd1-8f78ef4efac4 with scrape type 1
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21378168-77db-543a-9fd1-8f78ef4efac4
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F453%252F5374d07b247c4bb89c5d4fe43b789ef3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/453/5374d07b247c4bb89c5d4fe43b789ef3/images/large/1.jpg not downloaded yet
2026-01-27 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/845/9963a0cef6774459ab74dd7695c936d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:26 [ayvens.es] INFO: Found listing with ID: 1875270
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875270%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [ayvens.es] INFO: Scrape type for 1875270: 1
2026-01-27 20:04:26 [ayvens.es] INFO: Extracting data for car ID: 1875270
2026-01-27 20:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de50e316-914d-5f8b-a03e-8bf1e5fb3af4 with identifier: 1875270
2026-01-27 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de50e316-914d-5f8b-a03e-8bf1e5fb3af4 with scrape type 1
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de50e316-914d-5f8b-a03e-8bf1e5fb3af4
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F116%252Ff77b1a9134cf492182c22e6e831318a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/116/f77b1a9134cf492182c22e6e831318a9/images/large/1.jpg not downloaded yet
2026-01-27 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/167/b4bc5e9f6fd74522a679c02166e14a4a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722043d0>
2026-01-27 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43781666-e10f-52e5-84f7-0e5786991abe/43781666-e10f-52e5-84f7-0e5786991abe_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F238%252Fd682c9bd594846e9ac5bb08d0c8b06f6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/238/d682c9bd594846e9ac5bb08d0c8b06f6/images/large/1.jpg saved to cache
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43781666-e10f-52e5-84f7-0e5786991abe
2026-01-27 20:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43781666-e10f-52e5-84f7-0e5786991abe, skipping ID generation
2026-01-27 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43781666-e10f-52e5-84f7-0e5786991abe with scrape type 1
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 43781666-e10f-52e5-84f7-0e5786991abe from tracking dictionaries
2026-01-27 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43781666-e10f-52e5-84f7-0e5786991abe sending to next pipeline
2026-01-27 20:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 43781666-e10f-52e5-84f7-0e5786991abe, identifier: 1875260
2026-01-27 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/924/56a5ec6be18d45b9a98dc339a458db29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:27 [ayvens.es] INFO: Found listing with ID: 1875271
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875271%27 HTTP/1.1" 200 None
2026-01-27 20:04:27 [ayvens.es] INFO: Scrape type for 1875271: 1
2026-01-27 20:04:27 [ayvens.es] INFO: Extracting data for car ID: 1875271
2026-01-27 20:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9e4a2b-9750-508e-86fc-c7a88e638e13 with identifier: 1875271
2026-01-27 20:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9e4a2b-9750-508e-86fc-c7a88e638e13 with scrape type 1
2026-01-27 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a9e4a2b-9750-508e-86fc-c7a88e638e13
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F612%252Fefa24482deb6453bacf415150a03d53c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/612/efa24482deb6453bacf415150a03d53c/images/large/1.jpg not downloaded yet
2026-01-27 20:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 43781666-e10f-52e5-84f7-0e5786991abe with identifier: 1875260
2026-01-27 20:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 43781666-e10f-52e5-84f7-0e5786991abe with identifier: 1875260
2026-01-27 20:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 't-roc', 'trim': 'advance 1.5 tsi 110kw (150cv) dsg', 'title': 'volkswagen t-roc advance 1.5 tsi 110kw (150cv) dsg', 'price': 0, 'odometer': 205849, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-26', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 143, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '43781666-e10f-52e5-84f7-0e5786991abe', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43781666-e10f-52e5-84f7-0e5786991abe/43781666-e10f-52e5-84f7-0e5786991abe_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d682c9bd594846e9ac5bb08d0c8b06f6/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 323464}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'volkswagen t-roc', 'sanitized_make': 'volkswagen', 'odometer_in_km': 205849}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 143,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '43781666-e10f-52e5-84f7-0e5786991abe',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen t-roc',
     'model': 't-roc',
     'odometer': 205849,
     'odometer_in_km': 205849,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43781666-e10f-52e5-84f7-0e5786991abe/43781666-e10f-52e5-84f7-0e5786991abe_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 323464,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d682c9bd594846e9ac5bb08d0c8b06f6/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-26',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen t-roc advance 1.5 tsi 110kw (150cv) dsg',
     'transmission': 'manual',
     'trim': 'advance 1.5 tsi 110kw (150cv) dsg',
     'vin': None,
     'year': 2021}
2026-01-27 20:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 43781666-e10f-52e5-84f7-0e5786991abe spider: ayvens.es
2026-01-27 20:04:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 43781666-e10f-52e5-84f7-0e5786991abe due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 't-roc', 'trim': 'advance 1.5 tsi 110kw (150cv) dsg', 'title': 'volkswagen t-roc advance 1.5 tsi 110kw (150cv) dsg', 'price': 0, 'odometer': 205849, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-26', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 143, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '43781666-e10f-52e5-84f7-0e5786991abe', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43781666-e10f-52e5-84f7-0e5786991abe/43781666-e10f-52e5-84f7-0e5786991abe_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d682c9bd594846e9ac5bb08d0c8b06f6/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 323464}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'volkswagen t-roc', 'sanitized_make': 'volkswagen', 'odometer_in_km': 205849}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 143,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '43781666-e10f-52e5-84f7-0e5786991abe',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen t-roc',
     'model': 't-roc',
     'odometer': 205849,
     'odometer_in_km': 205849,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43781666-e10f-52e5-84f7-0e5786991abe/43781666-e10f-52e5-84f7-0e5786991abe_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 323464,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d682c9bd594846e9ac5bb08d0c8b06f6/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-26',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen t-roc advance 1.5 tsi 110kw (150cv) dsg',
     'transmission': 'manual',
     'trim': 'advance 1.5 tsi 110kw (150cv) dsg',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '43781666-e10f-52e5-84f7-0e5786991abe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 205849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43781666-e10f-52e5-84f7-0e5786991abe/43781666-e10f-52e5-84f7-0e5786991abe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d682c9bd594846e9ac5bb08d0c8b06f6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875260%27 HTTP/1.1" 200 None
2026-01-27 20:04:27 [ayvens.es] INFO: Saving data for 1875260: {'created_time': 1769544267.414561, 'last_price_update_time': 1769544267.414573, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875260') HTTP/1.1" 204 0
2026-01-27 20:04:27 [ayvens.es] INFO: Found listing with ID: 1875272
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875272%27 HTTP/1.1" 200 None
2026-01-27 20:04:27 [ayvens.es] INFO: Scrape type for 1875272: 1
2026-01-27 20:04:27 [ayvens.es] INFO: Extracting data for car ID: 1875272
2026-01-27 20:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b957c122-938e-59fc-9baa-a0a1869a5f50 with identifier: 1875272
2026-01-27 20:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b957c122-938e-59fc-9baa-a0a1869a5f50 with scrape type 1
2026-01-27 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b957c122-938e-59fc-9baa-a0a1869a5f50
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F340%252Ffc28d7f3d1f941b78ee9ff5eb2b3b745%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/340/fc28d7f3d1f941b78ee9ff5eb2b3b745/images/large/1.jpg not downloaded yet
2026-01-27 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57235fc50>
2026-01-27 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_841c37f9-595b-5e6a-8df5-e94c9ce8000e/841c37f9-595b-5e6a-8df5-e94c9ce8000e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F287%252F133b03a1451a44ce8d5c70cfa817c43a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/287/133b03a1451a44ce8d5c70cfa817c43a/images/large/1.jpg saved to cache
2026-01-27 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 841c37f9-595b-5e6a-8df5-e94c9ce8000e
2026-01-27 20:04:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 841c37f9-595b-5e6a-8df5-e94c9ce8000e, skipping ID generation
2026-01-27 20:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841c37f9-595b-5e6a-8df5-e94c9ce8000e with scrape type 1
2026-01-27 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 841c37f9-595b-5e6a-8df5-e94c9ce8000e from tracking dictionaries
2026-01-27 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 841c37f9-595b-5e6a-8df5-e94c9ce8000e sending to next pipeline
2026-01-27 20:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 841c37f9-595b-5e6a-8df5-e94c9ce8000e, identifier: 1875259
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b2fbd0>
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13afcb24-13d7-5076-a795-8f975b92f9d3/13afcb24-13d7-5076-a795-8f975b92f9d3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F483%252Fe955d9302382400d9484e086643b82f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/483/e955d9302382400d9484e086643b82f9/images/large/1.jpg saved to cache
2026-01-27 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13afcb24-13d7-5076-a795-8f975b92f9d3
2026-01-27 20:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13afcb24-13d7-5076-a795-8f975b92f9d3, skipping ID generation
2026-01-27 20:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13afcb24-13d7-5076-a795-8f975b92f9d3 with scrape type 1
2026-01-27 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 13afcb24-13d7-5076-a795-8f975b92f9d3 from tracking dictionaries
2026-01-27 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13afcb24-13d7-5076-a795-8f975b92f9d3 sending to next pipeline
2026-01-27 20:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13afcb24-13d7-5076-a795-8f975b92f9d3, identifier: 1875262
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572293ed0>
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f537ad-1a86-5c40-854e-a77ea734810e/69f537ad-1a86-5c40-854e-a77ea734810e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F845%252F9963a0cef6774459ab74dd7695c936d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/845/9963a0cef6774459ab74dd7695c936d5/images/large/1.jpg saved to cache
2026-01-27 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69f537ad-1a86-5c40-854e-a77ea734810e
2026-01-27 20:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69f537ad-1a86-5c40-854e-a77ea734810e, skipping ID generation
2026-01-27 20:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69f537ad-1a86-5c40-854e-a77ea734810e with scrape type 1
2026-01-27 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 69f537ad-1a86-5c40-854e-a77ea734810e from tracking dictionaries
2026-01-27 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69f537ad-1a86-5c40-854e-a77ea734810e sending to next pipeline
2026-01-27 20:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 69f537ad-1a86-5c40-854e-a77ea734810e, identifier: 1875258
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572102490>
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7/1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252Fb4bc5e9f6fd74522a679c02166e14a4a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/b4bc5e9f6fd74522a679c02166e14a4a/images/large/1.jpg saved to cache
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7
2026-01-27 20:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7, skipping ID generation
2026-01-27 20:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7 with scrape type 1
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7 from tracking dictionaries
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7 sending to next pipeline
2026-01-27 20:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7, identifier: 1875261
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f7b9d0>
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62c2646-e89c-5e1b-b413-4fba082bde3f/d62c2646-e89c-5e1b-b413-4fba082bde3f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252F56a5ec6be18d45b9a98dc339a458db29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/56a5ec6be18d45b9a98dc339a458db29/images/large/1.jpg saved to cache
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d62c2646-e89c-5e1b-b413-4fba082bde3f
2026-01-27 20:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d62c2646-e89c-5e1b-b413-4fba082bde3f, skipping ID generation
2026-01-27 20:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62c2646-e89c-5e1b-b413-4fba082bde3f with scrape type 1
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d62c2646-e89c-5e1b-b413-4fba082bde3f from tracking dictionaries
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d62c2646-e89c-5e1b-b413-4fba082bde3f sending to next pipeline
2026-01-27 20:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d62c2646-e89c-5e1b-b413-4fba082bde3f, identifier: 1875263
2026-01-27 20:04:29 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at -1 pages/min), scraped 169 items (at 48 items/min)
2026-01-27 20:04:29 [ayvens.es] INFO: Found listing with ID: 1875273
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875273%27 HTTP/1.1" 200 None
2026-01-27 20:04:29 [ayvens.es] INFO: Scrape type for 1875273: 1
2026-01-27 20:04:29 [ayvens.es] INFO: Extracting data for car ID: 1875273
2026-01-27 20:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b218ee11-24db-5749-adf4-683caf62698d with identifier: 1875273
2026-01-27 20:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b218ee11-24db-5749-adf4-683caf62698d with scrape type 1
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b218ee11-24db-5749-adf4-683caf62698d
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F046%252Ffba67ff4546e4c4a83bcf60506ab90c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/046/fba67ff4546e4c4a83bcf60506ab90c8/images/large/1.jpg not downloaded yet
2026-01-27 20:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 841c37f9-595b-5e6a-8df5-e94c9ce8000e with identifier: 1875259
2026-01-27 20:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 841c37f9-595b-5e6a-8df5-e94c9ce8000e with identifier: 1875259
2026-01-27 20:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184511 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184511
2026-01-27 20:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 841c37f9-595b-5e6a-8df5-e94c9ce8000e spider: ayvens.es
2026-01-27 20:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 841c37f9-595b-5e6a-8df5-e94c9ce8000e due to rule: high_mileage_for_country.json, error: 184511 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184511
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '841c37f9-595b-5e6a-8df5-e94c9ce8000e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 184511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_841c37f9-595b-5e6a-8df5-e94c9ce8000e/841c37f9-595b-5e6a-8df5-e94c9ce8000e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/287/133b03a1451a44ce8d5c70cfa817c43a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875259%27 HTTP/1.1" 200 None
2026-01-27 20:04:30 [ayvens.es] INFO: Saving data for 1875259: {'created_time': 1769544270.171449, 'last_price_update_time': 1769544270.171464, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875259') HTTP/1.1" 204 0
2026-01-27 20:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13afcb24-13d7-5076-a795-8f975b92f9d3 with identifier: 1875262
2026-01-27 20:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13afcb24-13d7-5076-a795-8f975b92f9d3 with identifier: 1875262
2026-01-27 20:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13afcb24-13d7-5076-a795-8f975b92f9d3 with identifier: 1875262 to the API
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/483/e955d9302382400d9484e086643b82f9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '13afcb24-13d7-5076-a795-8f975b92f9d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 116709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13afcb24-13d7-5076-a795-8f975b92f9d3/13afcb24-13d7-5076-a795-8f975b92f9d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/483/e955d9302382400d9484e086643b82f9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Active',
 'transmission': 'manual',
 'trim': '1.8 125H Active',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875262%27 HTTP/1.1" 200 None
2026-01-27 20:04:30 [ayvens.es] INFO: Saving data for 1875262: {'created_time': 1769544270.581226, 'last_price_update_time': 1769544270.581244, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875262') HTTP/1.1" 204 0
2026-01-27 20:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 69f537ad-1a86-5c40-854e-a77ea734810e with identifier: 1875258
2026-01-27 20:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 69f537ad-1a86-5c40-854e-a77ea734810e with identifier: 1875258
2026-01-27 20:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 69f537ad-1a86-5c40-854e-a77ea734810e with identifier: 1875258 to the API
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/845/9963a0cef6774459ab74dd7695c936d5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '69f537ad-1a86-5c40-854e-a77ea734810e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 49568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f537ad-1a86-5c40-854e-a77ea734810e/69f537ad-1a86-5c40-854e-a77ea734810e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/845/9963a0cef6774459ab74dd7695c936d5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Edition 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875258%27 HTTP/1.1" 200 None
2026-01-27 20:04:31 [ayvens.es] INFO: Saving data for 1875258: {'created_time': 1769544271.010007, 'last_price_update_time': 1769544271.010017, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875258') HTTP/1.1" 204 0
2026-01-27 20:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7 with identifier: 1875261
2026-01-27 20:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7 with identifier: 1875261
2026-01-27 20:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7 with identifier: 1875261 to the API
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/167/b4bc5e9f6fd74522a679c02166e14a4a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 86044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7/1f5433b4-b28c-52a4-b0b1-d1faa4fcf2f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/167/b4bc5e9f6fd74522a679c02166e14a4a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875261%27 HTTP/1.1" 200 None
2026-01-27 20:04:31 [ayvens.es] INFO: Saving data for 1875261: {'created_time': 1769544271.593909, 'last_price_update_time': 1769544271.59392, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875261') HTTP/1.1" 204 0
2026-01-27 20:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d62c2646-e89c-5e1b-b413-4fba082bde3f with identifier: 1875263
2026-01-27 20:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d62c2646-e89c-5e1b-b413-4fba082bde3f with identifier: 1875263
2026-01-27 20:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d62c2646-e89c-5e1b-b413-4fba082bde3f with identifier: 1875263 to the API
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/924/56a5ec6be18d45b9a98dc339a458db29/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd62c2646-e89c-5e1b-b413-4fba082bde3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 62486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62c2646-e89c-5e1b-b413-4fba082bde3f/d62c2646-e89c-5e1b-b413-4fba082bde3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/924/56a5ec6be18d45b9a98dc339a458db29/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Life 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875263%27 HTTP/1.1" 200 None
2026-01-27 20:04:31 [ayvens.es] INFO: Saving data for 1875263: {'created_time': 1769544271.924431, 'last_price_update_time': 1769544271.924442, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875263') HTTP/1.1" 204 0
2026-01-27 20:04:31 [ayvens.es] INFO: Found listing with ID: 1875274
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875274%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [ayvens.es] INFO: Scrape type for 1875274: 1
2026-01-27 20:04:32 [ayvens.es] INFO: Extracting data for car ID: 1875274
2026-01-27 20:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a25999d-4cef-5828-9712-b1ea13725cc2 with identifier: 1875274
2026-01-27 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a25999d-4cef-5828-9712-b1ea13725cc2 with scrape type 1
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a25999d-4cef-5828-9712-b1ea13725cc2
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252F474adc20d0994172980c8618a689db6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/474adc20d0994172980c8618a689db6d/images/large/1.jpg not downloaded yet
2026-01-27 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/914/8b167a8a071c49bcbc41cb3b892feb20/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/706/637471b8a2584a029fd8b8017dcb0578/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/462/63b59294802a4d7aba2482f9b2b92fd0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:32 [ayvens.es] INFO: Found listing with ID: 1875275
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875275%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [ayvens.es] INFO: Scrape type for 1875275: 1
2026-01-27 20:04:32 [ayvens.es] INFO: Extracting data for car ID: 1875275
2026-01-27 20:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9598498b-6049-5db8-81d1-e9a277501615 with identifier: 1875275
2026-01-27 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9598498b-6049-5db8-81d1-e9a277501615 with scrape type 1
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9598498b-6049-5db8-81d1-e9a277501615
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252Fd909637d7e794319a5b00e9b12ac9fdb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/d909637d7e794319a5b00e9b12ac9fdb/images/large/1.jpg not downloaded yet
2026-01-27 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/177/b99ea83843a14659a49a064cf19cf42e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/116/f77b1a9134cf492182c22e6e831318a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:32 [ayvens.es] INFO: Found listing with ID: 1875276
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875276%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [ayvens.es] INFO: Scrape type for 1875276: 1
2026-01-27 20:04:32 [ayvens.es] INFO: Extracting data for car ID: 1875276
2026-01-27 20:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c with identifier: 1875276
2026-01-27 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c with scrape type 1
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F929%252F4f5be1641ed946f99091c1c3f3c6c7c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/929/4f5be1641ed946f99091c1c3f3c6c7c8/images/large/1.jpg not downloaded yet
2026-01-27 20:04:32 [ayvens.es] INFO: Found listing with ID: 1875277
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875277%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [ayvens.es] INFO: Scrape type for 1875277: 1
2026-01-27 20:04:32 [ayvens.es] INFO: Extracting data for car ID: 1875277
2026-01-27 20:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b23136ca-6aea-5d09-aa6f-a48e0745ae5a with identifier: 1875277
2026-01-27 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23136ca-6aea-5d09-aa6f-a48e0745ae5a with scrape type 1
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b23136ca-6aea-5d09-aa6f-a48e0745ae5a
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252Fb581a1007bee41cfb35d75cb97cc2800%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/b581a1007bee41cfb35d75cb97cc2800/images/large/1.jpg not downloaded yet
2026-01-27 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/600/ad643e73d65d48d5b6239ebcc8059b30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/453/5374d07b247c4bb89c5d4fe43b789ef3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/612/efa24482deb6453bacf415150a03d53c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:32 [ayvens.es] INFO: Found listing with ID: 1875278
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875278%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [ayvens.es] INFO: Scrape type for 1875278: 1
2026-01-27 20:04:32 [ayvens.es] INFO: Extracting data for car ID: 1875278
2026-01-27 20:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4640fa37-1022-5279-9e9f-b95b3fe28ba0 with identifier: 1875278
2026-01-27 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4640fa37-1022-5279-9e9f-b95b3fe28ba0 with scrape type 1
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4640fa37-1022-5279-9e9f-b95b3fe28ba0
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F082%252F0b475272f849486d95e83a7362304961%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/082/0b475272f849486d95e83a7362304961/images/large/1.jpg not downloaded yet
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57232c0d0>
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ae06f5-ac20-504f-91d5-80fdd5405d6b/55ae06f5-ac20-504f-91d5-80fdd5405d6b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F914%252F8b167a8a071c49bcbc41cb3b892feb20%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/914/8b167a8a071c49bcbc41cb3b892feb20/images/large/1.jpg saved to cache
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55ae06f5-ac20-504f-91d5-80fdd5405d6b
2026-01-27 20:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55ae06f5-ac20-504f-91d5-80fdd5405d6b, skipping ID generation
2026-01-27 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55ae06f5-ac20-504f-91d5-80fdd5405d6b with scrape type 1
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 55ae06f5-ac20-504f-91d5-80fdd5405d6b from tracking dictionaries
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55ae06f5-ac20-504f-91d5-80fdd5405d6b sending to next pipeline
2026-01-27 20:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 55ae06f5-ac20-504f-91d5-80fdd5405d6b, identifier: 1875267
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b40ed0>
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a564a6f-85af-5afa-bfca-03b394fd194a/2a564a6f-85af-5afa-bfca-03b394fd194a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252F637471b8a2584a029fd8b8017dcb0578%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/637471b8a2584a029fd8b8017dcb0578/images/large/1.jpg saved to cache
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a564a6f-85af-5afa-bfca-03b394fd194a
2026-01-27 20:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a564a6f-85af-5afa-bfca-03b394fd194a, skipping ID generation
2026-01-27 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a564a6f-85af-5afa-bfca-03b394fd194a with scrape type 1
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2a564a6f-85af-5afa-bfca-03b394fd194a from tracking dictionaries
2026-01-27 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a564a6f-85af-5afa-bfca-03b394fd194a sending to next pipeline
2026-01-27 20:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2a564a6f-85af-5afa-bfca-03b394fd194a, identifier: 1875264
2026-01-27 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708cbdd0>
2026-01-27 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46961cdb-7e25-5a5d-9515-cc98512038f4/46961cdb-7e25-5a5d-9515-cc98512038f4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F462%252F63b59294802a4d7aba2482f9b2b92fd0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/462/63b59294802a4d7aba2482f9b2b92fd0/images/large/1.jpg saved to cache
2026-01-27 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46961cdb-7e25-5a5d-9515-cc98512038f4
2026-01-27 20:04:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46961cdb-7e25-5a5d-9515-cc98512038f4, skipping ID generation
2026-01-27 20:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46961cdb-7e25-5a5d-9515-cc98512038f4 with scrape type 1
2026-01-27 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 46961cdb-7e25-5a5d-9515-cc98512038f4 from tracking dictionaries
2026-01-27 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46961cdb-7e25-5a5d-9515-cc98512038f4 sending to next pipeline
2026-01-27 20:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 46961cdb-7e25-5a5d-9515-cc98512038f4, identifier: 1875266
2026-01-27 20:04:33 [ayvens.es] INFO: Found listing with ID: 1875279
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875279%27 HTTP/1.1" 200 None
2026-01-27 20:04:33 [ayvens.es] INFO: Scrape type for 1875279: 1
2026-01-27 20:04:33 [ayvens.es] INFO: Extracting data for car ID: 1875279
2026-01-27 20:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97a59b35-2761-5a42-bf13-cbbfa16c5764 with identifier: 1875279
2026-01-27 20:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97a59b35-2761-5a42-bf13-cbbfa16c5764 with scrape type 1
2026-01-27 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 97a59b35-2761-5a42-bf13-cbbfa16c5764
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F601%252F88d2c1f4a76644fab66f747cbd1d3083%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/601/88d2c1f4a76644fab66f747cbd1d3083/images/large/1.jpg not downloaded yet
2026-01-27 20:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 55ae06f5-ac20-504f-91d5-80fdd5405d6b with identifier: 1875267
2026-01-27 20:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 55ae06f5-ac20-504f-91d5-80fdd5405d6b with identifier: 1875267
2026-01-27 20:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 55ae06f5-ac20-504f-91d5-80fdd5405d6b with identifier: 1875267 to the API
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/914/8b167a8a071c49bcbc41cb3b892feb20/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '55ae06f5-ac20-504f-91d5-80fdd5405d6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 58174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ae06f5-ac20-504f-91d5-80fdd5405d6b/55ae06f5-ac20-504f-91d5-80fdd5405d6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/914/8b167a8a071c49bcbc41cb3b892feb20/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 92kW (125cv) Titanium',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 92kW (125cv) Titanium',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875267%27 HTTP/1.1" 200 None
2026-01-27 20:04:34 [ayvens.es] INFO: Saving data for 1875267: {'created_time': 1769544274.008245, 'last_price_update_time': 1769544274.008255, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875267') HTTP/1.1" 204 0
2026-01-27 20:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2a564a6f-85af-5afa-bfca-03b394fd194a with identifier: 1875264
2026-01-27 20:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2a564a6f-85af-5afa-bfca-03b394fd194a with identifier: 1875264
2026-01-27 20:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2a564a6f-85af-5afa-bfca-03b394fd194a with identifier: 1875264 to the API
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/706/637471b8a2584a029fd8b8017dcb0578/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2a564a6f-85af-5afa-bfca-03b394fd194a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 78971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a564a6f-85af-5afa-bfca-03b394fd194a/2a564a6f-85af-5afa-bfca-03b394fd194a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/706/637471b8a2584a029fd8b8017dcb0578/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Advanced 40 TDI 150kW quattro-ultra',
 'transmission': 'manual',
 'trim': 'Advanced 40 TDI 150kW quattro-ultra',
 'vin': None,
 'year': 2023}
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875264%27 HTTP/1.1" 200 None
2026-01-27 20:04:34 [ayvens.es] INFO: Saving data for 1875264: {'created_time': 1769544274.330128, 'last_price_update_time': 1769544274.330139, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875264') HTTP/1.1" 204 0
2026-01-27 20:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 46961cdb-7e25-5a5d-9515-cc98512038f4 with identifier: 1875266
2026-01-27 20:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 46961cdb-7e25-5a5d-9515-cc98512038f4 with identifier: 1875266
2026-01-27 20:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 46961cdb-7e25-5a5d-9515-cc98512038f4 with identifier: 1875266 to the API
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/462/63b59294802a4d7aba2482f9b2b92fd0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '46961cdb-7e25-5a5d-9515-cc98512038f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 131023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46961cdb-7e25-5a5d-9515-cc98512038f4/46961cdb-7e25-5a5d-9515-cc98512038f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/462/63b59294802a4d7aba2482f9b2b92fd0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Advance 1.0 59kW (80CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.0 59kW (80CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875266%27 HTTP/1.1" 200 None
2026-01-27 20:04:34 [ayvens.es] INFO: Saving data for 1875266: {'created_time': 1769544274.696995, 'last_price_update_time': 1769544274.697007, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875266') HTTP/1.1" 204 0
2026-01-27 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572374510>
2026-01-27 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2b161b5-7cb7-582d-a579-28c9249529af/c2b161b5-7cb7-582d-a579-28c9249529af_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252Fb99ea83843a14659a49a064cf19cf42e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/b99ea83843a14659a49a064cf19cf42e/images/large/1.jpg saved to cache
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2b161b5-7cb7-582d-a579-28c9249529af
2026-01-27 20:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2b161b5-7cb7-582d-a579-28c9249529af, skipping ID generation
2026-01-27 20:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b161b5-7cb7-582d-a579-28c9249529af with scrape type 1
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c2b161b5-7cb7-582d-a579-28c9249529af from tracking dictionaries
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2b161b5-7cb7-582d-a579-28c9249529af sending to next pipeline
2026-01-27 20:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c2b161b5-7cb7-582d-a579-28c9249529af, identifier: 1875265
2026-01-27 20:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721a7c90>
2026-01-27 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de50e316-914d-5f8b-a03e-8bf1e5fb3af4/de50e316-914d-5f8b-a03e-8bf1e5fb3af4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F116%252Ff77b1a9134cf492182c22e6e831318a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/116/f77b1a9134cf492182c22e6e831318a9/images/large/1.jpg saved to cache
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de50e316-914d-5f8b-a03e-8bf1e5fb3af4
2026-01-27 20:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de50e316-914d-5f8b-a03e-8bf1e5fb3af4, skipping ID generation
2026-01-27 20:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de50e316-914d-5f8b-a03e-8bf1e5fb3af4 with scrape type 1
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item de50e316-914d-5f8b-a03e-8bf1e5fb3af4 from tracking dictionaries
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de50e316-914d-5f8b-a03e-8bf1e5fb3af4 sending to next pipeline
2026-01-27 20:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de50e316-914d-5f8b-a03e-8bf1e5fb3af4, identifier: 1875270
2026-01-27 20:04:35 [ayvens.es] INFO: Found listing with ID: 1875303
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875303%27 HTTP/1.1" 200 None
2026-01-27 20:04:35 [ayvens.es] INFO: Scrape type for 1875303: 1
2026-01-27 20:04:35 [ayvens.es] INFO: Extracting data for car ID: 1875303
2026-01-27 20:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69242793-6ee9-5561-84b6-87611f94874d with identifier: 1875303
2026-01-27 20:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69242793-6ee9-5561-84b6-87611f94874d with scrape type 1
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69242793-6ee9-5561-84b6-87611f94874d
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F380%252F70b9377e51a34f36a33db795448cd1ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/380/70b9377e51a34f36a33db795448cd1ec/images/large/1.jpg not downloaded yet
2026-01-27 20:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c2b161b5-7cb7-582d-a579-28c9249529af with identifier: 1875265
2026-01-27 20:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c2b161b5-7cb7-582d-a579-28c9249529af with identifier: 1875265
2026-01-27 20:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c2b161b5-7cb7-582d-a579-28c9249529af with identifier: 1875265 to the API
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/177/b99ea83843a14659a49a064cf19cf42e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c2b161b5-7cb7-582d-a579-28c9249529af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 64975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2b161b5-7cb7-582d-a579-28c9249529af/c2b161b5-7cb7-582d-a579-28c9249529af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/177/b99ea83843a14659a49a064cf19cf42e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV Drive DCT',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV Drive DCT',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875265%27 HTTP/1.1" 200 None
2026-01-27 20:04:35 [ayvens.es] INFO: Saving data for 1875265: {'created_time': 1769544275.888685, 'last_price_update_time': 1769544275.888698, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875265') HTTP/1.1" 204 0
2026-01-27 20:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de50e316-914d-5f8b-a03e-8bf1e5fb3af4 with identifier: 1875270
2026-01-27 20:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de50e316-914d-5f8b-a03e-8bf1e5fb3af4 with identifier: 1875270
2026-01-27 20:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de50e316-914d-5f8b-a03e-8bf1e5fb3af4 with identifier: 1875270 to the API
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/116/f77b1a9134cf492182c22e6e831318a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'de50e316-914d-5f8b-a03e-8bf1e5fb3af4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 59633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de50e316-914d-5f8b-a03e-8bf1e5fb3af4/de50e316-914d-5f8b-a03e-8bf1e5fb3af4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/116/f77b1a9134cf492182c22e6e831318a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875270%27 HTTP/1.1" 200 None
2026-01-27 20:04:36 [ayvens.es] INFO: Saving data for 1875270: {'created_time': 1769544276.274252, 'last_price_update_time': 1769544276.274266, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875270') HTTP/1.1" 204 0
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57228a7d0>
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_797b89ad-f1c2-59bd-983f-57dd50be6631/797b89ad-f1c2-59bd-983f-57dd50be6631_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F600%252Fad643e73d65d48d5b6239ebcc8059b30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/600/ad643e73d65d48d5b6239ebcc8059b30/images/large/1.jpg saved to cache
2026-01-27 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 797b89ad-f1c2-59bd-983f-57dd50be6631
2026-01-27 20:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 797b89ad-f1c2-59bd-983f-57dd50be6631, skipping ID generation
2026-01-27 20:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 797b89ad-f1c2-59bd-983f-57dd50be6631 with scrape type 1
2026-01-27 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 797b89ad-f1c2-59bd-983f-57dd50be6631 from tracking dictionaries
2026-01-27 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 797b89ad-f1c2-59bd-983f-57dd50be6631 sending to next pipeline
2026-01-27 20:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 797b89ad-f1c2-59bd-983f-57dd50be6631, identifier: 1875268
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571edda90>
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21378168-77db-543a-9fd1-8f78ef4efac4/21378168-77db-543a-9fd1-8f78ef4efac4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F453%252F5374d07b247c4bb89c5d4fe43b789ef3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/453/5374d07b247c4bb89c5d4fe43b789ef3/images/large/1.jpg saved to cache
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21378168-77db-543a-9fd1-8f78ef4efac4
2026-01-27 20:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21378168-77db-543a-9fd1-8f78ef4efac4, skipping ID generation
2026-01-27 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21378168-77db-543a-9fd1-8f78ef4efac4 with scrape type 1
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 21378168-77db-543a-9fd1-8f78ef4efac4 from tracking dictionaries
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21378168-77db-543a-9fd1-8f78ef4efac4 sending to next pipeline
2026-01-27 20:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 21378168-77db-543a-9fd1-8f78ef4efac4, identifier: 1875269
2026-01-27 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d2810>
2026-01-27 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9e4a2b-9750-508e-86fc-c7a88e638e13/1a9e4a2b-9750-508e-86fc-c7a88e638e13_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F612%252Fefa24482deb6453bacf415150a03d53c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/612/efa24482deb6453bacf415150a03d53c/images/large/1.jpg saved to cache
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a9e4a2b-9750-508e-86fc-c7a88e638e13
2026-01-27 20:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a9e4a2b-9750-508e-86fc-c7a88e638e13, skipping ID generation
2026-01-27 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9e4a2b-9750-508e-86fc-c7a88e638e13 with scrape type 1
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a9e4a2b-9750-508e-86fc-c7a88e638e13 from tracking dictionaries
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a9e4a2b-9750-508e-86fc-c7a88e638e13 sending to next pipeline
2026-01-27 20:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1a9e4a2b-9750-508e-86fc-c7a88e638e13, identifier: 1875271
2026-01-27 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/340/fc28d7f3d1f941b78ee9ff5eb2b3b745/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:37 [ayvens.es] INFO: Found listing with ID: 1875304
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875304%27 HTTP/1.1" 200 None
2026-01-27 20:04:37 [ayvens.es] INFO: Scrape type for 1875304: 1
2026-01-27 20:04:37 [ayvens.es] INFO: Extracting data for car ID: 1875304
2026-01-27 20:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d1bcb4b-1175-5817-be3c-4a19ac675acd with identifier: 1875304
2026-01-27 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d1bcb4b-1175-5817-be3c-4a19ac675acd with scrape type 1
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d1bcb4b-1175-5817-be3c-4a19ac675acd
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F145%252F3db3a68a9108471c899665f5e892bd7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/145/3db3a68a9108471c899665f5e892bd7d/images/large/1.jpg not downloaded yet
2026-01-27 20:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 797b89ad-f1c2-59bd-983f-57dd50be6631 with identifier: 1875268
2026-01-27 20:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 797b89ad-f1c2-59bd-983f-57dd50be6631 with identifier: 1875268
2026-01-27 20:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 797b89ad-f1c2-59bd-983f-57dd50be6631 with identifier: 1875268 to the API
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/600/ad643e73d65d48d5b6239ebcc8059b30/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '797b89ad-f1c2-59bd-983f-57dd50be6631',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 56707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_797b89ad-f1c2-59bd-983f-57dd50be6631/797b89ad-f1c2-59bd-983f-57dd50be6631_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/600/ad643e73d65d48d5b6239ebcc8059b30/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Advance 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875268%27 HTTP/1.1" 200 None
2026-01-27 20:04:38 [ayvens.es] INFO: Saving data for 1875268: {'created_time': 1769544278.121506, 'last_price_update_time': 1769544278.12152, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875268') HTTP/1.1" 204 0
2026-01-27 20:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 21378168-77db-543a-9fd1-8f78ef4efac4 with identifier: 1875269
2026-01-27 20:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 21378168-77db-543a-9fd1-8f78ef4efac4 with identifier: 1875269
2026-01-27 20:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 21378168-77db-543a-9fd1-8f78ef4efac4 with identifier: 1875269 to the API
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/453/5374d07b247c4bb89c5d4fe43b789ef3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '21378168-77db-543a-9fd1-8f78ef4efac4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 69700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21378168-77db-543a-9fd1-8f78ef4efac4/21378168-77db-543a-9fd1-8f78ef4efac4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/453/5374d07b247c4bb89c5d4fe43b789ef3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.0 TSI 81KW (110 CV) Emotion',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW (110 CV) Emotion',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875269%27 HTTP/1.1" 200 None
2026-01-27 20:04:38 [ayvens.es] INFO: Saving data for 1875269: {'created_time': 1769544278.460784, 'last_price_update_time': 1769544278.460797, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875269') HTTP/1.1" 204 0
2026-01-27 20:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1a9e4a2b-9750-508e-86fc-c7a88e638e13 with identifier: 1875271
2026-01-27 20:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1a9e4a2b-9750-508e-86fc-c7a88e638e13 with identifier: 1875271
2026-01-27 20:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1a9e4a2b-9750-508e-86fc-c7a88e638e13 with identifier: 1875271 to the API
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/612/efa24482deb6453bacf415150a03d53c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1a9e4a2b-9750-508e-86fc-c7a88e638e13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 84286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9e4a2b-9750-508e-86fc-c7a88e638e13/1a9e4a2b-9750-508e-86fc-c7a88e638e13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/612/efa24482deb6453bacf415150a03d53c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875271%27 HTTP/1.1" 200 None
2026-01-27 20:04:38 [ayvens.es] INFO: Saving data for 1875271: {'created_time': 1769544278.839307, 'last_price_update_time': 1769544278.839317, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875271') HTTP/1.1" 204 0
2026-01-27 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/046/fba67ff4546e4c4a83bcf60506ab90c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/684/d909637d7e794319a5b00e9b12ac9fdb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:38 [ayvens.es] INFO: Found listing with ID: 1875305
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875305%27 HTTP/1.1" 200 None
2026-01-27 20:04:38 [ayvens.es] INFO: Scrape type for 1875305: 1
2026-01-27 20:04:38 [ayvens.es] INFO: Extracting data for car ID: 1875305
2026-01-27 20:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eeaaa59-8047-5337-a98d-f961aa566a66 with identifier: 1875305
2026-01-27 20:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eeaaa59-8047-5337-a98d-f961aa566a66 with scrape type 1
2026-01-27 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1eeaaa59-8047-5337-a98d-f961aa566a66
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F961%252F653801a3293e491db3d0e241d6636e7a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/961/653801a3293e491db3d0e241d6636e7a/images/large/1.jpg not downloaded yet
2026-01-27 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/929/4f5be1641ed946f99091c1c3f3c6c7c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a9f810>
2026-01-27 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b957c122-938e-59fc-9baa-a0a1869a5f50/b957c122-938e-59fc-9baa-a0a1869a5f50_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F340%252Ffc28d7f3d1f941b78ee9ff5eb2b3b745%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/340/fc28d7f3d1f941b78ee9ff5eb2b3b745/images/large/1.jpg saved to cache
2026-01-27 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b957c122-938e-59fc-9baa-a0a1869a5f50
2026-01-27 20:04:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b957c122-938e-59fc-9baa-a0a1869a5f50, skipping ID generation
2026-01-27 20:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b957c122-938e-59fc-9baa-a0a1869a5f50 with scrape type 1
2026-01-27 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b957c122-938e-59fc-9baa-a0a1869a5f50 from tracking dictionaries
2026-01-27 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b957c122-938e-59fc-9baa-a0a1869a5f50 sending to next pipeline
2026-01-27 20:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b957c122-938e-59fc-9baa-a0a1869a5f50, identifier: 1875272
2026-01-27 20:04:39 [ayvens.es] INFO: Found listing with ID: 1875306
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875306%27 HTTP/1.1" 200 None
2026-01-27 20:04:39 [ayvens.es] INFO: Scrape type for 1875306: 1
2026-01-27 20:04:39 [ayvens.es] INFO: Extracting data for car ID: 1875306
2026-01-27 20:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f55e0c4-1046-54da-ad53-e427e25607d1 with identifier: 1875306
2026-01-27 20:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f55e0c4-1046-54da-ad53-e427e25607d1 with scrape type 1
2026-01-27 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6f55e0c4-1046-54da-ad53-e427e25607d1
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F288%252Fee3f5bd9ba244414a4a7027344db193e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/288/ee3f5bd9ba244414a4a7027344db193e/images/large/1.jpg not downloaded yet
2026-01-27 20:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b957c122-938e-59fc-9baa-a0a1869a5f50 with identifier: 1875272
2026-01-27 20:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b957c122-938e-59fc-9baa-a0a1869a5f50 with identifier: 1875272
2026-01-27 20:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b957c122-938e-59fc-9baa-a0a1869a5f50 with identifier: 1875272 to the API
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/340/fc28d7f3d1f941b78ee9ff5eb2b3b745/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b957c122-938e-59fc-9baa-a0a1869a5f50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 21901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b957c122-938e-59fc-9baa-a0a1869a5f50/b957c122-938e-59fc-9baa-a0a1869a5f50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/340/fc28d7f3d1f941b78ee9ff5eb2b3b745/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 250 e',
 'transmission': 'manual',
 'trim': 'A 250 e',
 'vin': None,
 'year': 2023}
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875272%27 HTTP/1.1" 200 None
2026-01-27 20:04:39 [ayvens.es] INFO: Saving data for 1875272: {'created_time': 1769544279.8654, 'last_price_update_time': 1769544279.865411, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875272') HTTP/1.1" 204 0
2026-01-27 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/409/474adc20d0994172980c8618a689db6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/082/0b475272f849486d95e83a7362304961/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:39 [ayvens.es] INFO: Found listing with ID: 1875307
2026-01-27 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875307%27 HTTP/1.1" 200 None
2026-01-27 20:04:40 [ayvens.es] INFO: Scrape type for 1875307: 1
2026-01-27 20:04:40 [ayvens.es] INFO: Extracting data for car ID: 1875307
2026-01-27 20:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 with identifier: 1875307
2026-01-27 20:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 with scrape type 1
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc160273-e8f8-5b9f-a3ad-be8e1df4edb3
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F096%252F2b919874d21948f293f47ac19b8b93bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/096/2b919874d21948f293f47ac19b8b93bd/images/large/1.jpg not downloaded yet
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b5cc50>
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b218ee11-24db-5749-adf4-683caf62698d/b218ee11-24db-5749-adf4-683caf62698d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F046%252Ffba67ff4546e4c4a83bcf60506ab90c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/046/fba67ff4546e4c4a83bcf60506ab90c8/images/large/1.jpg saved to cache
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b218ee11-24db-5749-adf4-683caf62698d
2026-01-27 20:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b218ee11-24db-5749-adf4-683caf62698d, skipping ID generation
2026-01-27 20:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b218ee11-24db-5749-adf4-683caf62698d with scrape type 1
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b218ee11-24db-5749-adf4-683caf62698d from tracking dictionaries
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b218ee11-24db-5749-adf4-683caf62698d sending to next pipeline
2026-01-27 20:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b218ee11-24db-5749-adf4-683caf62698d, identifier: 1875273
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724f8290>
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9598498b-6049-5db8-81d1-e9a277501615/9598498b-6049-5db8-81d1-e9a277501615_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252Fd909637d7e794319a5b00e9b12ac9fdb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/d909637d7e794319a5b00e9b12ac9fdb/images/large/1.jpg saved to cache
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9598498b-6049-5db8-81d1-e9a277501615
2026-01-27 20:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9598498b-6049-5db8-81d1-e9a277501615, skipping ID generation
2026-01-27 20:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9598498b-6049-5db8-81d1-e9a277501615 with scrape type 1
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9598498b-6049-5db8-81d1-e9a277501615 from tracking dictionaries
2026-01-27 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9598498b-6049-5db8-81d1-e9a277501615 sending to next pipeline
2026-01-27 20:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9598498b-6049-5db8-81d1-e9a277501615, identifier: 1875275
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57224d390>
2026-01-27 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c/7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F929%252F4f5be1641ed946f99091c1c3f3c6c7c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/929/4f5be1641ed946f99091c1c3f3c6c7c8/images/large/1.jpg saved to cache
2026-01-27 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c
2026-01-27 20:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c, skipping ID generation
2026-01-27 20:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c with scrape type 1
2026-01-27 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c from tracking dictionaries
2026-01-27 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c sending to next pipeline
2026-01-27 20:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c, identifier: 1875276
2026-01-27 20:04:41 [ayvens.es] INFO: Found listing with ID: 1875308
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875308%27 HTTP/1.1" 200 None
2026-01-27 20:04:41 [ayvens.es] INFO: Scrape type for 1875308: 1
2026-01-27 20:04:41 [ayvens.es] INFO: Extracting data for car ID: 1875308
2026-01-27 20:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e5e77c-6af8-527a-9de2-b89e1b868e3e with identifier: 1875308
2026-01-27 20:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e5e77c-6af8-527a-9de2-b89e1b868e3e with scrape type 1
2026-01-27 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f5e5e77c-6af8-527a-9de2-b89e1b868e3e
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F839%252Ff6888419f6ba45c3bb18412c3b414ce7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/839/f6888419f6ba45c3bb18412c3b414ce7/images/large/1.jpg not downloaded yet
2026-01-27 20:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b218ee11-24db-5749-adf4-683caf62698d with identifier: 1875273
2026-01-27 20:04:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b218ee11-24db-5749-adf4-683caf62698d with identifier: 1875273
2026-01-27 20:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b218ee11-24db-5749-adf4-683caf62698d with identifier: 1875273 to the API
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/046/fba67ff4546e4c4a83bcf60506ab90c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 14,
 'color': 'Frozen',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b218ee11-24db-5749-adf4-683caf62698d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 5',
 'odometer': 58799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b218ee11-24db-5749-adf4-683caf62698d/b218ee11-24db-5749-adf4-683caf62698d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/046/fba67ff4546e4c4a83bcf60506ab90c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 5 530e',
 'transmission': 'manual',
 'trim': '530e',
 'vin': None,
 'year': 2025}
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875273%27 HTTP/1.1" 200 None
2026-01-27 20:04:41 [ayvens.es] INFO: Saving data for 1875273: {'created_time': 1769544281.950758, 'last_price_update_time': 1769544281.950769, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875273') HTTP/1.1" 204 0
2026-01-27 20:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9598498b-6049-5db8-81d1-e9a277501615 with identifier: 1875275
2026-01-27 20:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9598498b-6049-5db8-81d1-e9a277501615 with identifier: 1875275
2026-01-27 20:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9598498b-6049-5db8-81d1-e9a277501615 with identifier: 1875275 to the API
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/684/d909637d7e794319a5b00e9b12ac9fdb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9598498b-6049-5db8-81d1-e9a277501615',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 9604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9598498b-6049-5db8-81d1-e9a277501615/9598498b-6049-5db8-81d1-e9a277501615_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/684/d909637d7e794319a5b00e9b12ac9fdb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 TSI 85kW (115CV) Style XL',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style XL',
 'vin': None,
 'year': 2024}
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875275%27 HTTP/1.1" 200 None
2026-01-27 20:04:42 [ayvens.es] INFO: Saving data for 1875275: {'created_time': 1769544282.389219, 'last_price_update_time': 1769544282.38923, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875275') HTTP/1.1" 204 0
2026-01-27 20:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c with identifier: 1875276
2026-01-27 20:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c with identifier: 1875276
2026-01-27 20:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c with identifier: 1875276 to the API
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/929/4f5be1641ed946f99091c1c3f3c6c7c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 81229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c/7fe6b2d6-9c91-5ac6-bb54-0d71ede7ac0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/929/4f5be1641ed946f99091c1c3f3c6c7c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Life 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875276%27 HTTP/1.1" 200 None
2026-01-27 20:04:42 [ayvens.es] INFO: Saving data for 1875276: {'created_time': 1769544282.767467, 'last_price_update_time': 1769544282.76748, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875276') HTTP/1.1" 204 0
2026-01-27 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/840/b581a1007bee41cfb35d75cb97cc2800/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57224e610>
2026-01-27 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a25999d-4cef-5828-9712-b1ea13725cc2/0a25999d-4cef-5828-9712-b1ea13725cc2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252F474adc20d0994172980c8618a689db6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/474adc20d0994172980c8618a689db6d/images/large/1.jpg saved to cache
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a25999d-4cef-5828-9712-b1ea13725cc2
2026-01-27 20:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a25999d-4cef-5828-9712-b1ea13725cc2, skipping ID generation
2026-01-27 20:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a25999d-4cef-5828-9712-b1ea13725cc2 with scrape type 1
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0a25999d-4cef-5828-9712-b1ea13725cc2 from tracking dictionaries
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a25999d-4cef-5828-9712-b1ea13725cc2 sending to next pipeline
2026-01-27 20:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0a25999d-4cef-5828-9712-b1ea13725cc2, identifier: 1875274
2026-01-27 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5723f3bd0>
2026-01-27 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4640fa37-1022-5279-9e9f-b95b3fe28ba0/4640fa37-1022-5279-9e9f-b95b3fe28ba0_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F082%252F0b475272f849486d95e83a7362304961%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/082/0b475272f849486d95e83a7362304961/images/large/1.jpg saved to cache
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4640fa37-1022-5279-9e9f-b95b3fe28ba0
2026-01-27 20:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4640fa37-1022-5279-9e9f-b95b3fe28ba0, skipping ID generation
2026-01-27 20:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4640fa37-1022-5279-9e9f-b95b3fe28ba0 with scrape type 1
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4640fa37-1022-5279-9e9f-b95b3fe28ba0 from tracking dictionaries
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4640fa37-1022-5279-9e9f-b95b3fe28ba0 sending to next pipeline
2026-01-27 20:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4640fa37-1022-5279-9e9f-b95b3fe28ba0, identifier: 1875278
2026-01-27 20:04:43 [ayvens.es] INFO: Found listing with ID: 1875309
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875309%27 HTTP/1.1" 200 None
2026-01-27 20:04:43 [ayvens.es] INFO: Scrape type for 1875309: 1
2026-01-27 20:04:43 [ayvens.es] INFO: Extracting data for car ID: 1875309
2026-01-27 20:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dbfd919-65a2-5f6f-838f-ed5312f2e248 with identifier: 1875309
2026-01-27 20:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dbfd919-65a2-5f6f-838f-ed5312f2e248 with scrape type 1
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6dbfd919-65a2-5f6f-838f-ed5312f2e248
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F238%252Fd168d146ae314ad19780f6e824e24083%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/238/d168d146ae314ad19780f6e824e24083/images/large/1.jpg not downloaded yet
2026-01-27 20:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0a25999d-4cef-5828-9712-b1ea13725cc2 with identifier: 1875274
2026-01-27 20:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0a25999d-4cef-5828-9712-b1ea13725cc2 with identifier: 1875274
2026-01-27 20:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'puretech 60kw (83cv) feel', 'title': 'citroën c3 puretech 60kw (83cv) feel', 'price': 0, 'odometer': 52560, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-02', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 96, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0a25999d-4cef-5828-9712-b1ea13725cc2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a25999d-4cef-5828-9712-b1ea13725cc2/0a25999d-4cef-5828-9712-b1ea13725cc2_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/474adc20d0994172980c8618a689db6d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 583828}], 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 52560}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '0a25999d-4cef-5828-9712-b1ea13725cc2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c3',
     'model': 'c3',
     'odometer': 52560,
     'odometer_in_km': 52560,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a25999d-4cef-5828-9712-b1ea13725cc2/0a25999d-4cef-5828-9712-b1ea13725cc2_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 583828,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/474adc20d0994172980c8618a689db6d/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-02',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c3 puretech 60kw (83cv) feel',
     'transmission': 'manual',
     'trim': 'puretech 60kw (83cv) feel',
     'vin': None,
     'year': 2020}
2026-01-27 20:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0a25999d-4cef-5828-9712-b1ea13725cc2 spider: ayvens.es
2026-01-27 20:04:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0a25999d-4cef-5828-9712-b1ea13725cc2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'puretech 60kw (83cv) feel', 'title': 'citroën c3 puretech 60kw (83cv) feel', 'price': 0, 'odometer': 52560, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-02', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 96, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0a25999d-4cef-5828-9712-b1ea13725cc2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a25999d-4cef-5828-9712-b1ea13725cc2/0a25999d-4cef-5828-9712-b1ea13725cc2_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/474adc20d0994172980c8618a689db6d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 583828}], 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 52560}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 96,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'petrol',
     'id': '0a25999d-4cef-5828-9712-b1ea13725cc2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën c3',
     'model': 'c3',
     'odometer': 52560,
     'odometer_in_km': 52560,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a25999d-4cef-5828-9712-b1ea13725cc2/0a25999d-4cef-5828-9712-b1ea13725cc2_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 583828,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/474adc20d0994172980c8618a689db6d/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-02',
     'sanitized_make': 'citron',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroën c3 puretech 60kw (83cv) feel',
     'transmission': 'manual',
     'trim': 'puretech 60kw (83cv) feel',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0a25999d-4cef-5828-9712-b1ea13725cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 52560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a25999d-4cef-5828-9712-b1ea13725cc2/0a25999d-4cef-5828-9712-b1ea13725cc2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/474adc20d0994172980c8618a689db6d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 PureTech 60KW (83CV) FEEL',
 'transmission': 'manual',
 'trim': 'PureTech 60KW (83CV) FEEL',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875274%27 HTTP/1.1" 200 None
2026-01-27 20:04:43 [ayvens.es] INFO: Saving data for 1875274: {'created_time': 1769544283.974329, 'last_price_update_time': 1769544283.974343, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875274') HTTP/1.1" 204 0
2026-01-27 20:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4640fa37-1022-5279-9e9f-b95b3fe28ba0 with identifier: 1875278
2026-01-27 20:04:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4640fa37-1022-5279-9e9f-b95b3fe28ba0 with identifier: 1875278
2026-01-27 20:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4640fa37-1022-5279-9e9f-b95b3fe28ba0 with identifier: 1875278 to the API
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/082/0b475272f849486d95e83a7362304961/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4640fa37-1022-5279-9e9f-b95b3fe28ba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 107956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4640fa37-1022-5279-9e9f-b95b3fe28ba0/4640fa37-1022-5279-9e9f-b95b3fe28ba0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/082/0b475272f849486d95e83a7362304961/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Sport 2.0 TDI 110kW (150CV) 4Motion DSG',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 110kW (150CV) 4Motion DSG',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875278%27 HTTP/1.1" 200 None
2026-01-27 20:04:44 [ayvens.es] INFO: Saving data for 1875278: {'created_time': 1769544284.44319, 'last_price_update_time': 1769544284.443204, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875278') HTTP/1.1" 204 0
2026-01-27 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/601/88d2c1f4a76644fab66f747cbd1d3083/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:44 [ayvens.es] INFO: Found listing with ID: 1875310
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875310%27 HTTP/1.1" 200 None
2026-01-27 20:04:44 [ayvens.es] INFO: Scrape type for 1875310: 1
2026-01-27 20:04:44 [ayvens.es] INFO: Extracting data for car ID: 1875310
2026-01-27 20:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c085f5f8-ba30-5b39-a73b-b776c7d99251 with identifier: 1875310
2026-01-27 20:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c085f5f8-ba30-5b39-a73b-b776c7d99251 with scrape type 1
2026-01-27 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c085f5f8-ba30-5b39-a73b-b776c7d99251
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F099%252F9d31bf7bd40f49dc9878c4d84f421149%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/099/9d31bf7bd40f49dc9878c4d84f421149/images/large/1.jpg not downloaded yet
2026-01-27 20:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725fbbd0>
2026-01-27 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b23136ca-6aea-5d09-aa6f-a48e0745ae5a/b23136ca-6aea-5d09-aa6f-a48e0745ae5a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252Fb581a1007bee41cfb35d75cb97cc2800%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/b581a1007bee41cfb35d75cb97cc2800/images/large/1.jpg saved to cache
2026-01-27 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b23136ca-6aea-5d09-aa6f-a48e0745ae5a
2026-01-27 20:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b23136ca-6aea-5d09-aa6f-a48e0745ae5a, skipping ID generation
2026-01-27 20:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23136ca-6aea-5d09-aa6f-a48e0745ae5a with scrape type 1
2026-01-27 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b23136ca-6aea-5d09-aa6f-a48e0745ae5a from tracking dictionaries
2026-01-27 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b23136ca-6aea-5d09-aa6f-a48e0745ae5a sending to next pipeline
2026-01-27 20:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b23136ca-6aea-5d09-aa6f-a48e0745ae5a, identifier: 1875277
2026-01-27 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/380/70b9377e51a34f36a33db795448cd1ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/145/3db3a68a9108471c899665f5e892bd7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/961/653801a3293e491db3d0e241d6636e7a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:44 [ayvens.es] INFO: Found listing with ID: 1875311
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875311%27 HTTP/1.1" 200 None
2026-01-27 20:04:44 [ayvens.es] INFO: Scrape type for 1875311: 1
2026-01-27 20:04:44 [ayvens.es] INFO: Extracting data for car ID: 1875311
2026-01-27 20:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5b28697-434c-53f9-b9f8-9aad5ebefd20 with identifier: 1875311
2026-01-27 20:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b28697-434c-53f9-b9f8-9aad5ebefd20 with scrape type 1
2026-01-27 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c5b28697-434c-53f9-b9f8-9aad5ebefd20
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F247%252F6e38e142d3114f5bbcd3917fb86abac7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/247/6e38e142d3114f5bbcd3917fb86abac7/images/large/1.jpg not downloaded yet
2026-01-27 20:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b23136ca-6aea-5d09-aa6f-a48e0745ae5a with identifier: 1875277
2026-01-27 20:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b23136ca-6aea-5d09-aa6f-a48e0745ae5a with identifier: 1875277
2026-01-27 20:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b23136ca-6aea-5d09-aa6f-a48e0745ae5a with identifier: 1875277 to the API
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/840/b581a1007bee41cfb35d75cb97cc2800/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b23136ca-6aea-5d09-aa6f-a48e0745ae5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 85417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b23136ca-6aea-5d09-aa6f-a48e0745ae5a/b23136ca-6aea-5d09-aa6f-a48e0745ae5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/840/b581a1007bee41cfb35d75cb97cc2800/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Business 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2018}
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875277%27 HTTP/1.1" 200 None
2026-01-27 20:04:45 [ayvens.es] INFO: Saving data for 1875277: {'created_time': 1769544285.355557, 'last_price_update_time': 1769544285.355569, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875277') HTTP/1.1" 204 0
2026-01-27 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/288/ee3f5bd9ba244414a4a7027344db193e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:45 [ayvens.es] INFO: Found listing with ID: 1875312
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875312%27 HTTP/1.1" 200 None
2026-01-27 20:04:45 [ayvens.es] INFO: Scrape type for 1875312: 1
2026-01-27 20:04:45 [ayvens.es] INFO: Extracting data for car ID: 1875312
2026-01-27 20:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d17e8eeb-ee29-5984-8366-c92ef53f118d with identifier: 1875312
2026-01-27 20:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d17e8eeb-ee29-5984-8366-c92ef53f118d with scrape type 1
2026-01-27 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d17e8eeb-ee29-5984-8366-c92ef53f118d
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252F8b77b4e97aff483bac1d06bc8ecef480%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/8b77b4e97aff483bac1d06bc8ecef480/images/large/1.jpg not downloaded yet
2026-01-27 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/096/2b919874d21948f293f47ac19b8b93bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57231ea90>
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97a59b35-2761-5a42-bf13-cbbfa16c5764/97a59b35-2761-5a42-bf13-cbbfa16c5764_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F601%252F88d2c1f4a76644fab66f747cbd1d3083%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/601/88d2c1f4a76644fab66f747cbd1d3083/images/large/1.jpg saved to cache
2026-01-27 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97a59b35-2761-5a42-bf13-cbbfa16c5764
2026-01-27 20:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97a59b35-2761-5a42-bf13-cbbfa16c5764, skipping ID generation
2026-01-27 20:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97a59b35-2761-5a42-bf13-cbbfa16c5764 with scrape type 1
2026-01-27 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 97a59b35-2761-5a42-bf13-cbbfa16c5764 from tracking dictionaries
2026-01-27 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97a59b35-2761-5a42-bf13-cbbfa16c5764 sending to next pipeline
2026-01-27 20:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 97a59b35-2761-5a42-bf13-cbbfa16c5764, identifier: 1875279
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f03590>
2026-01-27 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69242793-6ee9-5561-84b6-87611f94874d/69242793-6ee9-5561-84b6-87611f94874d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F380%252F70b9377e51a34f36a33db795448cd1ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/380/70b9377e51a34f36a33db795448cd1ec/images/large/1.jpg saved to cache
2026-01-27 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69242793-6ee9-5561-84b6-87611f94874d
2026-01-27 20:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69242793-6ee9-5561-84b6-87611f94874d, skipping ID generation
2026-01-27 20:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69242793-6ee9-5561-84b6-87611f94874d with scrape type 1
2026-01-27 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 69242793-6ee9-5561-84b6-87611f94874d from tracking dictionaries
2026-01-27 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69242793-6ee9-5561-84b6-87611f94874d sending to next pipeline
2026-01-27 20:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 69242793-6ee9-5561-84b6-87611f94874d, identifier: 1875303
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5726511d0>
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d1bcb4b-1175-5817-be3c-4a19ac675acd/3d1bcb4b-1175-5817-be3c-4a19ac675acd_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F145%252F3db3a68a9108471c899665f5e892bd7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/145/3db3a68a9108471c899665f5e892bd7d/images/large/1.jpg saved to cache
2026-01-27 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d1bcb4b-1175-5817-be3c-4a19ac675acd
2026-01-27 20:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d1bcb4b-1175-5817-be3c-4a19ac675acd, skipping ID generation
2026-01-27 20:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d1bcb4b-1175-5817-be3c-4a19ac675acd with scrape type 1
2026-01-27 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3d1bcb4b-1175-5817-be3c-4a19ac675acd from tracking dictionaries
2026-01-27 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d1bcb4b-1175-5817-be3c-4a19ac675acd sending to next pipeline
2026-01-27 20:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d1bcb4b-1175-5817-be3c-4a19ac675acd, identifier: 1875304
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57231f190>
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeaaa59-8047-5337-a98d-f961aa566a66/1eeaaa59-8047-5337-a98d-f961aa566a66_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F961%252F653801a3293e491db3d0e241d6636e7a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/961/653801a3293e491db3d0e241d6636e7a/images/large/1.jpg saved to cache
2026-01-27 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1eeaaa59-8047-5337-a98d-f961aa566a66
2026-01-27 20:04:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1eeaaa59-8047-5337-a98d-f961aa566a66, skipping ID generation
2026-01-27 20:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eeaaa59-8047-5337-a98d-f961aa566a66 with scrape type 1
2026-01-27 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1eeaaa59-8047-5337-a98d-f961aa566a66 from tracking dictionaries
2026-01-27 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1eeaaa59-8047-5337-a98d-f961aa566a66 sending to next pipeline
2026-01-27 20:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1eeaaa59-8047-5337-a98d-f961aa566a66, identifier: 1875305
2026-01-27 20:04:47 [ayvens.es] INFO: Found listing with ID: 1875313
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875313%27 HTTP/1.1" 200 None
2026-01-27 20:04:47 [ayvens.es] INFO: Scrape type for 1875313: 1
2026-01-27 20:04:47 [ayvens.es] INFO: Extracting data for car ID: 1875313
2026-01-27 20:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99790074-2af3-5e49-9986-8364ba9c9568 with identifier: 1875313
2026-01-27 20:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99790074-2af3-5e49-9986-8364ba9c9568 with scrape type 1
2026-01-27 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99790074-2af3-5e49-9986-8364ba9c9568
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F842%252Fbf4c27b645414707937d4fcfba53a1b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/842/bf4c27b645414707937d4fcfba53a1b3/images/large/1.jpg not downloaded yet
2026-01-27 20:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 97a59b35-2761-5a42-bf13-cbbfa16c5764 with identifier: 1875279
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 97a59b35-2761-5a42-bf13-cbbfa16c5764 with identifier: 1875279
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161973 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161973
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 97a59b35-2761-5a42-bf13-cbbfa16c5764 spider: ayvens.es
2026-01-27 20:04:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 97a59b35-2761-5a42-bf13-cbbfa16c5764 due to rule: high_mileage_for_country.json, error: 161973 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161973
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '97a59b35-2761-5a42-bf13-cbbfa16c5764',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39116',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 161973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97a59b35-2761-5a42-bf13-cbbfa16c5764/97a59b35-2761-5a42-bf13-cbbfa16c5764_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/601/88d2c1f4a76644fab66f747cbd1d3083/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875279%27 HTTP/1.1" 200 None
2026-01-27 20:04:47 [ayvens.es] INFO: Saving data for 1875279: {'created_time': 1769544287.362032, 'last_price_update_time': 1769544287.362042, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875279') HTTP/1.1" 204 0
2026-01-27 20:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 69242793-6ee9-5561-84b6-87611f94874d with identifier: 1875303
2026-01-27 20:04:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 69242793-6ee9-5561-84b6-87611f94874d with identifier: 1875303
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'nv300' containing 'nv'
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 69242793-6ee9-5561-84b6-87611f94874d spider: ayvens.es
2026-01-27 20:04:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 69242793-6ee9-5561-84b6-87611f94874d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'nv300' containing 'nv'
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco hielo solido',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '69242793-6ee9-5561-84b6-87611f94874d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV300',
 'odometer': 22500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69242793-6ee9-5561-84b6-87611f94874d/69242793-6ee9-5561-84b6-87611f94874d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/380/70b9377e51a34f36a33db795448cd1ec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV300 1.6dCi 70kW (95CV) L1H1 1T PRO+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '1.6dCi 70kW (95CV) L1H1 1T PRO+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875303%27 HTTP/1.1" 200 None
2026-01-27 20:04:47 [ayvens.es] INFO: Saving data for 1875303: {'created_time': 1769544287.592732, 'last_price_update_time': 1769544287.592751, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875303') HTTP/1.1" 204 0
2026-01-27 20:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d1bcb4b-1175-5817-be3c-4a19ac675acd with identifier: 1875304
2026-01-27 20:04:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d1bcb4b-1175-5817-be3c-4a19ac675acd with identifier: 1875304
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3d1bcb4b-1175-5817-be3c-4a19ac675acd spider: ayvens.es
2026-01-27 20:04:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 3d1bcb4b-1175-5817-be3c-4a19ac675acd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'color': 'Rojo race',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3d1bcb4b-1175-5817-be3c-4a19ac675acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 114068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d1bcb4b-1175-5817-be3c-4a19ac675acd/3d1bcb4b-1175-5817-be3c-4a19ac675acd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/145/3db3a68a9108471c899665f5e892bd7d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 300 L2 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 300 L2 Trend',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875304%27 HTTP/1.1" 200 None
2026-01-27 20:04:47 [ayvens.es] INFO: Saving data for 1875304: {'created_time': 1769544287.841836, 'last_price_update_time': 1769544287.841851, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875304') HTTP/1.1" 204 0
2026-01-27 20:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1eeaaa59-8047-5337-a98d-f961aa566a66 with identifier: 1875305
2026-01-27 20:04:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1eeaaa59-8047-5337-a98d-f961aa566a66 with identifier: 1875305
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo cargo' containing 'doblo'
2026-01-27 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1eeaaa59-8047-5337-a98d-f961aa566a66 spider: ayvens.es
2026-01-27 20:04:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1eeaaa59-8047-5337-a98d-f961aa566a66 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo cargo' containing 'doblo'
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.4L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'gas',
 'id': '1eeaaa59-8047-5337-a98d-f961aa566a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 155928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeaaa59-8047-5337-a98d-f961aa566a66/1eeaaa59-8047-5337-a98d-f961aa566a66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/961/653801a3293e491db3d0e241d6636e7a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.4 T-Jet 88kW Natur Power CNG',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.4 T-Jet 88kW Natur Power CNG',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875305%27 HTTP/1.1" 200 None
2026-01-27 20:04:48 [ayvens.es] INFO: Saving data for 1875305: {'created_time': 1769544288.087161, 'last_price_update_time': 1769544288.087175, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875305') HTTP/1.1" 204 0
2026-01-27 20:04:48 [ayvens.es] INFO: Found listing with ID: 1875314
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875314%27 HTTP/1.1" 200 None
2026-01-27 20:04:48 [ayvens.es] INFO: Scrape type for 1875314: 1
2026-01-27 20:04:48 [ayvens.es] INFO: Extracting data for car ID: 1875314
2026-01-27 20:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f0e5464-38eb-52b6-8311-30db8462ec6b with identifier: 1875314
2026-01-27 20:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0e5464-38eb-52b6-8311-30db8462ec6b with scrape type 1
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4f0e5464-38eb-52b6-8311-30db8462ec6b
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F524%252F8814e55502334eb7a2f39b89f51b914a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/524/8814e55502334eb7a2f39b89f51b914a/images/large/1.jpg not downloaded yet
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57092bc50>
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f55e0c4-1046-54da-ad53-e427e25607d1/6f55e0c4-1046-54da-ad53-e427e25607d1_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F288%252Fee3f5bd9ba244414a4a7027344db193e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/288/ee3f5bd9ba244414a4a7027344db193e/images/large/1.jpg saved to cache
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f55e0c4-1046-54da-ad53-e427e25607d1
2026-01-27 20:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f55e0c4-1046-54da-ad53-e427e25607d1, skipping ID generation
2026-01-27 20:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f55e0c4-1046-54da-ad53-e427e25607d1 with scrape type 1
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6f55e0c4-1046-54da-ad53-e427e25607d1 from tracking dictionaries
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f55e0c4-1046-54da-ad53-e427e25607d1 sending to next pipeline
2026-01-27 20:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6f55e0c4-1046-54da-ad53-e427e25607d1, identifier: 1875306
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724cc550>
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc160273-e8f8-5b9f-a3ad-be8e1df4edb3/cc160273-e8f8-5b9f-a3ad-be8e1df4edb3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F096%252F2b919874d21948f293f47ac19b8b93bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/096/2b919874d21948f293f47ac19b8b93bd/images/large/1.jpg saved to cache
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc160273-e8f8-5b9f-a3ad-be8e1df4edb3
2026-01-27 20:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc160273-e8f8-5b9f-a3ad-be8e1df4edb3, skipping ID generation
2026-01-27 20:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 with scrape type 1
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 from tracking dictionaries
2026-01-27 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 sending to next pipeline
2026-01-27 20:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cc160273-e8f8-5b9f-a3ad-be8e1df4edb3, identifier: 1875307
2026-01-27 20:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6f55e0c4-1046-54da-ad53-e427e25607d1 with identifier: 1875306
2026-01-27 20:04:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6f55e0c4-1046-54da-ad53-e427e25607d1 with identifier: 1875306
2026-01-27 20:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-27 20:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6f55e0c4-1046-54da-ad53-e427e25607d1 spider: ayvens.es
2026-01-27 20:04:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6f55e0c4-1046-54da-ad53-e427e25607d1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6f55e0c4-1046-54da-ad53-e427e25607d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 142106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f55e0c4-1046-54da-ad53-e427e25607d1/6f55e0c4-1046-54da-ad53-e427e25607d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/288/ee3f5bd9ba244414a4a7027344db193e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 71kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 71kW Trend',
 'vin': None,
 'year': 2020}
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875306%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [ayvens.es] INFO: Saving data for 1875306: {'created_time': 1769544289.266838, 'last_price_update_time': 1769544289.266854, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875306') HTTP/1.1" 204 0
2026-01-27 20:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 with identifier: 1875307
2026-01-27 20:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 with identifier: 1875307
2026-01-27 20:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 spider: ayvens.es
2026-01-27 20:04:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: cc160273-e8f8-5b9f-a3ad-be8e1df4edb3 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cc160273-e8f8-5b9f-a3ad-be8e1df4edb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 114519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc160273-e8f8-5b9f-a3ad-be8e1df4edb3/cc160273-e8f8-5b9f-a3ad-be8e1df4edb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/096/2b919874d21948f293f47ac19b8b93bd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Compact dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional Compact dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875307%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [ayvens.es] INFO: Saving data for 1875307: {'created_time': 1769544289.5345, 'last_price_update_time': 1769544289.534511, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875307') HTTP/1.1" 204 0
2026-01-27 20:04:49 [ayvens.es] INFO: Found listing with ID: 1875315
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875315%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [ayvens.es] INFO: Scrape type for 1875315: 1
2026-01-27 20:04:49 [ayvens.es] INFO: Extracting data for car ID: 1875315
2026-01-27 20:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 with identifier: 1875315
2026-01-27 20:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 with scrape type 1
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e6341a0-2345-5ce7-bfee-1042f4f7baf5
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252Fd6e01bb530894030ab9e410b33eb446b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/d6e01bb530894030ab9e410b33eb446b/images/large/1.jpg not downloaded yet
2026-01-27 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/839/f6888419f6ba45c3bb18412c3b414ce7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:49 [ayvens.es] INFO: Found listing with ID: 1875316
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875316%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [ayvens.es] INFO: Scrape type for 1875316: 1
2026-01-27 20:04:49 [ayvens.es] INFO: Extracting data for car ID: 1875316
2026-01-27 20:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66796ae-0734-5275-829a-44714dea9f6e with identifier: 1875316
2026-01-27 20:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66796ae-0734-5275-829a-44714dea9f6e with scrape type 1
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f66796ae-0734-5275-829a-44714dea9f6e
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F401%252F797d92bb258048b381a6bf58ce368c37%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/401/797d92bb258048b381a6bf58ce368c37/images/large/1.jpg not downloaded yet
2026-01-27 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/238/d168d146ae314ad19780f6e824e24083/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:49 [ayvens.es] INFO: Found listing with ID: 1875317
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875317%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [ayvens.es] INFO: Scrape type for 1875317: 1
2026-01-27 20:04:49 [ayvens.es] INFO: Extracting data for car ID: 1875317
2026-01-27 20:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb with identifier: 1875317
2026-01-27 20:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb with scrape type 1
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F023%252Fbe9cb85bc8e144c580b26792583c8d2d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/023/be9cb85bc8e144c580b26792583c8d2d/images/large/1.jpg not downloaded yet
2026-01-27 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/099/9d31bf7bd40f49dc9878c4d84f421149/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/247/6e38e142d3114f5bbcd3917fb86abac7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/716/8b77b4e97aff483bac1d06bc8ecef480/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:49 [ayvens.es] INFO: Found listing with ID: 1875318
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875318%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [ayvens.es] INFO: Scrape type for 1875318: 1
2026-01-27 20:04:49 [ayvens.es] INFO: Extracting data for car ID: 1875318
2026-01-27 20:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9179002b-4ef2-502f-b698-cf39d2fcb2ff with identifier: 1875318
2026-01-27 20:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9179002b-4ef2-502f-b698-cf39d2fcb2ff with scrape type 1
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9179002b-4ef2-502f-b698-cf39d2fcb2ff
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F174%252Fd283d2000b9a4b1181523eb81475c65d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/174/d283d2000b9a4b1181523eb81475c65d/images/large/1.jpg not downloaded yet
2026-01-27 20:04:49 [ayvens.es] INFO: Found listing with ID: 1875319
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875319%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [ayvens.es] INFO: Scrape type for 1875319: 1
2026-01-27 20:04:49 [ayvens.es] INFO: Extracting data for car ID: 1875319
2026-01-27 20:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08f992d2-0120-5661-b297-da6f5918cbbc with identifier: 1875319
2026-01-27 20:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f992d2-0120-5661-b297-da6f5918cbbc with scrape type 1
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08f992d2-0120-5661-b297-da6f5918cbbc
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F266%252F9af285cdb0dd43e6beec319c8fead994%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/266/9af285cdb0dd43e6beec319c8fead994/images/large/1.jpg not downloaded yet
2026-01-27 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572352510>
2026-01-27 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5e5e77c-6af8-527a-9de2-b89e1b868e3e/f5e5e77c-6af8-527a-9de2-b89e1b868e3e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F839%252Ff6888419f6ba45c3bb18412c3b414ce7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/839/f6888419f6ba45c3bb18412c3b414ce7/images/large/1.jpg saved to cache
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5e5e77c-6af8-527a-9de2-b89e1b868e3e
2026-01-27 20:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5e5e77c-6af8-527a-9de2-b89e1b868e3e, skipping ID generation
2026-01-27 20:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e5e77c-6af8-527a-9de2-b89e1b868e3e with scrape type 1
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f5e5e77c-6af8-527a-9de2-b89e1b868e3e from tracking dictionaries
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5e5e77c-6af8-527a-9de2-b89e1b868e3e sending to next pipeline
2026-01-27 20:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f5e5e77c-6af8-527a-9de2-b89e1b868e3e, identifier: 1875308
2026-01-27 20:04:50 [ayvens.es] INFO: Found listing with ID: 1875320
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875320%27 HTTP/1.1" 200 None
2026-01-27 20:04:50 [ayvens.es] INFO: Scrape type for 1875320: 1
2026-01-27 20:04:50 [ayvens.es] INFO: Extracting data for car ID: 1875320
2026-01-27 20:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 with identifier: 1875320
2026-01-27 20:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 with scrape type 1
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3d537ff-b4d0-5bb4-9f02-09aedfdd6065
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F784%252F4bb4745ec04b4eb4af33f223cc2dbebc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/784/4bb4745ec04b4eb4af33f223cc2dbebc/images/large/1.jpg not downloaded yet
2026-01-27 20:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f5e5e77c-6af8-527a-9de2-b89e1b868e3e with identifier: 1875308
2026-01-27 20:04:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f5e5e77c-6af8-527a-9de2-b89e1b868e3e with identifier: 1875308
2026-01-27 20:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-27 20:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f5e5e77c-6af8-527a-9de2-b89e1b868e3e spider: ayvens.es
2026-01-27 20:04:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: f5e5e77c-6af8-527a-9de2-b89e1b868e3e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Verde vaillant ral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f5e5e77c-6af8-527a-9de2-b89e1b868e3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 41685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e5e77c-6af8-527a-9de2-b89e1b868e3e/f5e5e77c-6af8-527a-9de2-b89e1b868e3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/839/f6888419f6ba45c3bb18412c3b414ce7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875308%27 HTTP/1.1" 200 None
2026-01-27 20:04:50 [ayvens.es] INFO: Saving data for 1875308: {'created_time': 1769544290.494297, 'last_price_update_time': 1769544290.494308, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875308') HTTP/1.1" 204 0
2026-01-27 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff573e29690>
2026-01-27 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dbfd919-65a2-5f6f-838f-ed5312f2e248/6dbfd919-65a2-5f6f-838f-ed5312f2e248_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F238%252Fd168d146ae314ad19780f6e824e24083%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/238/d168d146ae314ad19780f6e824e24083/images/large/1.jpg saved to cache
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6dbfd919-65a2-5f6f-838f-ed5312f2e248
2026-01-27 20:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6dbfd919-65a2-5f6f-838f-ed5312f2e248, skipping ID generation
2026-01-27 20:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dbfd919-65a2-5f6f-838f-ed5312f2e248 with scrape type 1
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6dbfd919-65a2-5f6f-838f-ed5312f2e248 from tracking dictionaries
2026-01-27 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6dbfd919-65a2-5f6f-838f-ed5312f2e248 sending to next pipeline
2026-01-27 20:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6dbfd919-65a2-5f6f-838f-ed5312f2e248, identifier: 1875309
2026-01-27 20:04:51 [ayvens.es] INFO: Found listing with ID: 1875321
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875321%27 HTTP/1.1" 200 None
2026-01-27 20:04:51 [ayvens.es] INFO: Scrape type for 1875321: 1
2026-01-27 20:04:51 [ayvens.es] INFO: Extracting data for car ID: 1875321
2026-01-27 20:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7781549b-4ef8-5112-be25-6ebef6bfab54 with identifier: 1875321
2026-01-27 20:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7781549b-4ef8-5112-be25-6ebef6bfab54 with scrape type 1
2026-01-27 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7781549b-4ef8-5112-be25-6ebef6bfab54
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F274%252Fb7dd59aee353442e9306d3da6a065d5f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/274/b7dd59aee353442e9306d3da6a065d5f/images/large/1.jpg not downloaded yet
2026-01-27 20:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6dbfd919-65a2-5f6f-838f-ed5312f2e248 with identifier: 1875309
2026-01-27 20:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6dbfd919-65a2-5f6f-838f-ed5312f2e248 with identifier: 1875309
2026-01-27 20:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'mercedes-benz', 'model': 'vito', 'trim': '111 cdi larga', 'title': 'mercedes-benz vito 111 cdi larga', 'price': 0, 'odometer': 272514, 'odometer_reading_unit': 'km', 'registration_date': '2021-01-04', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.6l', 'c_o_2_emission_value': 164, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6dbfd919-65a2-5f6f-838f-ed5312f2e248', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dbfd919-65a2-5f6f-838f-ed5312f2e248/6dbfd919-65a2-5f6f-838f-ed5312f2e248_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d168d146ae314ad19780f6e824e24083/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 502031}], 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'mercedes-benz vito', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 272514}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 164,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '1.6l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '6dbfd919-65a2-5f6f-838f-ed5312f2e248',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz vito',
     'model': 'vito',
     'odometer': 272514,
     'odometer_in_km': 272514,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dbfd919-65a2-5f6f-838f-ed5312f2e248/6dbfd919-65a2-5f6f-838f-ed5312f2e248_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 502031,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d168d146ae314ad19780f6e824e24083/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-01-04',
     'sanitized_make': 'mercedesbenz',
     'seats_number': 2,
     'seller_name': None,
     'title': 'mercedes-benz vito 111 cdi larga',
     'transmission': 'manual',
     'trim': '111 cdi larga',
     'vin': None,
     'year': 2021}
2026-01-27 20:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 6dbfd919-65a2-5f6f-838f-ed5312f2e248 spider: ayvens.es
2026-01-27 20:04:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6dbfd919-65a2-5f6f-838f-ed5312f2e248 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'mercedes-benz', 'model': 'vito', 'trim': '111 cdi larga', 'title': 'mercedes-benz vito 111 cdi larga', 'price': 0, 'odometer': 272514, 'odometer_reading_unit': 'km', 'registration_date': '2021-01-04', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.6l', 'c_o_2_emission_value': 164, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6dbfd919-65a2-5f6f-838f-ed5312f2e248', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dbfd919-65a2-5f6f-838f-ed5312f2e248/6dbfd919-65a2-5f6f-838f-ed5312f2e248_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d168d146ae314ad19780f6e824e24083/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 502031}], 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'mercedes-benz vito', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 272514}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 164,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '1.6l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '6dbfd919-65a2-5f6f-838f-ed5312f2e248',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz vito',
     'model': 'vito',
     'odometer': 272514,
     'odometer_in_km': 272514,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dbfd919-65a2-5f6f-838f-ed5312f2e248/6dbfd919-65a2-5f6f-838f-ed5312f2e248_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 502031,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d168d146ae314ad19780f6e824e24083/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-01-04',
     'sanitized_make': 'mercedesbenz',
     'seats_number': 2,
     'seller_name': None,
     'title': 'mercedes-benz vito 111 cdi larga',
     'transmission': 'manual',
     'trim': '111 cdi larga',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6dbfd919-65a2-5f6f-838f-ed5312f2e248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'VITO',
 'odometer': 272514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dbfd919-65a2-5f6f-838f-ed5312f2e248/6dbfd919-65a2-5f6f-838f-ed5312f2e248_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/d168d146ae314ad19780f6e824e24083/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ VITO 111 CDI Larga',
 'transmission': 'manual',
 'trim': '111 CDI Larga',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875309%27 HTTP/1.1" 200 None
2026-01-27 20:04:51 [ayvens.es] INFO: Saving data for 1875309: {'created_time': 1769544291.313146, 'last_price_update_time': 1769544291.313161, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875309') HTTP/1.1" 204 0
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff573e28290>
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c085f5f8-ba30-5b39-a73b-b776c7d99251/c085f5f8-ba30-5b39-a73b-b776c7d99251_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F099%252F9d31bf7bd40f49dc9878c4d84f421149%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/099/9d31bf7bd40f49dc9878c4d84f421149/images/large/1.jpg saved to cache
2026-01-27 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c085f5f8-ba30-5b39-a73b-b776c7d99251
2026-01-27 20:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c085f5f8-ba30-5b39-a73b-b776c7d99251, skipping ID generation
2026-01-27 20:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c085f5f8-ba30-5b39-a73b-b776c7d99251 with scrape type 1
2026-01-27 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c085f5f8-ba30-5b39-a73b-b776c7d99251 from tracking dictionaries
2026-01-27 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c085f5f8-ba30-5b39-a73b-b776c7d99251 sending to next pipeline
2026-01-27 20:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c085f5f8-ba30-5b39-a73b-b776c7d99251, identifier: 1875310
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f29b50>
2026-01-27 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5b28697-434c-53f9-b9f8-9aad5ebefd20/c5b28697-434c-53f9-b9f8-9aad5ebefd20_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F247%252F6e38e142d3114f5bbcd3917fb86abac7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/247/6e38e142d3114f5bbcd3917fb86abac7/images/large/1.jpg saved to cache
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5b28697-434c-53f9-b9f8-9aad5ebefd20
2026-01-27 20:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5b28697-434c-53f9-b9f8-9aad5ebefd20, skipping ID generation
2026-01-27 20:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b28697-434c-53f9-b9f8-9aad5ebefd20 with scrape type 1
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c5b28697-434c-53f9-b9f8-9aad5ebefd20 from tracking dictionaries
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5b28697-434c-53f9-b9f8-9aad5ebefd20 sending to next pipeline
2026-01-27 20:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c5b28697-434c-53f9-b9f8-9aad5ebefd20, identifier: 1875311
2026-01-27 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572288890>
2026-01-27 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d17e8eeb-ee29-5984-8366-c92ef53f118d/d17e8eeb-ee29-5984-8366-c92ef53f118d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252F8b77b4e97aff483bac1d06bc8ecef480%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/8b77b4e97aff483bac1d06bc8ecef480/images/large/1.jpg saved to cache
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d17e8eeb-ee29-5984-8366-c92ef53f118d
2026-01-27 20:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d17e8eeb-ee29-5984-8366-c92ef53f118d, skipping ID generation
2026-01-27 20:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d17e8eeb-ee29-5984-8366-c92ef53f118d with scrape type 1
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d17e8eeb-ee29-5984-8366-c92ef53f118d from tracking dictionaries
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d17e8eeb-ee29-5984-8366-c92ef53f118d sending to next pipeline
2026-01-27 20:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d17e8eeb-ee29-5984-8366-c92ef53f118d, identifier: 1875312
2026-01-27 20:04:52 [ayvens.es] INFO: Found listing with ID: 1875322
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875322%27 HTTP/1.1" 200 None
2026-01-27 20:04:52 [ayvens.es] INFO: Scrape type for 1875322: 1
2026-01-27 20:04:52 [ayvens.es] INFO: Extracting data for car ID: 1875322
2026-01-27 20:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 636ff52f-8b67-5a48-bc86-d66dd5f9f321 with identifier: 1875322
2026-01-27 20:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636ff52f-8b67-5a48-bc86-d66dd5f9f321 with scrape type 1
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 636ff52f-8b67-5a48-bc86-d66dd5f9f321
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F58f8cad44c584f5a88c37646d25fc4d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/58f8cad44c584f5a88c37646d25fc4d9/images/large/1.jpg not downloaded yet
2026-01-27 20:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c085f5f8-ba30-5b39-a73b-b776c7d99251 with identifier: 1875310
2026-01-27 20:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c085f5f8-ba30-5b39-a73b-b776c7d99251 with identifier: 1875310
2026-01-27 20:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-27 20:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c085f5f8-ba30-5b39-a73b-b776c7d99251 spider: ayvens.es
2026-01-27 20:04:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c085f5f8-ba30-5b39-a73b-b776c7d99251 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c085f5f8-ba30-5b39-a73b-b776c7d99251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 190399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c085f5f8-ba30-5b39-a73b-b776c7d99251/c085f5f8-ba30-5b39-a73b-b776c7d99251_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/099/9d31bf7bd40f49dc9878c4d84f421149/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875310%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [ayvens.es] INFO: Saving data for 1875310: {'created_time': 1769544293.07557, 'last_price_update_time': 1769544293.075584, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875310') HTTP/1.1" 204 0
2026-01-27 20:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c5b28697-434c-53f9-b9f8-9aad5ebefd20 with identifier: 1875311
2026-01-27 20:04:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c5b28697-434c-53f9-b9f8-9aad5ebefd20 with identifier: 1875311
2026-01-27 20:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c5b28697-434c-53f9-b9f8-9aad5ebefd20 spider: ayvens.es
2026-01-27 20:04:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c5b28697-434c-53f9-b9f8-9aad5ebefd20 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c5b28697-434c-53f9-b9f8-9aad5ebefd20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 52276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5b28697-434c-53f9-b9f8-9aad5ebefd20/c5b28697-434c-53f9-b9f8-9aad5ebefd20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/247/6e38e142d3114f5bbcd3917fb86abac7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': '(O) Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875311%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [ayvens.es] INFO: Saving data for 1875311: {'created_time': 1769544293.382813, 'last_price_update_time': 1769544293.382828, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875311') HTTP/1.1" 204 0
2026-01-27 20:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d17e8eeb-ee29-5984-8366-c92ef53f118d with identifier: 1875312
2026-01-27 20:04:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d17e8eeb-ee29-5984-8366-c92ef53f118d with identifier: 1875312
2026-01-27 20:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-27 20:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d17e8eeb-ee29-5984-8366-c92ef53f118d spider: ayvens.es
2026-01-27 20:04:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d17e8eeb-ee29-5984-8366-c92ef53f118d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Blanco jade',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd17e8eeb-ee29-5984-8366-c92ef53f118d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 124439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d17e8eeb-ee29-5984-8366-c92ef53f118d/d17e8eeb-ee29-5984-8366-c92ef53f118d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/716/8b77b4e97aff483bac1d06bc8ecef480/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) M Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) M Std Express',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875312%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [ayvens.es] INFO: Saving data for 1875312: {'created_time': 1769544293.689105, 'last_price_update_time': 1769544293.689117, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875312') HTTP/1.1" 204 0
2026-01-27 20:04:53 [ayvens.es] INFO: Found listing with ID: 1875323
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875323%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [ayvens.es] INFO: Scrape type for 1875323: 1
2026-01-27 20:04:53 [ayvens.es] INFO: Extracting data for car ID: 1875323
2026-01-27 20:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89ba20a9-3ad9-5f33-8a48-5638ec65a136 with identifier: 1875323
2026-01-27 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89ba20a9-3ad9-5f33-8a48-5638ec65a136 with scrape type 1
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89ba20a9-3ad9-5f33-8a48-5638ec65a136
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252Fb19ae1b07eb348b39aaf2376c5cad85d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/b19ae1b07eb348b39aaf2376c5cad85d/images/large/1.jpg not downloaded yet
2026-01-27 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/336/d6e01bb530894030ab9e410b33eb446b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/174/d283d2000b9a4b1181523eb81475c65d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:53 [ayvens.es] INFO: Found listing with ID: 1875324
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875324%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [ayvens.es] INFO: Scrape type for 1875324: 1
2026-01-27 20:04:53 [ayvens.es] INFO: Extracting data for car ID: 1875324
2026-01-27 20:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c50b031-8537-5910-aae2-c5c18909dded with identifier: 1875324
2026-01-27 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c50b031-8537-5910-aae2-c5c18909dded with scrape type 1
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9c50b031-8537-5910-aae2-c5c18909dded
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F209%252F38007d8f4dfd4cd6b018abab3776be95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/209/38007d8f4dfd4cd6b018abab3776be95/images/large/1.jpg not downloaded yet
2026-01-27 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/401/797d92bb258048b381a6bf58ce368c37/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:53 [ayvens.es] INFO: Found listing with ID: 1875325
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875325%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [ayvens.es] INFO: Scrape type for 1875325: 1
2026-01-27 20:04:53 [ayvens.es] INFO: Extracting data for car ID: 1875325
2026-01-27 20:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bfb964-0592-5a3e-b24d-65de09ba30f0 with identifier: 1875325
2026-01-27 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bfb964-0592-5a3e-b24d-65de09ba30f0 with scrape type 1
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e4bfb964-0592-5a3e-b24d-65de09ba30f0
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F210%252Fbbdb94b2c5e743b992dfdc06871738b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/210/bbdb94b2c5e743b992dfdc06871738b7/images/large/1.jpg not downloaded yet
2026-01-27 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/842/bf4c27b645414707937d4fcfba53a1b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/266/9af285cdb0dd43e6beec319c8fead994/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:53 [ayvens.es] INFO: Found listing with ID: 1875326
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875326%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [ayvens.es] INFO: Scrape type for 1875326: 1
2026-01-27 20:04:53 [ayvens.es] INFO: Extracting data for car ID: 1875326
2026-01-27 20:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6949715f-7ccf-5e5f-856b-dccf51677fa7 with identifier: 1875326
2026-01-27 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6949715f-7ccf-5e5f-856b-dccf51677fa7 with scrape type 1
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6949715f-7ccf-5e5f-856b-dccf51677fa7
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F773%252Feaa3582245cf45ba98421cb2083f9c42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/773/eaa3582245cf45ba98421cb2083f9c42/images/large/1.jpg not downloaded yet
2026-01-27 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/524/8814e55502334eb7a2f39b89f51b914a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/023/be9cb85bc8e144c580b26792583c8d2d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:53 [ayvens.es] INFO: Found listing with ID: 1875327
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875327%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [ayvens.es] INFO: Scrape type for 1875327: 1
2026-01-27 20:04:53 [ayvens.es] INFO: Extracting data for car ID: 1875327
2026-01-27 20:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 with identifier: 1875327
2026-01-27 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 with scrape type 1
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1d51a82c-e555-5b49-87f7-7279fa5f9ea4
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F894%252F994bcb0790654c309b3983ad5041a3fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/894/994bcb0790654c309b3983ad5041a3fb/images/large/1.jpg not downloaded yet
2026-01-27 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571eddbd0>
2026-01-27 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6341a0-2345-5ce7-bfee-1042f4f7baf5/3e6341a0-2345-5ce7-bfee-1042f4f7baf5_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252Fd6e01bb530894030ab9e410b33eb446b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/d6e01bb530894030ab9e410b33eb446b/images/large/1.jpg saved to cache
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e6341a0-2345-5ce7-bfee-1042f4f7baf5
2026-01-27 20:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e6341a0-2345-5ce7-bfee-1042f4f7baf5, skipping ID generation
2026-01-27 20:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 with scrape type 1
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 from tracking dictionaries
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 sending to next pipeline
2026-01-27 20:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e6341a0-2345-5ce7-bfee-1042f4f7baf5, identifier: 1875315
2026-01-27 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571ede3d0>
2026-01-27 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9179002b-4ef2-502f-b698-cf39d2fcb2ff/9179002b-4ef2-502f-b698-cf39d2fcb2ff_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F174%252Fd283d2000b9a4b1181523eb81475c65d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/174/d283d2000b9a4b1181523eb81475c65d/images/large/1.jpg saved to cache
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9179002b-4ef2-502f-b698-cf39d2fcb2ff
2026-01-27 20:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9179002b-4ef2-502f-b698-cf39d2fcb2ff, skipping ID generation
2026-01-27 20:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9179002b-4ef2-502f-b698-cf39d2fcb2ff with scrape type 1
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9179002b-4ef2-502f-b698-cf39d2fcb2ff from tracking dictionaries
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9179002b-4ef2-502f-b698-cf39d2fcb2ff sending to next pipeline
2026-01-27 20:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9179002b-4ef2-502f-b698-cf39d2fcb2ff, identifier: 1875318
2026-01-27 20:04:54 [ayvens.es] INFO: Found listing with ID: 1875328
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875328%27 HTTP/1.1" 200 None
2026-01-27 20:04:54 [ayvens.es] INFO: Scrape type for 1875328: 1
2026-01-27 20:04:54 [ayvens.es] INFO: Extracting data for car ID: 1875328
2026-01-27 20:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 220674cc-6521-5981-9719-3ab8cd0a3b51 with identifier: 1875328
2026-01-27 20:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 220674cc-6521-5981-9719-3ab8cd0a3b51 with scrape type 1
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 220674cc-6521-5981-9719-3ab8cd0a3b51
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F132%252F0198b8f2e6ac4c538f0f5b0525c837e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/132/0198b8f2e6ac4c538f0f5b0525c837e7/images/large/1.jpg not downloaded yet
2026-01-27 20:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 with identifier: 1875315
2026-01-27 20:04:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 with identifier: 1875315
2026-01-27 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'banquise blanco s', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'jumpy', 'trim': 'talla xl bluehdi 120 s&s 6v control', 'title': 'citroën jumpy talla xl bluehdi 120 s&s 6v control', 'price': 0, 'odometer': 290163, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-11', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 190, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '3e6341a0-2345-5ce7-bfee-1042f4f7baf5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6341a0-2345-5ce7-bfee-1042f4f7baf5/3e6341a0-2345-5ce7-bfee-1042f4f7baf5_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/d6e01bb530894030ab9e410b33eb446b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 471196}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'citroën jumpy', 'sanitized_make': 'citron', 'odometer_in_km': 290163}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 190,
     'color': 'banquise blanco s',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '2.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '3e6341a0-2345-5ce7-bfee-1042f4f7baf5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën jumpy',
     'model': 'jumpy',
     'odometer': 290163,
     'odometer_in_km': 290163,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6341a0-2345-5ce7-bfee-1042f4f7baf5/3e6341a0-2345-5ce7-bfee-1042f4f7baf5_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 471196,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/d6e01bb530894030ab9e410b33eb446b/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-11',
     'sanitized_make': 'citron',
     'seats_number': 2,
     'seller_name': None,
     'title': 'citroën jumpy talla xl bluehdi 120 s&s 6v control',
     'transmission': 'manual',
     'trim': 'talla xl bluehdi 120 s&s 6v control',
     'vin': None,
     'year': 2021}
2026-01-27 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 spider: ayvens.es
2026-01-27 20:04:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 3e6341a0-2345-5ce7-bfee-1042f4f7baf5 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'banquise blanco s', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'jumpy', 'trim': 'talla xl bluehdi 120 s&s 6v control', 'title': 'citroën jumpy talla xl bluehdi 120 s&s 6v control', 'price': 0, 'odometer': 290163, 'odometer_reading_unit': 'km', 'registration_date': '2021-10-11', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 190, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '3e6341a0-2345-5ce7-bfee-1042f4f7baf5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6341a0-2345-5ce7-bfee-1042f4f7baf5/3e6341a0-2345-5ce7-bfee-1042f4f7baf5_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/d6e01bb530894030ab9e410b33eb446b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 471196}], 'current_year_diff': 5, 'age_in_months': 51, 'make_model': 'citroën jumpy', 'sanitized_make': 'citron', 'odometer_in_km': 290163}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 51,
     'auction_title': '',
     'c_o_2_emission_value': 190,
     'color': 'banquise blanco s',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '2.0l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '3e6341a0-2345-5ce7-bfee-1042f4f7baf5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'citroën',
     'make_model': 'citroën jumpy',
     'model': 'jumpy',
     'odometer': 290163,
     'odometer_in_km': 290163,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6341a0-2345-5ce7-bfee-1042f4f7baf5/3e6341a0-2345-5ce7-bfee-1042f4f7baf5_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 471196,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/d6e01bb530894030ab9e410b33eb446b/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-11',
     'sanitized_make': 'citron',
     'seats_number': 2,
     'seller_name': None,
     'title': 'citroën jumpy talla xl bluehdi 120 s&s 6v control',
     'transmission': 'manual',
     'trim': 'talla xl bluehdi 120 s&s 6v control',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Banquise blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e6341a0-2345-5ce7-bfee-1042f4f7baf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 290163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6341a0-2345-5ce7-bfee-1042f4f7baf5/3e6341a0-2345-5ce7-bfee-1042f4f7baf5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/d6e01bb530894030ab9e410b33eb446b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla XL BlueHDi 120 S&S 6v Control',
 'transmission': 'manual',
 'trim': 'Talla XL BlueHDi 120 S&S 6v Control',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875315%27 HTTP/1.1" 200 None
2026-01-27 20:04:55 [ayvens.es] INFO: Saving data for 1875315: {'created_time': 1769544295.089119, 'last_price_update_time': 1769544295.089133, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875315') HTTP/1.1" 204 0
2026-01-27 20:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9179002b-4ef2-502f-b698-cf39d2fcb2ff with identifier: 1875318
2026-01-27 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9179002b-4ef2-502f-b698-cf39d2fcb2ff with identifier: 1875318
2026-01-27 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo cargo' containing 'doblo'
2026-01-27 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9179002b-4ef2-502f-b698-cf39d2fcb2ff spider: ayvens.es
2026-01-27 20:04:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 9179002b-4ef2-502f-b698-cf39d2fcb2ff due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo cargo' containing 'doblo'
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9179002b-4ef2-502f-b698-cf39d2fcb2ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 130776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9179002b-4ef2-502f-b698-cf39d2fcb2ff/9179002b-4ef2-502f-b698-cf39d2fcb2ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/174/d283d2000b9a4b1181523eb81475c65d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo Base 1.3 Multijet 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Multijet 70kW (95CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875318%27 HTTP/1.1" 200 None
2026-01-27 20:04:55 [ayvens.es] INFO: Saving data for 1875318: {'created_time': 1769544295.377754, 'last_price_update_time': 1769544295.377766, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875318') HTTP/1.1" 204 0
2026-01-27 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721a5590>
2026-01-27 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66796ae-0734-5275-829a-44714dea9f6e/f66796ae-0734-5275-829a-44714dea9f6e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F401%252F797d92bb258048b381a6bf58ce368c37%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/401/797d92bb258048b381a6bf58ce368c37/images/large/1.jpg saved to cache
2026-01-27 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f66796ae-0734-5275-829a-44714dea9f6e
2026-01-27 20:04:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f66796ae-0734-5275-829a-44714dea9f6e, skipping ID generation
2026-01-27 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66796ae-0734-5275-829a-44714dea9f6e with scrape type 1
2026-01-27 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f66796ae-0734-5275-829a-44714dea9f6e from tracking dictionaries
2026-01-27 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f66796ae-0734-5275-829a-44714dea9f6e sending to next pipeline
2026-01-27 20:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f66796ae-0734-5275-829a-44714dea9f6e, identifier: 1875316
2026-01-27 20:04:55 [ayvens.es] INFO: Found listing with ID: 1875329
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875329%27 HTTP/1.1" 200 None
2026-01-27 20:04:55 [ayvens.es] INFO: Scrape type for 1875329: 1
2026-01-27 20:04:55 [ayvens.es] INFO: Extracting data for car ID: 1875329
2026-01-27 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 543b7f1f-4770-5460-be59-81069ee22084 with identifier: 1875329
2026-01-27 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 543b7f1f-4770-5460-be59-81069ee22084 with scrape type 1
2026-01-27 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 543b7f1f-4770-5460-be59-81069ee22084
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F623%252Fc218a2d0255040c0a4da2631e520d862%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/623/c218a2d0255040c0a4da2631e520d862/images/large/1.jpg not downloaded yet
2026-01-27 20:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f66796ae-0734-5275-829a-44714dea9f6e with identifier: 1875316
2026-01-27 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f66796ae-0734-5275-829a-44714dea9f6e with identifier: 1875316
2026-01-27 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-27 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f66796ae-0734-5275-829a-44714dea9f6e spider: ayvens.es
2026-01-27 20:04:56 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: f66796ae-0734-5275-829a-44714dea9f6e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f66796ae-0734-5275-829a-44714dea9f6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 188904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66796ae-0734-5275-829a-44714dea9f6e/f66796ae-0734-5275-829a-44714dea9f6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/401/797d92bb258048b381a6bf58ce368c37/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 340 L2 MHEV Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 340 L2 MHEV Trend',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875316%27 HTTP/1.1" 200 None
2026-01-27 20:04:56 [ayvens.es] INFO: Saving data for 1875316: {'created_time': 1769544296.100751, 'last_price_update_time': 1769544296.100761, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875316') HTTP/1.1" 204 0
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5727f25d0>
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99790074-2af3-5e49-9986-8364ba9c9568/99790074-2af3-5e49-9986-8364ba9c9568_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F842%252Fbf4c27b645414707937d4fcfba53a1b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/842/bf4c27b645414707937d4fcfba53a1b3/images/large/1.jpg saved to cache
2026-01-27 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99790074-2af3-5e49-9986-8364ba9c9568
2026-01-27 20:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99790074-2af3-5e49-9986-8364ba9c9568, skipping ID generation
2026-01-27 20:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99790074-2af3-5e49-9986-8364ba9c9568 with scrape type 1
2026-01-27 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 99790074-2af3-5e49-9986-8364ba9c9568 from tracking dictionaries
2026-01-27 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99790074-2af3-5e49-9986-8364ba9c9568 sending to next pipeline
2026-01-27 20:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99790074-2af3-5e49-9986-8364ba9c9568, identifier: 1875313
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57244a210>
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08f992d2-0120-5661-b297-da6f5918cbbc/08f992d2-0120-5661-b297-da6f5918cbbc_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F266%252F9af285cdb0dd43e6beec319c8fead994%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/266/9af285cdb0dd43e6beec319c8fead994/images/large/1.jpg saved to cache
2026-01-27 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08f992d2-0120-5661-b297-da6f5918cbbc
2026-01-27 20:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08f992d2-0120-5661-b297-da6f5918cbbc, skipping ID generation
2026-01-27 20:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f992d2-0120-5661-b297-da6f5918cbbc with scrape type 1
2026-01-27 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08f992d2-0120-5661-b297-da6f5918cbbc from tracking dictionaries
2026-01-27 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08f992d2-0120-5661-b297-da6f5918cbbc sending to next pipeline
2026-01-27 20:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 08f992d2-0120-5661-b297-da6f5918cbbc, identifier: 1875319
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57231c750>
2026-01-27 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f0e5464-38eb-52b6-8311-30db8462ec6b/4f0e5464-38eb-52b6-8311-30db8462ec6b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F524%252F8814e55502334eb7a2f39b89f51b914a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/524/8814e55502334eb7a2f39b89f51b914a/images/large/1.jpg saved to cache
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f0e5464-38eb-52b6-8311-30db8462ec6b
2026-01-27 20:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f0e5464-38eb-52b6-8311-30db8462ec6b, skipping ID generation
2026-01-27 20:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0e5464-38eb-52b6-8311-30db8462ec6b with scrape type 1
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4f0e5464-38eb-52b6-8311-30db8462ec6b from tracking dictionaries
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f0e5464-38eb-52b6-8311-30db8462ec6b sending to next pipeline
2026-01-27 20:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4f0e5464-38eb-52b6-8311-30db8462ec6b, identifier: 1875314
2026-01-27 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571edead0>
2026-01-27 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb/87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F023%252Fbe9cb85bc8e144c580b26792583c8d2d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/023/be9cb85bc8e144c580b26792583c8d2d/images/large/1.jpg saved to cache
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb
2026-01-27 20:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb, skipping ID generation
2026-01-27 20:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb with scrape type 1
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb from tracking dictionaries
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb sending to next pipeline
2026-01-27 20:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb, identifier: 1875317
2026-01-27 20:04:57 [ayvens.es] INFO: Found listing with ID: 1875330
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875330%27 HTTP/1.1" 200 None
2026-01-27 20:04:57 [ayvens.es] INFO: Scrape type for 1875330: 1
2026-01-27 20:04:57 [ayvens.es] INFO: Extracting data for car ID: 1875330
2026-01-27 20:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ea8070-7436-5691-87a3-f8aa4ecefd72 with identifier: 1875330
2026-01-27 20:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ea8070-7436-5691-87a3-f8aa4ecefd72 with scrape type 1
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81ea8070-7436-5691-87a3-f8aa4ecefd72
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F787%252Fbdbefa43f9cf4575aa17b93225d13bb4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/787/bdbefa43f9cf4575aa17b93225d13bb4/images/large/1.jpg not downloaded yet
2026-01-27 20:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99790074-2af3-5e49-9986-8364ba9c9568 with identifier: 1875313
2026-01-27 20:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99790074-2af3-5e49-9986-8364ba9c9568 with identifier: 1875313
2026-01-27 20:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-27 20:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 99790074-2af3-5e49-9986-8364ba9c9568 spider: ayvens.es
2026-01-27 20:04:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 99790074-2af3-5e49-9986-8364ba9c9568 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '99790074-2af3-5e49-9986-8364ba9c9568',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 39124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99790074-2af3-5e49-9986-8364ba9c9568/99790074-2af3-5e49-9986-8364ba9c9568_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/842/bf4c27b645414707937d4fcfba53a1b3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875313%27 HTTP/1.1" 200 None
2026-01-27 20:04:58 [ayvens.es] INFO: Saving data for 1875313: {'created_time': 1769544298.01669, 'last_price_update_time': 1769544298.0167, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875313') HTTP/1.1" 204 0
2026-01-27 20:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 08f992d2-0120-5661-b297-da6f5918cbbc with identifier: 1875319
2026-01-27 20:04:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 08f992d2-0120-5661-b297-da6f5918cbbc with identifier: 1875319
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 08f992d2-0120-5661-b297-da6f5918cbbc spider: ayvens.es
2026-01-27 20:04:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 08f992d2-0120-5661-b297-da6f5918cbbc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco baq',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '08f992d2-0120-5661-b297-da6f5918cbbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 105597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08f992d2-0120-5661-b297-da6f5918cbbc/08f992d2-0120-5661-b297-da6f5918cbbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/266/9af285cdb0dd43e6beec319c8fead994/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Multispace LIVE Edit.BlueHDi 74KW (100CV',
 'transmission': 'manual',
 'trim': 'Multispace LIVE Edit.BlueHDi 74KW (100CV',
 'vin': None,
 'year': 2018}
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875319%27 HTTP/1.1" 200 None
2026-01-27 20:04:58 [ayvens.es] INFO: Saving data for 1875319: {'created_time': 1769544298.376308, 'last_price_update_time': 1769544298.376321, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875319') HTTP/1.1" 204 0
2026-01-27 20:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4f0e5464-38eb-52b6-8311-30db8462ec6b with identifier: 1875314
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4f0e5464-38eb-52b6-8311-30db8462ec6b with identifier: 1875314
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo cargo' containing 'doblo'
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4f0e5464-38eb-52b6-8311-30db8462ec6b spider: ayvens.es
2026-01-27 20:04:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 4f0e5464-38eb-52b6-8311-30db8462ec6b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo cargo' containing 'doblo'
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4f0e5464-38eb-52b6-8311-30db8462ec6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 190776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f0e5464-38eb-52b6-8311-30db8462ec6b/4f0e5464-38eb-52b6-8311-30db8462ec6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/524/8814e55502334eb7a2f39b89f51b914a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2022}
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875314%27 HTTP/1.1" 200 None
2026-01-27 20:04:58 [ayvens.es] INFO: Saving data for 1875314: {'created_time': 1769544298.61567, 'last_price_update_time': 1769544298.615679, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875314') HTTP/1.1" 204 0
2026-01-27 20:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb with identifier: 1875317
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb with identifier: 1875317
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-27 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb spider: ayvens.es
2026-01-27 20:04:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 139727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb/87f5b9e9-0ba3-5b72-a4ac-f9fdfef3a8cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/023/be9cb85bc8e144c580b26792583c8d2d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875317%27 HTTP/1.1" 200 None
2026-01-27 20:04:58 [ayvens.es] INFO: Saving data for 1875317: {'created_time': 1769544298.950215, 'last_price_update_time': 1769544298.950224, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875317') HTTP/1.1" 204 0
2026-01-27 20:04:58 [ayvens.es] INFO: Found listing with ID: 1875331
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875331%27 HTTP/1.1" 200 None
2026-01-27 20:04:58 [ayvens.es] INFO: Scrape type for 1875331: 1
2026-01-27 20:04:58 [ayvens.es] INFO: Extracting data for car ID: 1875331
2026-01-27 20:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7551364-e0ce-50d0-ac2f-7db4a7fab027 with identifier: 1875331
2026-01-27 20:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7551364-e0ce-50d0-ac2f-7db4a7fab027 with scrape type 1
2026-01-27 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f7551364-e0ce-50d0-ac2f-7db4a7fab027
2026-01-27 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F862%252Fd0c6f265ec444a5797ff142f5cfc6c78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/862/d0c6f265ec444a5797ff142f5cfc6c78/images/large/1.jpg not downloaded yet
2026-01-27 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/784/4bb4745ec04b4eb4af33f223cc2dbebc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:04:59 [ayvens.es] INFO: Found listing with ID: 1875332
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875332%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [ayvens.es] INFO: Scrape type for 1875332: 1
2026-01-27 20:04:59 [ayvens.es] INFO: Extracting data for car ID: 1875332
2026-01-27 20:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b866d2-8c92-50ec-9cf7-9f9985742863 with identifier: 1875332
2026-01-27 20:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b866d2-8c92-50ec-9cf7-9f9985742863 with scrape type 1
2026-01-27 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26b866d2-8c92-50ec-9cf7-9f9985742863
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F632%252Fe890d509eb194b27bd572fcd1257e9ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/632/e890d509eb194b27bd572fcd1257e9ba/images/large/1.jpg not downloaded yet
2026-01-27 20:04:59 [ayvens.es] INFO: Found listing with ID: 1875333
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875333%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [ayvens.es] INFO: Scrape type for 1875333: 1
2026-01-27 20:04:59 [ayvens.es] INFO: Extracting data for car ID: 1875333
2026-01-27 20:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fea0641c-688c-5c69-a758-44c6790d5ade with identifier: 1875333
2026-01-27 20:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fea0641c-688c-5c69-a758-44c6790d5ade with scrape type 1
2026-01-27 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fea0641c-688c-5c69-a758-44c6790d5ade
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F1527cece37104361bcc34d5e08efe61a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/1527cece37104361bcc34d5e08efe61a/images/large/1.jpg not downloaded yet
2026-01-27 20:04:59 [ayvens.es] INFO: Found listing with ID: 1875334
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875334%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [ayvens.es] INFO: Scrape type for 1875334: 1
2026-01-27 20:04:59 [ayvens.es] INFO: Extracting data for car ID: 1875334
2026-01-27 20:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3839f2a4-15ed-5665-9df8-db508babcdae with identifier: 1875334
2026-01-27 20:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3839f2a4-15ed-5665-9df8-db508babcdae with scrape type 1
2026-01-27 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3839f2a4-15ed-5665-9df8-db508babcdae
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F934%252Fbef723812bc541219da1e5fb7fd63784%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/934/bef723812bc541219da1e5fb7fd63784/images/large/1.jpg not downloaded yet
2026-01-27 20:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 636ff52f-8b67-5a48-bc86-d66dd5f9f321 with identifier: 1875322
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 636ff52f-8b67-5a48-bc86-d66dd5f9f321 with identifier: 1875322
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 636ff52f-8b67-5a48-bc86-d66dd5f9f321 spider: ayvens.es
2026-01-27 20:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 636ff52f-8b67-5a48-bc86-d66dd5f9f321 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '636ff52f-8b67-5a48-bc86-d66dd5f9f321',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 188935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/897/58f8cad44c584f5a88c37646d25fc4d9/images/large/1.jpg'],
 'photos': [],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875322%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [ayvens.es] INFO: Saving data for 1875322: {'created_time': 1769544299.393182, 'last_price_update_time': 1769544299.393195, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875322') HTTP/1.1" 204 0
2026-01-27 20:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7781549b-4ef8-5112-be25-6ebef6bfab54 with identifier: 1875321
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7781549b-4ef8-5112-be25-6ebef6bfab54 with identifier: 1875321
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo cargo' containing 'doblo'
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7781549b-4ef8-5112-be25-6ebef6bfab54 spider: ayvens.es
2026-01-27 20:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7781549b-4ef8-5112-be25-6ebef6bfab54 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo cargo' containing 'doblo'
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7781549b-4ef8-5112-be25-6ebef6bfab54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 96250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/274/b7dd59aee353442e9306d3da6a065d5f/images/large/1.jpg'],
 'photos': [],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo Base 1.3 Multijet 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Multijet 70kW (95CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875321%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [ayvens.es] INFO: Saving data for 1875321: {'created_time': 1769544299.739842, 'last_price_update_time': 1769544299.739852, 'auction_closing_time': 1769601600.0}
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875321') HTTP/1.1" 204 0
2026-01-27 20:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89ba20a9-3ad9-5f33-8a48-5638ec65a136 with identifier: 1875323
2026-01-27 20:04:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89ba20a9-3ad9-5f33-8a48-5638ec65a136 with identifier: 1875323
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumper' containing 'jumper'
2026-01-27 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 89ba20a9-3ad9-5f33-8a48-5638ec65a136 spider: ayvens.es
2026-01-27 20:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 89ba20a9-3ad9-5f33-8a48-5638ec65a136 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumper' containing 'jumper'
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'color': 'Banquies blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89ba20a9-3ad9-5f33-8a48-5638ec65a136',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPER',
 'odometer': 187950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/406/b19ae1b07eb348b39aaf2376c5cad85d/images/large/1.jpg'],
 'photos': [],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPER BlueHDi 103KW (140CV) Furgon 35L3H2',
 'transmission': 'manual',
 'trim': 'BlueHDi 103KW (140CV) Furgon 35L3H2',
 'vin': None,
 'year': 2021}
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875323%27 HTTP/1.1" 200 None
2026-01-27 20:04:59 [ayvens.es] INFO: Saving data for 1875323: {'created_time': 1769544299.996748, 'last_price_update_time': 1769544299.99676, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875323') HTTP/1.1" 204 0
2026-01-27 20:05:00 [ayvens.es] INFO: Found listing with ID: 1875335
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875335%27 HTTP/1.1" 200 None
2026-01-27 20:05:00 [ayvens.es] INFO: Scrape type for 1875335: 1
2026-01-27 20:05:00 [ayvens.es] INFO: Extracting data for car ID: 1875335
2026-01-27 20:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14c3f3f6-a7b7-5235-b0f6-f3894d813350 with identifier: 1875335
2026-01-27 20:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14c3f3f6-a7b7-5235-b0f6-f3894d813350 with scrape type 1
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 14c3f3f6-a7b7-5235-b0f6-f3894d813350
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252Fddce860a7cf848dfa6c6e8ad1364e02c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/ddce860a7cf848dfa6c6e8ad1364e02c/images/large/1.jpg not downloaded yet
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 636ff52f-8b67-5a48-bc86-d66dd5f9f321 due to [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>]
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 7781549b-4ef8-5112-be25-6ebef6bfab54 due to [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>]
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 89ba20a9-3ad9-5f33-8a48-5638ec65a136 due to [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>]
2026-01-27 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57229ba50>
2026-01-27 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d537ff-b4d0-5bb4-9f02-09aedfdd6065/c3d537ff-b4d0-5bb4-9f02-09aedfdd6065_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F784%252F4bb4745ec04b4eb4af33f223cc2dbebc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/784/4bb4745ec04b4eb4af33f223cc2dbebc/images/large/1.jpg saved to cache
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3d537ff-b4d0-5bb4-9f02-09aedfdd6065
2026-01-27 20:05:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3d537ff-b4d0-5bb4-9f02-09aedfdd6065, skipping ID generation
2026-01-27 20:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 with scrape type 1
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 from tracking dictionaries
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 sending to next pipeline
2026-01-27 20:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3d537ff-b4d0-5bb4-9f02-09aedfdd6065, identifier: 1875320
2026-01-27 20:05:00 [ayvens.es] INFO: Found listing with ID: 1875336
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875336%27 HTTP/1.1" 200 None
2026-01-27 20:05:00 [ayvens.es] INFO: Scrape type for 1875336: 1
2026-01-27 20:05:00 [ayvens.es] INFO: Extracting data for car ID: 1875336
2026-01-27 20:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff2fc9b9-5ca0-5886-b0f4-5785520d027a with identifier: 1875336
2026-01-27 20:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2fc9b9-5ca0-5886-b0f4-5785520d027a with scrape type 1
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff2fc9b9-5ca0-5886-b0f4-5785520d027a
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F509%252Ff66031e9c8ca4ae49a8d03d2c84d10d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/509/f66031e9c8ca4ae49a8d03d2c84d10d1/images/large/1.jpg not downloaded yet
2026-01-27 20:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 with identifier: 1875320
2026-01-27 20:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 with identifier: 1875320
2026-01-27 20:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-27 20:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 spider: ayvens.es
2026-01-27 20:05:00 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: c3d537ff-b4d0-5bb4-9f02-09aedfdd6065 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c3d537ff-b4d0-5bb4-9f02-09aedfdd6065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 108358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d537ff-b4d0-5bb4-9f02-09aedfdd6065/c3d537ff-b4d0-5bb4-9f02-09aedfdd6065_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/784/4bb4745ec04b4eb4af33f223cc2dbebc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Kombi 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Kombi 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875320%27 HTTP/1.1" 200 None
2026-01-27 20:05:00 [ayvens.es] INFO: Saving data for 1875320: {'created_time': 1769544300.951914, 'last_price_update_time': 1769544300.951928, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875320') HTTP/1.1" 204 0
2026-01-27 20:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9c50b031-8537-5910-aae2-c5c18909dded with identifier: 1875324
2026-01-27 20:05:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9c50b031-8537-5910-aae2-c5c18909dded with identifier: 1875324
2026-01-27 20:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-27 20:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9c50b031-8537-5910-aae2-c5c18909dded spider: ayvens.es
2026-01-27 20:05:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 9c50b031-8537-5910-aae2-c5c18909dded due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Race rojo s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9c50b031-8537-5910-aae2-c5c18909dded',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 51734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/209/38007d8f4dfd4cd6b018abab3776be95/images/large/1.jpg'],
 'photos': [],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875324%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [ayvens.es] INFO: Saving data for 1875324: {'created_time': 1769544301.265637, 'last_price_update_time': 1769544301.265653, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875324') HTTP/1.1" 204 0
2026-01-27 20:05:01 [ayvens.es] INFO: Found listing with ID: 1875337
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875337%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [ayvens.es] INFO: Scrape type for 1875337: 1
2026-01-27 20:05:01 [ayvens.es] INFO: Extracting data for car ID: 1875337
2026-01-27 20:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fcdecb3-e834-5056-a442-dffc3db68edf with identifier: 1875337
2026-01-27 20:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fcdecb3-e834-5056-a442-dffc3db68edf with scrape type 1
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6fcdecb3-e834-5056-a442-dffc3db68edf
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F494%252F21fda362aae44c7a82476de5c01725d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/494/21fda362aae44c7a82476de5c01725d9/images/large/1.jpg not downloaded yet
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 9c50b031-8537-5910-aae2-c5c18909dded due to [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>]
2026-01-27 20:05:01 [ayvens.es] INFO: Found listing with ID: 1875338
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875338%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [ayvens.es] INFO: Scrape type for 1875338: 1
2026-01-27 20:05:01 [ayvens.es] INFO: Extracting data for car ID: 1875338
2026-01-27 20:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8099986-4b48-56ab-95df-eaae4b2d8e42 with identifier: 1875338
2026-01-27 20:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8099986-4b48-56ab-95df-eaae4b2d8e42 with scrape type 1
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e8099986-4b48-56ab-95df-eaae4b2d8e42
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F361%252F39f58abb7da646fabadea841fef961c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/361/39f58abb7da646fabadea841fef961c5/images/large/1.jpg not downloaded yet
2026-01-27 20:05:01 [ayvens.es] INFO: Found listing with ID: 1875339
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875339%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [ayvens.es] INFO: Scrape type for 1875339: 1
2026-01-27 20:05:01 [ayvens.es] INFO: Extracting data for car ID: 1875339
2026-01-27 20:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9536cc23-fb5d-5368-bde2-0d445ddd1806 with identifier: 1875339
2026-01-27 20:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9536cc23-fb5d-5368-bde2-0d445ddd1806 with scrape type 1
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9536cc23-fb5d-5368-bde2-0d445ddd1806
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252Fdf30d3117b9a4552bd9eb3b57fb6d6a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/df30d3117b9a4552bd9eb3b57fb6d6a2/images/large/1.jpg not downloaded yet
2026-01-27 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/210/bbdb94b2c5e743b992dfdc06871738b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:01 [ayvens.es] INFO: Found listing with ID: 1875340
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875340%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [ayvens.es] INFO: Scrape type for 1875340: 1
2026-01-27 20:05:01 [ayvens.es] INFO: Extracting data for car ID: 1875340
2026-01-27 20:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1045c63-a39c-5e1b-b379-82130fe3a78b with identifier: 1875340
2026-01-27 20:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1045c63-a39c-5e1b-b379-82130fe3a78b with scrape type 1
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1045c63-a39c-5e1b-b379-82130fe3a78b
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F153%252F3565d55dce564b39902f2fac0b71bde6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/153/3565d55dce564b39902f2fac0b71bde6/images/large/1.jpg not downloaded yet
2026-01-27 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/894/994bcb0790654c309b3983ad5041a3fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:01 [ayvens.es] INFO: Found listing with ID: 1875341
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875341%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [ayvens.es] INFO: Scrape type for 1875341: 1
2026-01-27 20:05:01 [ayvens.es] INFO: Extracting data for car ID: 1875341
2026-01-27 20:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9397ddd4-7f43-5960-8228-c3fadb7f141f with identifier: 1875341
2026-01-27 20:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9397ddd4-7f43-5960-8228-c3fadb7f141f with scrape type 1
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9397ddd4-7f43-5960-8228-c3fadb7f141f
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Fa30fa0160878436db934cdfe86e9d210%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/a30fa0160878436db934cdfe86e9d210/images/large/1.jpg not downloaded yet
2026-01-27 20:05:01 [ayvens.es] INFO: Found listing with ID: 1875342
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875342%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [ayvens.es] INFO: Scrape type for 1875342: 1
2026-01-27 20:05:01 [ayvens.es] INFO: Extracting data for car ID: 1875342
2026-01-27 20:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 630ced5c-6728-5db0-b527-93ead5b668c2 with identifier: 1875342
2026-01-27 20:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 630ced5c-6728-5db0-b527-93ead5b668c2 with scrape type 1
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 630ced5c-6728-5db0-b527-93ead5b668c2
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F440%252Fac28d0e5d83e4bb7b0b877696c32b7b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/440/ac28d0e5d83e4bb7b0b877696c32b7b6/images/large/1.jpg not downloaded yet
2026-01-27 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57092d950>
2026-01-27 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bfb964-0592-5a3e-b24d-65de09ba30f0/e4bfb964-0592-5a3e-b24d-65de09ba30f0_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F210%252Fbbdb94b2c5e743b992dfdc06871738b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/210/bbdb94b2c5e743b992dfdc06871738b7/images/large/1.jpg saved to cache
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4bfb964-0592-5a3e-b24d-65de09ba30f0
2026-01-27 20:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4bfb964-0592-5a3e-b24d-65de09ba30f0, skipping ID generation
2026-01-27 20:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bfb964-0592-5a3e-b24d-65de09ba30f0 with scrape type 1
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e4bfb964-0592-5a3e-b24d-65de09ba30f0 from tracking dictionaries
2026-01-27 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4bfb964-0592-5a3e-b24d-65de09ba30f0 sending to next pipeline
2026-01-27 20:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e4bfb964-0592-5a3e-b24d-65de09ba30f0, identifier: 1875325
2026-01-27 20:05:02 [ayvens.es] INFO: Found listing with ID: 1875343
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875343%27 HTTP/1.1" 200 None
2026-01-27 20:05:02 [ayvens.es] INFO: Scrape type for 1875343: 1
2026-01-27 20:05:02 [ayvens.es] INFO: Extracting data for car ID: 1875343
2026-01-27 20:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 with identifier: 1875343
2026-01-27 20:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 with scrape type 1
2026-01-27 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 59a8c0bb-14be-5daf-97f1-0fc90011b3c7
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F447%252F39df28a1bae044beaac524e795508345%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/447/39df28a1bae044beaac524e795508345/images/large/1.jpg not downloaded yet
2026-01-27 20:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e4bfb964-0592-5a3e-b24d-65de09ba30f0 with identifier: 1875325
2026-01-27 20:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e4bfb964-0592-5a3e-b24d-65de09ba30f0 with identifier: 1875325
2026-01-27 20:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-27 20:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e4bfb964-0592-5a3e-b24d-65de09ba30f0 spider: ayvens.es
2026-01-27 20:05:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e4bfb964-0592-5a3e-b24d-65de09ba30f0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Race rojo s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e4bfb964-0592-5a3e-b24d-65de09ba30f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 48943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bfb964-0592-5a3e-b24d-65de09ba30f0/e4bfb964-0592-5a3e-b24d-65de09ba30f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/210/bbdb94b2c5e743b992dfdc06871738b7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875325%27 HTTP/1.1" 200 None
2026-01-27 20:05:02 [ayvens.es] INFO: Saving data for 1875325: {'created_time': 1769544302.357078, 'last_price_update_time': 1769544302.357093, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875325') HTTP/1.1" 204 0
2026-01-27 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57092f6d0>
2026-01-27 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d51a82c-e555-5b49-87f7-7279fa5f9ea4/1d51a82c-e555-5b49-87f7-7279fa5f9ea4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F894%252F994bcb0790654c309b3983ad5041a3fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/894/994bcb0790654c309b3983ad5041a3fb/images/large/1.jpg saved to cache
2026-01-27 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d51a82c-e555-5b49-87f7-7279fa5f9ea4
2026-01-27 20:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d51a82c-e555-5b49-87f7-7279fa5f9ea4, skipping ID generation
2026-01-27 20:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 with scrape type 1
2026-01-27 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 from tracking dictionaries
2026-01-27 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 sending to next pipeline
2026-01-27 20:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1d51a82c-e555-5b49-87f7-7279fa5f9ea4, identifier: 1875327
2026-01-27 20:05:02 [ayvens.es] INFO: Found listing with ID: 1875344
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875344%27 HTTP/1.1" 200 None
2026-01-27 20:05:02 [ayvens.es] INFO: Scrape type for 1875344: 1
2026-01-27 20:05:02 [ayvens.es] INFO: Extracting data for car ID: 1875344
2026-01-27 20:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c626bc2-5126-5440-8c3d-1d483e83da0e with identifier: 1875344
2026-01-27 20:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c626bc2-5126-5440-8c3d-1d483e83da0e with scrape type 1
2026-01-27 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c626bc2-5126-5440-8c3d-1d483e83da0e
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F43466b51b27f4f63b19aa74601a788e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/43466b51b27f4f63b19aa74601a788e6/images/large/1.jpg not downloaded yet
2026-01-27 20:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 with identifier: 1875327
2026-01-27 20:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 with identifier: 1875327
2026-01-27 20:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'kangoo', 'trim': 'profesional n1 energy dci 55kw (75cv)', 'title': 'renault kangoo profesional n1 energy dci 55kw (75cv)', 'price': 0, 'odometer': 225112, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-25', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 123, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '1d51a82c-e555-5b49-87f7-7279fa5f9ea4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d51a82c-e555-5b49-87f7-7279fa5f9ea4/1d51a82c-e555-5b49-87f7-7279fa5f9ea4_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/894/994bcb0790654c309b3983ad5041a3fb/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 429702}], 'current_year_diff': 7, 'age_in_months': 76, 'make_model': 'renault kangoo', 'sanitized_make': 'renault', 'odometer_in_km': 225112}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 76,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '1d51a82c-e555-5b49-87f7-7279fa5f9ea4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault kangoo',
     'model': 'kangoo',
     'odometer': 225112,
     'odometer_in_km': 225112,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d51a82c-e555-5b49-87f7-7279fa5f9ea4/1d51a82c-e555-5b49-87f7-7279fa5f9ea4_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 429702,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/894/994bcb0790654c309b3983ad5041a3fb/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-25',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kangoo profesional n1 energy dci 55kw (75cv)',
     'transmission': 'manual',
     'trim': 'profesional n1 energy dci 55kw (75cv)',
     'vin': None,
     'year': 2019}
2026-01-27 20:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 spider: ayvens.es
2026-01-27 20:05:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1d51a82c-e555-5b49-87f7-7279fa5f9ea4 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'kangoo', 'trim': 'profesional n1 energy dci 55kw (75cv)', 'title': 'renault kangoo profesional n1 energy dci 55kw (75cv)', 'price': 0, 'odometer': 225112, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-25', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 123, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '1d51a82c-e555-5b49-87f7-7279fa5f9ea4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d51a82c-e555-5b49-87f7-7279fa5f9ea4/1d51a82c-e555-5b49-87f7-7279fa5f9ea4_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/894/994bcb0790654c309b3983ad5041a3fb/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 429702}], 'current_year_diff': 7, 'age_in_months': 76, 'make_model': 'renault kangoo', 'sanitized_make': 'renault', 'odometer_in_km': 225112}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 76,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '1d51a82c-e555-5b49-87f7-7279fa5f9ea4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault kangoo',
     'model': 'kangoo',
     'odometer': 225112,
     'odometer_in_km': 225112,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d51a82c-e555-5b49-87f7-7279fa5f9ea4/1d51a82c-e555-5b49-87f7-7279fa5f9ea4_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 429702,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/894/994bcb0790654c309b3983ad5041a3fb/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-25',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kangoo profesional n1 energy dci 55kw (75cv)',
     'transmission': 'manual',
     'trim': 'profesional n1 energy dci 55kw (75cv)',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1d51a82c-e555-5b49-87f7-7279fa5f9ea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 225112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d51a82c-e555-5b49-87f7-7279fa5f9ea4/1d51a82c-e555-5b49-87f7-7279fa5f9ea4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/894/994bcb0790654c309b3983ad5041a3fb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875327%27 HTTP/1.1" 200 None
2026-01-27 20:05:03 [ayvens.es] INFO: Saving data for 1875327: {'created_time': 1769544303.153251, 'last_price_update_time': 1769544303.153264, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875327') HTTP/1.1" 204 0
2026-01-27 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/862/d0c6f265ec444a5797ff142f5cfc6c78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/623/c218a2d0255040c0a4da2631e520d862/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/632/e890d509eb194b27bd572fcd1257e9ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/463/1527cece37104361bcc34d5e08efe61a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/132/0198b8f2e6ac4c538f0f5b0525c837e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:03 [ayvens.es] INFO: Found listing with ID: 1875345
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875345%27 HTTP/1.1" 200 None
2026-01-27 20:05:03 [ayvens.es] INFO: Scrape type for 1875345: 1
2026-01-27 20:05:03 [ayvens.es] INFO: Extracting data for car ID: 1875345
2026-01-27 20:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa732946-f146-539c-b970-d010aaf8b4f0 with identifier: 1875345
2026-01-27 20:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa732946-f146-539c-b970-d010aaf8b4f0 with scrape type 1
2026-01-27 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fa732946-f146-539c-b970-d010aaf8b4f0
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252F3b7b9d993cbb41aaa75945b000bc451a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/3b7b9d993cbb41aaa75945b000bc451a/images/large/1.jpg not downloaded yet
2026-01-27 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/934/bef723812bc541219da1e5fb7fd63784/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/773/eaa3582245cf45ba98421cb2083f9c42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:03 [ayvens.es] INFO: Found listing with ID: 1875346
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875346%27 HTTP/1.1" 200 None
2026-01-27 20:05:03 [ayvens.es] INFO: Scrape type for 1875346: 1
2026-01-27 20:05:03 [ayvens.es] INFO: Extracting data for car ID: 1875346
2026-01-27 20:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8574c2-1170-5f82-9f70-c278034abc87 with identifier: 1875346
2026-01-27 20:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8574c2-1170-5f82-9f70-c278034abc87 with scrape type 1
2026-01-27 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf8574c2-1170-5f82-9f70-c278034abc87
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F5dc8a5e5b81543cd8cba9e2cfd82cbe4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/5dc8a5e5b81543cd8cba9e2cfd82cbe4/images/large/1.jpg not downloaded yet
2026-01-27 20:05:03 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-01-27 20:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f36990>
2026-01-27 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7551364-e0ce-50d0-ac2f-7db4a7fab027/f7551364-e0ce-50d0-ac2f-7db4a7fab027_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F862%252Fd0c6f265ec444a5797ff142f5cfc6c78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/862/d0c6f265ec444a5797ff142f5cfc6c78/images/large/1.jpg saved to cache
2026-01-27 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7551364-e0ce-50d0-ac2f-7db4a7fab027
2026-01-27 20:05:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7551364-e0ce-50d0-ac2f-7db4a7fab027, skipping ID generation
2026-01-27 20:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7551364-e0ce-50d0-ac2f-7db4a7fab027 with scrape type 1
2026-01-27 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f7551364-e0ce-50d0-ac2f-7db4a7fab027 from tracking dictionaries
2026-01-27 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7551364-e0ce-50d0-ac2f-7db4a7fab027 sending to next pipeline
2026-01-27 20:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f7551364-e0ce-50d0-ac2f-7db4a7fab027, identifier: 1875331
2026-01-27 20:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f7551364-e0ce-50d0-ac2f-7db4a7fab027 with identifier: 1875331
2026-01-27 20:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f7551364-e0ce-50d0-ac2f-7db4a7fab027 with identifier: 1875331
2026-01-27 20:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
2026-01-27 20:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f7551364-e0ce-50d0-ac2f-7db4a7fab027 spider: ayvens.es
2026-01-27 20:05:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: f7551364-e0ce-50d0-ac2f-7db4a7fab027 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f7551364-e0ce-50d0-ac2f-7db4a7fab027',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 198464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7551364-e0ce-50d0-ac2f-7db4a7fab027/f7551364-e0ce-50d0-ac2f-7db4a7fab027_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/862/d0c6f265ec444a5797ff142f5cfc6c78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER Kombi Corto TN 2.0 TDI 110kW BMT 4Motion',
 'transmission': 'manual',
 'trim': 'Kombi Corto TN 2.0 TDI 110kW BMT 4Motion',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875331%27 HTTP/1.1" 200 None
2026-01-27 20:05:03 [ayvens.es] INFO: Saving data for 1875331: {'created_time': 1769544303.938334, 'last_price_update_time': 1769544303.938347, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875331') HTTP/1.1" 204 0
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57265cc50>
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_543b7f1f-4770-5460-be59-81069ee22084/543b7f1f-4770-5460-be59-81069ee22084_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F623%252Fc218a2d0255040c0a4da2631e520d862%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/623/c218a2d0255040c0a4da2631e520d862/images/large/1.jpg saved to cache
2026-01-27 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 543b7f1f-4770-5460-be59-81069ee22084
2026-01-27 20:05:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 543b7f1f-4770-5460-be59-81069ee22084, skipping ID generation
2026-01-27 20:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 543b7f1f-4770-5460-be59-81069ee22084 with scrape type 1
2026-01-27 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 543b7f1f-4770-5460-be59-81069ee22084 from tracking dictionaries
2026-01-27 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 543b7f1f-4770-5460-be59-81069ee22084 sending to next pipeline
2026-01-27 20:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 543b7f1f-4770-5460-be59-81069ee22084, identifier: 1875329
2026-01-27 20:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 543b7f1f-4770-5460-be59-81069ee22084 with identifier: 1875329
2026-01-27 20:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 543b7f1f-4770-5460-be59-81069ee22084 with identifier: 1875329
2026-01-27 20:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-27 20:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 543b7f1f-4770-5460-be59-81069ee22084 spider: ayvens.es
2026-01-27 20:05:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 543b7f1f-4770-5460-be59-81069ee22084 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '543b7f1f-4770-5460-be59-81069ee22084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 181036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_543b7f1f-4770-5460-be59-81069ee22084/543b7f1f-4770-5460-be59-81069ee22084_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/623/c218a2d0255040c0a4da2631e520d862/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW XL Business Edition N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW XL Business Edition N1',
 'vin': None,
 'year': 2023}
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875329%27 HTTP/1.1" 200 None
2026-01-27 20:05:04 [ayvens.es] INFO: Saving data for 1875329: {'created_time': 1769544304.680066, 'last_price_update_time': 1769544304.680076, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875329') HTTP/1.1" 204 0
2026-01-27 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/787/bdbefa43f9cf4575aa17b93225d13bb4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/426/ddce860a7cf848dfa6c6e8ad1364e02c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572269450>
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b866d2-8c92-50ec-9cf7-9f9985742863/26b866d2-8c92-50ec-9cf7-9f9985742863_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F632%252Fe890d509eb194b27bd572fcd1257e9ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/632/e890d509eb194b27bd572fcd1257e9ba/images/large/1.jpg saved to cache
2026-01-27 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26b866d2-8c92-50ec-9cf7-9f9985742863
2026-01-27 20:05:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26b866d2-8c92-50ec-9cf7-9f9985742863, skipping ID generation
2026-01-27 20:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b866d2-8c92-50ec-9cf7-9f9985742863 with scrape type 1
2026-01-27 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 26b866d2-8c92-50ec-9cf7-9f9985742863 from tracking dictionaries
2026-01-27 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26b866d2-8c92-50ec-9cf7-9f9985742863 sending to next pipeline
2026-01-27 20:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 26b866d2-8c92-50ec-9cf7-9f9985742863, identifier: 1875332
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571ee8290>
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fea0641c-688c-5c69-a758-44c6790d5ade/fea0641c-688c-5c69-a758-44c6790d5ade_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F1527cece37104361bcc34d5e08efe61a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/1527cece37104361bcc34d5e08efe61a/images/large/1.jpg saved to cache
2026-01-27 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fea0641c-688c-5c69-a758-44c6790d5ade
2026-01-27 20:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fea0641c-688c-5c69-a758-44c6790d5ade, skipping ID generation
2026-01-27 20:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fea0641c-688c-5c69-a758-44c6790d5ade with scrape type 1
2026-01-27 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fea0641c-688c-5c69-a758-44c6790d5ade from tracking dictionaries
2026-01-27 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fea0641c-688c-5c69-a758-44c6790d5ade sending to next pipeline
2026-01-27 20:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fea0641c-688c-5c69-a758-44c6790d5ade, identifier: 1875333
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572128a10>
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220674cc-6521-5981-9719-3ab8cd0a3b51/220674cc-6521-5981-9719-3ab8cd0a3b51_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F132%252F0198b8f2e6ac4c538f0f5b0525c837e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/132/0198b8f2e6ac4c538f0f5b0525c837e7/images/large/1.jpg saved to cache
2026-01-27 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 220674cc-6521-5981-9719-3ab8cd0a3b51
2026-01-27 20:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 220674cc-6521-5981-9719-3ab8cd0a3b51, skipping ID generation
2026-01-27 20:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 220674cc-6521-5981-9719-3ab8cd0a3b51 with scrape type 1
2026-01-27 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 220674cc-6521-5981-9719-3ab8cd0a3b51 from tracking dictionaries
2026-01-27 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 220674cc-6521-5981-9719-3ab8cd0a3b51 sending to next pipeline
2026-01-27 20:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 220674cc-6521-5981-9719-3ab8cd0a3b51, identifier: 1875328
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724cc750>
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3839f2a4-15ed-5665-9df8-db508babcdae/3839f2a4-15ed-5665-9df8-db508babcdae_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F934%252Fbef723812bc541219da1e5fb7fd63784%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/934/bef723812bc541219da1e5fb7fd63784/images/large/1.jpg saved to cache
2026-01-27 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3839f2a4-15ed-5665-9df8-db508babcdae
2026-01-27 20:05:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3839f2a4-15ed-5665-9df8-db508babcdae, skipping ID generation
2026-01-27 20:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3839f2a4-15ed-5665-9df8-db508babcdae with scrape type 1
2026-01-27 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3839f2a4-15ed-5665-9df8-db508babcdae from tracking dictionaries
2026-01-27 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3839f2a4-15ed-5665-9df8-db508babcdae sending to next pipeline
2026-01-27 20:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3839f2a4-15ed-5665-9df8-db508babcdae, identifier: 1875334
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57231ee50>
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6949715f-7ccf-5e5f-856b-dccf51677fa7/6949715f-7ccf-5e5f-856b-dccf51677fa7_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F773%252Feaa3582245cf45ba98421cb2083f9c42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/773/eaa3582245cf45ba98421cb2083f9c42/images/large/1.jpg saved to cache
2026-01-27 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6949715f-7ccf-5e5f-856b-dccf51677fa7
2026-01-27 20:05:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6949715f-7ccf-5e5f-856b-dccf51677fa7, skipping ID generation
2026-01-27 20:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6949715f-7ccf-5e5f-856b-dccf51677fa7 with scrape type 1
2026-01-27 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6949715f-7ccf-5e5f-856b-dccf51677fa7 from tracking dictionaries
2026-01-27 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6949715f-7ccf-5e5f-856b-dccf51677fa7 sending to next pipeline
2026-01-27 20:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6949715f-7ccf-5e5f-856b-dccf51677fa7, identifier: 1875326
2026-01-27 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/509/f66031e9c8ca4ae49a8d03d2c84d10d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/153/3565d55dce564b39902f2fac0b71bde6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 26b866d2-8c92-50ec-9cf7-9f9985742863 with identifier: 1875332
2026-01-27 20:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 26b866d2-8c92-50ec-9cf7-9f9985742863 with identifier: 1875332
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 26b866d2-8c92-50ec-9cf7-9f9985742863 spider: ayvens.es
2026-01-27 20:05:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 26b866d2-8c92-50ec-9cf7-9f9985742863 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '26b866d2-8c92-50ec-9cf7-9f9985742863',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 62558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b866d2-8c92-50ec-9cf7-9f9985742863/26b866d2-8c92-50ec-9cf7-9f9985742863_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/632/e890d509eb194b27bd572fcd1257e9ba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla M BlueHDi 120 S&S 6v Control',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 120 S&S 6v Control',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875332%27 HTTP/1.1" 200 None
2026-01-27 20:05:07 [ayvens.es] INFO: Saving data for 1875332: {'created_time': 1769544307.217928, 'last_price_update_time': 1769544307.217938, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875332') HTTP/1.1" 204 0
2026-01-27 20:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fea0641c-688c-5c69-a758-44c6790d5ade with identifier: 1875333
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fea0641c-688c-5c69-a758-44c6790d5ade with identifier: 1875333
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fea0641c-688c-5c69-a758-44c6790d5ade spider: ayvens.es
2026-01-27 20:05:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: fea0641c-688c-5c69-a758-44c6790d5ade due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fea0641c-688c-5c69-a758-44c6790d5ade',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 128778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fea0641c-688c-5c69-a758-44c6790d5ade/fea0641c-688c-5c69-a758-44c6790d5ade_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/463/1527cece37104361bcc34d5e08efe61a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) S Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) S Std Express',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875333%27 HTTP/1.1" 200 None
2026-01-27 20:05:07 [ayvens.es] INFO: Saving data for 1875333: {'created_time': 1769544307.453928, 'last_price_update_time': 1769544307.453938, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875333') HTTP/1.1" 204 0
2026-01-27 20:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 220674cc-6521-5981-9719-3ab8cd0a3b51 with identifier: 1875328
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 220674cc-6521-5981-9719-3ab8cd0a3b51 with identifier: 1875328
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'navara' containing 'navara'
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 220674cc-6521-5981-9719-3ab8cd0a3b51 spider: ayvens.es
2026-01-27 20:05:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 220674cc-6521-5981-9719-3ab8cd0a3b51 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'navara' containing 'navara'
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '220674cc-6521-5981-9719-3ab8cd0a3b51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NAVARA',
 'odometer': 92002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220674cc-6521-5981-9719-3ab8cd0a3b51/220674cc-6521-5981-9719-3ab8cd0a3b51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/132/0198b8f2e6ac4c538f0f5b0525c837e7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN NAVARA D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'transmission': 'manual',
 'trim': 'D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875328%27 HTTP/1.1" 200 None
2026-01-27 20:05:07 [ayvens.es] INFO: Saving data for 1875328: {'created_time': 1769544307.69509, 'last_price_update_time': 1769544307.695102, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875328') HTTP/1.1" 204 0
2026-01-27 20:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3839f2a4-15ed-5665-9df8-db508babcdae with identifier: 1875334
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3839f2a4-15ed-5665-9df8-db508babcdae with identifier: 1875334
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3839f2a4-15ed-5665-9df8-db508babcdae spider: ayvens.es
2026-01-27 20:05:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 3839f2a4-15ed-5665-9df8-db508babcdae due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3839f2a4-15ed-5665-9df8-db508babcdae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 114431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3839f2a4-15ed-5665-9df8-db508babcdae/3839f2a4-15ed-5665-9df8-db508babcdae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/934/bef723812bc541219da1e5fb7fd63784/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Pro Standard 600kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Pro Standard 600kg BlueHDi 73kW',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875334%27 HTTP/1.1" 200 None
2026-01-27 20:05:07 [ayvens.es] INFO: Saving data for 1875334: {'created_time': 1769544307.965937, 'last_price_update_time': 1769544307.965951, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875334') HTTP/1.1" 204 0
2026-01-27 20:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6949715f-7ccf-5e5f-856b-dccf51677fa7 with identifier: 1875326
2026-01-27 20:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6949715f-7ccf-5e5f-856b-dccf51677fa7 with identifier: 1875326
2026-01-27 20:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6949715f-7ccf-5e5f-856b-dccf51677fa7 spider: ayvens.es
2026-01-27 20:05:08 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6949715f-7ccf-5e5f-856b-dccf51677fa7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6949715f-7ccf-5e5f-856b-dccf51677fa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 147799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6949715f-7ccf-5e5f-856b-dccf51677fa7/6949715f-7ccf-5e5f-856b-dccf51677fa7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/773/eaa3582245cf45ba98421cb2083f9c42/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 66kW (90CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Profesional dCi 66kW (90CV) Euro 6',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875326%27 HTTP/1.1" 200 None
2026-01-27 20:05:08 [ayvens.es] INFO: Saving data for 1875326: {'created_time': 1769544308.208371, 'last_price_update_time': 1769544308.208384, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875326') HTTP/1.1" 204 0
2026-01-27 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/494/21fda362aae44c7a82476de5c01725d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/361/39f58abb7da646fabadea841fef961c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/df30d3117b9a4552bd9eb3b57fb6d6a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/a30fa0160878436db934cdfe86e9d210/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b40750>
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ea8070-7436-5691-87a3-f8aa4ecefd72/81ea8070-7436-5691-87a3-f8aa4ecefd72_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F787%252Fbdbefa43f9cf4575aa17b93225d13bb4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/787/bdbefa43f9cf4575aa17b93225d13bb4/images/large/1.jpg saved to cache
2026-01-27 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81ea8070-7436-5691-87a3-f8aa4ecefd72
2026-01-27 20:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81ea8070-7436-5691-87a3-f8aa4ecefd72, skipping ID generation
2026-01-27 20:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ea8070-7436-5691-87a3-f8aa4ecefd72 with scrape type 1
2026-01-27 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 81ea8070-7436-5691-87a3-f8aa4ecefd72 from tracking dictionaries
2026-01-27 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81ea8070-7436-5691-87a3-f8aa4ecefd72 sending to next pipeline
2026-01-27 20:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 81ea8070-7436-5691-87a3-f8aa4ecefd72, identifier: 1875330
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724afbd0>
2026-01-27 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14c3f3f6-a7b7-5235-b0f6-f3894d813350/14c3f3f6-a7b7-5235-b0f6-f3894d813350_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252Fddce860a7cf848dfa6c6e8ad1364e02c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/ddce860a7cf848dfa6c6e8ad1364e02c/images/large/1.jpg saved to cache
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14c3f3f6-a7b7-5235-b0f6-f3894d813350
2026-01-27 20:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14c3f3f6-a7b7-5235-b0f6-f3894d813350, skipping ID generation
2026-01-27 20:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14c3f3f6-a7b7-5235-b0f6-f3894d813350 with scrape type 1
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 14c3f3f6-a7b7-5235-b0f6-f3894d813350 from tracking dictionaries
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14c3f3f6-a7b7-5235-b0f6-f3894d813350 sending to next pipeline
2026-01-27 20:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 14c3f3f6-a7b7-5235-b0f6-f3894d813350, identifier: 1875335
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57258e610>
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff2fc9b9-5ca0-5886-b0f4-5785520d027a/ff2fc9b9-5ca0-5886-b0f4-5785520d027a_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F509%252Ff66031e9c8ca4ae49a8d03d2c84d10d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/509/f66031e9c8ca4ae49a8d03d2c84d10d1/images/large/1.jpg saved to cache
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff2fc9b9-5ca0-5886-b0f4-5785520d027a
2026-01-27 20:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff2fc9b9-5ca0-5886-b0f4-5785520d027a, skipping ID generation
2026-01-27 20:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2fc9b9-5ca0-5886-b0f4-5785520d027a with scrape type 1
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ff2fc9b9-5ca0-5886-b0f4-5785520d027a from tracking dictionaries
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff2fc9b9-5ca0-5886-b0f4-5785520d027a sending to next pipeline
2026-01-27 20:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff2fc9b9-5ca0-5886-b0f4-5785520d027a, identifier: 1875336
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572579a90>
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1045c63-a39c-5e1b-b379-82130fe3a78b/b1045c63-a39c-5e1b-b379-82130fe3a78b_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F153%252F3565d55dce564b39902f2fac0b71bde6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/153/3565d55dce564b39902f2fac0b71bde6/images/large/1.jpg saved to cache
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1045c63-a39c-5e1b-b379-82130fe3a78b
2026-01-27 20:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1045c63-a39c-5e1b-b379-82130fe3a78b, skipping ID generation
2026-01-27 20:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1045c63-a39c-5e1b-b379-82130fe3a78b with scrape type 1
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b1045c63-a39c-5e1b-b379-82130fe3a78b from tracking dictionaries
2026-01-27 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1045c63-a39c-5e1b-b379-82130fe3a78b sending to next pipeline
2026-01-27 20:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1045c63-a39c-5e1b-b379-82130fe3a78b, identifier: 1875340
2026-01-27 20:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 81ea8070-7436-5691-87a3-f8aa4ecefd72 with identifier: 1875330
2026-01-27 20:05:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 81ea8070-7436-5691-87a3-f8aa4ecefd72 with identifier: 1875330
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 81ea8070-7436-5691-87a3-f8aa4ecefd72 spider: ayvens.es
2026-01-27 20:05:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 81ea8070-7436-5691-87a3-f8aa4ecefd72 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'Antiguo blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '81ea8070-7436-5691-87a3-f8aa4ecefd72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 156939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ea8070-7436-5691-87a3-f8aa4ecefd72/81ea8070-7436-5691-87a3-f8aa4ecefd72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/787/bdbefa43f9cf4575aa17b93225d13bb4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 9,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI TOURER LARGO 3.5T T. ALTO',
 'transmission': 'manual',
 'trim': '314 CDI TOURER LARGO 3.5T T. ALTO',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875330%27 HTTP/1.1" 200 None
2026-01-27 20:05:10 [ayvens.es] INFO: Saving data for 1875330: {'created_time': 1769544310.266106, 'last_price_update_time': 1769544310.266118, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875330') HTTP/1.1" 204 0
2026-01-27 20:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 14c3f3f6-a7b7-5235-b0f6-f3894d813350 with identifier: 1875335
2026-01-27 20:05:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 14c3f3f6-a7b7-5235-b0f6-f3894d813350 with identifier: 1875335
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 14c3f3f6-a7b7-5235-b0f6-f3894d813350 spider: ayvens.es
2026-01-27 20:05:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 14c3f3f6-a7b7-5235-b0f6-f3894d813350 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco casablanca',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '14c3f3f6-a7b7-5235-b0f6-f3894d813350',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 110642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14c3f3f6-a7b7-5235-b0f6-f3894d813350/14c3f3f6-a7b7-5235-b0f6-f3894d813350_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/426/ddce860a7cf848dfa6c6e8ad1364e02c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L1H1 Energy BluedCi 88 kW',
 'transmission': 'manual',
 'trim': 'Furgon 29 L1H1 Energy BluedCi 88 kW',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875335%27 HTTP/1.1" 200 None
2026-01-27 20:05:10 [ayvens.es] INFO: Saving data for 1875335: {'created_time': 1769544310.530124, 'last_price_update_time': 1769544310.530139, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875335') HTTP/1.1" 204 0
2026-01-27 20:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff2fc9b9-5ca0-5886-b0f4-5785520d027a with identifier: 1875336
2026-01-27 20:05:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff2fc9b9-5ca0-5886-b0f4-5785520d027a with identifier: 1875336
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ff2fc9b9-5ca0-5886-b0f4-5785520d027a spider: ayvens.es
2026-01-27 20:05:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ff2fc9b9-5ca0-5886-b0f4-5785520d027a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'color': 'Amarillo correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff2fc9b9-5ca0-5886-b0f4-5785520d027a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 64243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff2fc9b9-5ca0-5886-b0f4-5785520d027a/ff2fc9b9-5ca0-5886-b0f4-5785520d027a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/509/f66031e9c8ca4ae49a8d03d2c84d10d1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L3H2 3500 Bl dCi 100 kW(135CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L3H2 3500 Bl dCi 100 kW(135CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875336%27 HTTP/1.1" 200 None
2026-01-27 20:05:10 [ayvens.es] INFO: Saving data for 1875336: {'created_time': 1769544310.783357, 'last_price_update_time': 1769544310.783371, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875336') HTTP/1.1" 204 0
2026-01-27 20:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1045c63-a39c-5e1b-b379-82130fe3a78b with identifier: 1875340
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1045c63-a39c-5e1b-b379-82130fe3a78b with identifier: 1875340
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace' containing 'proace'
2026-01-27 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b1045c63-a39c-5e1b-b379-82130fe3a78b spider: ayvens.es
2026-01-27 20:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b1045c63-a39c-5e1b-b379-82130fe3a78b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace' containing 'proace'
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b1045c63-a39c-5e1b-b379-82130fe3a78b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE',
 'odometer': 122073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1045c63-a39c-5e1b-b379-82130fe3a78b/b1045c63-a39c-5e1b-b379-82130fe3a78b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/153/3565d55dce564b39902f2fac0b71bde6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE 2.0D 120CV BUSINESS 1PL 2PT L2',
 'transmission': 'manual',
 'trim': '2.0D 120CV BUSINESS 1PL 2PT L2',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875340%27 HTTP/1.1" 200 None
2026-01-27 20:05:11 [ayvens.es] INFO: Saving data for 1875340: {'created_time': 1769544311.030529, 'last_price_update_time': 1769544311.030542, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875340') HTTP/1.1" 204 0
2026-01-27 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/447/39df28a1bae044beaac524e795508345/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f7add0>
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fcdecb3-e834-5056-a442-dffc3db68edf/6fcdecb3-e834-5056-a442-dffc3db68edf_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F494%252F21fda362aae44c7a82476de5c01725d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/494/21fda362aae44c7a82476de5c01725d9/images/large/1.jpg saved to cache
2026-01-27 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fcdecb3-e834-5056-a442-dffc3db68edf
2026-01-27 20:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fcdecb3-e834-5056-a442-dffc3db68edf, skipping ID generation
2026-01-27 20:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fcdecb3-e834-5056-a442-dffc3db68edf with scrape type 1
2026-01-27 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6fcdecb3-e834-5056-a442-dffc3db68edf from tracking dictionaries
2026-01-27 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fcdecb3-e834-5056-a442-dffc3db68edf sending to next pipeline
2026-01-27 20:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6fcdecb3-e834-5056-a442-dffc3db68edf, identifier: 1875337
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5727a1d50>
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8099986-4b48-56ab-95df-eaae4b2d8e42/e8099986-4b48-56ab-95df-eaae4b2d8e42_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F361%252F39f58abb7da646fabadea841fef961c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/361/39f58abb7da646fabadea841fef961c5/images/large/1.jpg saved to cache
2026-01-27 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8099986-4b48-56ab-95df-eaae4b2d8e42
2026-01-27 20:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8099986-4b48-56ab-95df-eaae4b2d8e42, skipping ID generation
2026-01-27 20:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8099986-4b48-56ab-95df-eaae4b2d8e42 with scrape type 1
2026-01-27 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e8099986-4b48-56ab-95df-eaae4b2d8e42 from tracking dictionaries
2026-01-27 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8099986-4b48-56ab-95df-eaae4b2d8e42 sending to next pipeline
2026-01-27 20:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e8099986-4b48-56ab-95df-eaae4b2d8e42, identifier: 1875338
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f79190>
2026-01-27 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9536cc23-fb5d-5368-bde2-0d445ddd1806/9536cc23-fb5d-5368-bde2-0d445ddd1806_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252Fdf30d3117b9a4552bd9eb3b57fb6d6a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/df30d3117b9a4552bd9eb3b57fb6d6a2/images/large/1.jpg saved to cache
2026-01-27 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9536cc23-fb5d-5368-bde2-0d445ddd1806
2026-01-27 20:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9536cc23-fb5d-5368-bde2-0d445ddd1806, skipping ID generation
2026-01-27 20:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9536cc23-fb5d-5368-bde2-0d445ddd1806 with scrape type 1
2026-01-27 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9536cc23-fb5d-5368-bde2-0d445ddd1806 from tracking dictionaries
2026-01-27 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9536cc23-fb5d-5368-bde2-0d445ddd1806 sending to next pipeline
2026-01-27 20:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9536cc23-fb5d-5368-bde2-0d445ddd1806, identifier: 1875339
2026-01-27 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572165490>
2026-01-27 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9397ddd4-7f43-5960-8228-c3fadb7f141f/9397ddd4-7f43-5960-8228-c3fadb7f141f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Fa30fa0160878436db934cdfe86e9d210%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/a30fa0160878436db934cdfe86e9d210/images/large/1.jpg saved to cache
2026-01-27 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9397ddd4-7f43-5960-8228-c3fadb7f141f
2026-01-27 20:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9397ddd4-7f43-5960-8228-c3fadb7f141f, skipping ID generation
2026-01-27 20:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9397ddd4-7f43-5960-8228-c3fadb7f141f with scrape type 1
2026-01-27 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9397ddd4-7f43-5960-8228-c3fadb7f141f from tracking dictionaries
2026-01-27 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9397ddd4-7f43-5960-8228-c3fadb7f141f sending to next pipeline
2026-01-27 20:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9397ddd4-7f43-5960-8228-c3fadb7f141f, identifier: 1875341
2026-01-27 20:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6fcdecb3-e834-5056-a442-dffc3db68edf with identifier: 1875337
2026-01-27 20:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6fcdecb3-e834-5056-a442-dffc3db68edf with identifier: 1875337
2026-01-27 20:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'toyota', 'model': 'hilux', 'trim': '2.4d doble cabina basalto 4x4', 'title': 'toyota hilux 2.4d doble cabina basalto 4x4', 'price': 0, 'odometer': 223645, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-05', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.4l', 'c_o_2_emission_value': 185, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6fcdecb3-e834-5056-a442-dffc3db68edf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcdecb3-e834-5056-a442-dffc3db68edf/6fcdecb3-e834-5056-a442-dffc3db68edf_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/494/21fda362aae44c7a82476de5c01725d9/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 353927}], 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'toyota hilux', 'sanitized_make': 'toyota', 'odometer_in_km': 223645}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 185,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 4,
     'engine': '2.4l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '6fcdecb3-e834-5056-a442-dffc3db68edf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'toyota',
     'make_model': 'toyota hilux',
     'model': 'hilux',
     'odometer': 223645,
     'odometer_in_km': 223645,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcdecb3-e834-5056-a442-dffc3db68edf/6fcdecb3-e834-5056-a442-dffc3db68edf_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 353927,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/494/21fda362aae44c7a82476de5c01725d9/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-02-05',
     'sanitized_make': 'toyota',
     'seats_number': 5,
     'seller_name': None,
     'title': 'toyota hilux 2.4d doble cabina basalto 4x4',
     'transmission': 'manual',
     'trim': '2.4d doble cabina basalto 4x4',
     'vin': None,
     'year': 2019}
2026-01-27 20:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 6fcdecb3-e834-5056-a442-dffc3db68edf spider: ayvens.es
2026-01-27 20:05:12 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 6fcdecb3-e834-5056-a442-dffc3db68edf due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'toyota', 'model': 'hilux', 'trim': '2.4d doble cabina basalto 4x4', 'title': 'toyota hilux 2.4d doble cabina basalto 4x4', 'price': 0, 'odometer': 223645, 'odometer_reading_unit': 'km', 'registration_date': '2019-02-05', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.4l', 'c_o_2_emission_value': 185, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6fcdecb3-e834-5056-a442-dffc3db68edf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcdecb3-e834-5056-a442-dffc3db68edf/6fcdecb3-e834-5056-a442-dffc3db68edf_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/494/21fda362aae44c7a82476de5c01725d9/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 353927}], 'current_year_diff': 7, 'age_in_months': 83, 'make_model': 'toyota hilux', 'sanitized_make': 'toyota', 'odometer_in_km': 223645}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 83,
     'auction_title': '',
     'c_o_2_emission_value': 185,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 4,
     'engine': '2.4l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '6fcdecb3-e834-5056-a442-dffc3db68edf',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'toyota',
     'make_model': 'toyota hilux',
     'model': 'hilux',
     'odometer': 223645,
     'odometer_in_km': 223645,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcdecb3-e834-5056-a442-dffc3db68edf/6fcdecb3-e834-5056-a442-dffc3db68edf_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 353927,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/494/21fda362aae44c7a82476de5c01725d9/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-02-05',
     'sanitized_make': 'toyota',
     'seats_number': 5,
     'seller_name': None,
     'title': 'toyota hilux 2.4d doble cabina basalto 4x4',
     'transmission': 'manual',
     'trim': '2.4d doble cabina basalto 4x4',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6fcdecb3-e834-5056-a442-dffc3db68edf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 223645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcdecb3-e834-5056-a442-dffc3db68edf/6fcdecb3-e834-5056-a442-dffc3db68edf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/494/21fda362aae44c7a82476de5c01725d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4D Doble Cabina Basalto 4x4',
 'transmission': 'manual',
 'trim': '2.4D Doble Cabina Basalto 4x4',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875337%27 HTTP/1.1" 200 None
2026-01-27 20:05:12 [ayvens.es] INFO: Saving data for 1875337: {'created_time': 1769544312.979811, 'last_price_update_time': 1769544312.979823, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875337') HTTP/1.1" 204 0
2026-01-27 20:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e8099986-4b48-56ab-95df-eaae4b2d8e42 with identifier: 1875338
2026-01-27 20:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e8099986-4b48-56ab-95df-eaae4b2d8e42 with identifier: 1875338
2026-01-27 20:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2026-01-27 20:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e8099986-4b48-56ab-95df-eaae4b2d8e42 spider: ayvens.es
2026-01-27 20:05:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e8099986-4b48-56ab-95df-eaae4b2d8e42 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e8099986-4b48-56ab-95df-eaae4b2d8e42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 159037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8099986-4b48-56ab-95df-eaae4b2d8e42/e8099986-4b48-56ab-95df-eaae4b2d8e42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/361/39f58abb7da646fabadea841fef961c5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 Energy BluedCi 88 kW',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 Energy BluedCi 88 kW',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875338%27 HTTP/1.1" 200 None
2026-01-27 20:05:13 [ayvens.es] INFO: Saving data for 1875338: {'created_time': 1769544313.20706, 'last_price_update_time': 1769544313.207071, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875338') HTTP/1.1" 204 0
2026-01-27 20:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9536cc23-fb5d-5368-bde2-0d445ddd1806 with identifier: 1875339
2026-01-27 20:05:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9536cc23-fb5d-5368-bde2-0d445ddd1806 with identifier: 1875339
2026-01-27 20:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-27 20:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9536cc23-fb5d-5368-bde2-0d445ddd1806 spider: ayvens.es
2026-01-27 20:05:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 9536cc23-fb5d-5368-bde2-0d445ddd1806 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9536cc23-fb5d-5368-bde2-0d445ddd1806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 112953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9536cc23-fb5d-5368-bde2-0d445ddd1806/9536cc23-fb5d-5368-bde2-0d445ddd1806_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/df30d3117b9a4552bd9eb3b57fb6d6a2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Premium 1.5 BlueHDi 100 Standard',
 'transmission': 'manual',
 'trim': 'Furgon Premium 1.5 BlueHDi 100 Standard',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875339%27 HTTP/1.1" 200 None
2026-01-27 20:05:13 [ayvens.es] INFO: Saving data for 1875339: {'created_time': 1769544313.471302, 'last_price_update_time': 1769544313.471314, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875339') HTTP/1.1" 204 0
2026-01-27 20:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9397ddd4-7f43-5960-8228-c3fadb7f141f with identifier: 1875341
2026-01-27 20:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9397ddd4-7f43-5960-8228-c3fadb7f141f with identifier: 1875341
2026-01-27 20:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9397ddd4-7f43-5960-8228-c3fadb7f141f with identifier: 1875341 to the API
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-27 20:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/a30fa0160878436db934cdfe86e9d210/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 84,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9397ddd4-7f43-5960-8228-c3fadb7f141f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 79141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9397ddd4-7f43-5960-8228-c3fadb7f141f/9397ddd4-7f43-5960-8228-c3fadb7f141f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/a30fa0160878436db934cdfe86e9d210/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 100H Active Ecovan',
 'transmission': 'manual',
 'trim': '1.5 100H Active Ecovan',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875341%27 HTTP/1.1" 200 None
2026-01-27 20:05:13 [ayvens.es] INFO: Saving data for 1875341: {'created_time': 1769544313.799954, 'last_price_update_time': 1769544313.799965, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875341') HTTP/1.1" 204 0
2026-01-27 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/279/5dc8a5e5b81543cd8cba9e2cfd82cbe4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/372/3b7b9d993cbb41aaa75945b000bc451a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-27 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/440/ac28d0e5d83e4bb7b0b877696c32b7b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721b9110>
2026-01-27 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59a8c0bb-14be-5daf-97f1-0fc90011b3c7/59a8c0bb-14be-5daf-97f1-0fc90011b3c7_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F447%252F39df28a1bae044beaac524e795508345%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/447/39df28a1bae044beaac524e795508345/images/large/1.jpg saved to cache
2026-01-27 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59a8c0bb-14be-5daf-97f1-0fc90011b3c7
2026-01-27 20:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59a8c0bb-14be-5daf-97f1-0fc90011b3c7, skipping ID generation
2026-01-27 20:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 with scrape type 1
2026-01-27 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 from tracking dictionaries
2026-01-27 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 sending to next pipeline
2026-01-27 20:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 59a8c0bb-14be-5daf-97f1-0fc90011b3c7, identifier: 1875343
2026-01-27 20:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 with identifier: 1875343
2026-01-27 20:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 with identifier: 1875343
2026-01-27 20:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-27 20:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 spider: ayvens.es
2026-01-27 20:05:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 59a8c0bb-14be-5daf-97f1-0fc90011b3c7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '59a8c0bb-14be-5daf-97f1-0fc90011b3c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 196718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59a8c0bb-14be-5daf-97f1-0fc90011b3c7/59a8c0bb-14be-5daf-97f1-0fc90011b3c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/447/39df28a1bae044beaac524e795508345/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend RWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend RWD',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875343%27 HTTP/1.1" 200 None
2026-01-27 20:05:14 [ayvens.es] INFO: Saving data for 1875343: {'created_time': 1769544314.495023, 'last_price_update_time': 1769544314.495036, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875343') HTTP/1.1" 204 0
2026-01-27 20:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/43466b51b27f4f63b19aa74601a788e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57092bb90>
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8574c2-1170-5f82-9f70-c278034abc87/bf8574c2-1170-5f82-9f70-c278034abc87_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F5dc8a5e5b81543cd8cba9e2cfd82cbe4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/5dc8a5e5b81543cd8cba9e2cfd82cbe4/images/large/1.jpg saved to cache
2026-01-27 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf8574c2-1170-5f82-9f70-c278034abc87
2026-01-27 20:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf8574c2-1170-5f82-9f70-c278034abc87, skipping ID generation
2026-01-27 20:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8574c2-1170-5f82-9f70-c278034abc87 with scrape type 1
2026-01-27 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bf8574c2-1170-5f82-9f70-c278034abc87 from tracking dictionaries
2026-01-27 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf8574c2-1170-5f82-9f70-c278034abc87 sending to next pipeline
2026-01-27 20:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf8574c2-1170-5f82-9f70-c278034abc87, identifier: 1875346
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57238cb90>
2026-01-27 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa732946-f146-539c-b970-d010aaf8b4f0/fa732946-f146-539c-b970-d010aaf8b4f0_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252F3b7b9d993cbb41aaa75945b000bc451a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/3b7b9d993cbb41aaa75945b000bc451a/images/large/1.jpg saved to cache
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa732946-f146-539c-b970-d010aaf8b4f0
2026-01-27 20:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa732946-f146-539c-b970-d010aaf8b4f0, skipping ID generation
2026-01-27 20:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa732946-f146-539c-b970-d010aaf8b4f0 with scrape type 1
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fa732946-f146-539c-b970-d010aaf8b4f0 from tracking dictionaries
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa732946-f146-539c-b970-d010aaf8b4f0 sending to next pipeline
2026-01-27 20:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fa732946-f146-539c-b970-d010aaf8b4f0, identifier: 1875345
2026-01-27 20:05:15 [ayvens.es] INFO: Found listing with ID: 1875347
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875347%27 HTTP/1.1" 200 None
2026-01-27 20:05:15 [ayvens.es] INFO: Scrape type for 1875347: 1
2026-01-27 20:05:15 [ayvens.es] INFO: Extracting data for car ID: 1875347
2026-01-27 20:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08696edd-72c9-5262-b4a9-8243be187e04 with identifier: 1875347
2026-01-27 20:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08696edd-72c9-5262-b4a9-8243be187e04 with scrape type 1
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08696edd-72c9-5262-b4a9-8243be187e04
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F842%252F9e85def0f6ed4fc9b907c13c09ca37ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/842/9e85def0f6ed4fc9b907c13c09ca37ec/images/large/1.jpg not downloaded yet
2026-01-27 20:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a8d910>
2026-01-27 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_630ced5c-6728-5db0-b527-93ead5b668c2/630ced5c-6728-5db0-b527-93ead5b668c2_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F440%252Fac28d0e5d83e4bb7b0b877696c32b7b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/440/ac28d0e5d83e4bb7b0b877696c32b7b6/images/large/1.jpg saved to cache
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 630ced5c-6728-5db0-b527-93ead5b668c2
2026-01-27 20:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 630ced5c-6728-5db0-b527-93ead5b668c2, skipping ID generation
2026-01-27 20:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 630ced5c-6728-5db0-b527-93ead5b668c2 with scrape type 1
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 630ced5c-6728-5db0-b527-93ead5b668c2 from tracking dictionaries
2026-01-27 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 630ced5c-6728-5db0-b527-93ead5b668c2 sending to next pipeline
2026-01-27 20:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 630ced5c-6728-5db0-b527-93ead5b668c2, identifier: 1875342
2026-01-27 20:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf8574c2-1170-5f82-9f70-c278034abc87 with identifier: 1875346
2026-01-27 20:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf8574c2-1170-5f82-9f70-c278034abc87 with identifier: 1875346
2026-01-27 20:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-27 20:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bf8574c2-1170-5f82-9f70-c278034abc87 spider: ayvens.es
2026-01-27 20:05:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: bf8574c2-1170-5f82-9f70-c278034abc87 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf8574c2-1170-5f82-9f70-c278034abc87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 87401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8574c2-1170-5f82-9f70-c278034abc87/bf8574c2-1170-5f82-9f70-c278034abc87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/279/5dc8a5e5b81543cd8cba9e2cfd82cbe4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.6 TD S/S 74kW (100CV) Select L H1 650k',
 'transmission': 'manual',
 'trim': '1.6 TD S/S 74kW (100CV) Select L H1 650k',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875346%27 HTTP/1.1" 200 None
2026-01-27 20:05:16 [ayvens.es] INFO: Saving data for 1875346: {'created_time': 1769544316.017267, 'last_price_update_time': 1769544316.017277, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875346') HTTP/1.1" 204 0
2026-01-27 20:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fa732946-f146-539c-b970-d010aaf8b4f0 with identifier: 1875345
2026-01-27 20:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fa732946-f146-539c-b970-d010aaf8b4f0 with identifier: 1875345
2026-01-27 20:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'fiat', 'model': 'fiorino', 'trim': 'cargo base 1.3 mjet 75cv e5+ clase 2', 'title': 'fiat fiorino cargo base 1.3 mjet 75cv e5+ clase 2', 'price': 0, 'odometer': 210740, 'odometer_reading_unit': 'km', 'registration_date': '2017-05-17', 'year': 2017, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 124, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'fa732946-f146-539c-b970-d010aaf8b4f0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa732946-f146-539c-b970-d010aaf8b4f0/fa732946-f146-539c-b970-d010aaf8b4f0_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/3b7b9d993cbb41aaa75945b000bc451a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 318368}], 'current_year_diff': 9, 'age_in_months': 104, 'make_model': 'fiat fiorino', 'sanitized_make': 'fiat', 'odometer_in_km': 210740}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 4,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'fa732946-f146-539c-b970-d010aaf8b4f0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'fiat',
     'make_model': 'fiat fiorino',
     'model': 'fiorino',
     'odometer': 210740,
     'odometer_in_km': 210740,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa732946-f146-539c-b970-d010aaf8b4f0/fa732946-f146-539c-b970-d010aaf8b4f0_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 318368,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/3b7b9d993cbb41aaa75945b000bc451a/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-05-17',
     'sanitized_make': 'fiat',
     'seats_number': 2,
     'seller_name': None,
     'title': 'fiat fiorino cargo base 1.3 mjet 75cv e5+ clase 2',
     'transmission': 'manual',
     'trim': 'cargo base 1.3 mjet 75cv e5+ clase 2',
     'vin': None,
     'year': 2017}
2026-01-27 20:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: fa732946-f146-539c-b970-d010aaf8b4f0 spider: ayvens.es
2026-01-27 20:05:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: fa732946-f146-539c-b970-d010aaf8b4f0 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'fiat', 'model': 'fiorino', 'trim': 'cargo base 1.3 mjet 75cv e5+ clase 2', 'title': 'fiat fiorino cargo base 1.3 mjet 75cv e5+ clase 2', 'price': 0, 'odometer': 210740, 'odometer_reading_unit': 'km', 'registration_date': '2017-05-17', 'year': 2017, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.2l', 'c_o_2_emission_value': 124, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'fa732946-f146-539c-b970-d010aaf8b4f0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa732946-f146-539c-b970-d010aaf8b4f0/fa732946-f146-539c-b970-d010aaf8b4f0_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/3b7b9d993cbb41aaa75945b000bc451a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 318368}], 'current_year_diff': 9, 'age_in_months': 104, 'make_model': 'fiat fiorino', 'sanitized_make': 'fiat', 'odometer_in_km': 210740}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 4,
     'engine': '1.2l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'fa732946-f146-539c-b970-d010aaf8b4f0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'fiat',
     'make_model': 'fiat fiorino',
     'model': 'fiorino',
     'odometer': 210740,
     'odometer_in_km': 210740,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa732946-f146-539c-b970-d010aaf8b4f0/fa732946-f146-539c-b970-d010aaf8b4f0_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 318368,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/3b7b9d993cbb41aaa75945b000bc451a/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-05-17',
     'sanitized_make': 'fiat',
     'seats_number': 2,
     'seller_name': None,
     'title': 'fiat fiorino cargo base 1.3 mjet 75cv e5+ clase 2',
     'transmission': 'manual',
     'trim': 'cargo base 1.3 mjet 75cv e5+ clase 2',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fa732946-f146-539c-b970-d010aaf8b4f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 210740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa732946-f146-539c-b970-d010aaf8b4f0/fa732946-f146-539c-b970-d010aaf8b4f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/3b7b9d993cbb41aaa75945b000bc451a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'vin': None,
 'year': 2017}
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875345%27 HTTP/1.1" 200 None
2026-01-27 20:05:16 [ayvens.es] INFO: Saving data for 1875345: {'created_time': 1769544316.281957, 'last_price_update_time': 1769544316.281967, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875345') HTTP/1.1" 204 0
2026-01-27 20:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 630ced5c-6728-5db0-b527-93ead5b668c2 with identifier: 1875342
2026-01-27 20:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 630ced5c-6728-5db0-b527-93ead5b668c2 with identifier: 1875342
2026-01-27 20:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-27 20:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 630ced5c-6728-5db0-b527-93ead5b668c2 spider: ayvens.es
2026-01-27 20:05:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 630ced5c-6728-5db0-b527-93ead5b668c2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '630ced5c-6728-5db0-b527-93ead5b668c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 34924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_630ced5c-6728-5db0-b527-93ead5b668c2/630ced5c-6728-5db0-b527-93ead5b668c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/440/ac28d0e5d83e4bb7b0b877696c32b7b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 333 L2 H2 BHDI 103kW (140CV) S&S 6 V. M',
 'transmission': 'manual',
 'trim': '333 L2 H2 BHDI 103kW (140CV) S&S 6 V. M',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875342%27 HTTP/1.1" 200 None
2026-01-27 20:05:16 [ayvens.es] INFO: Saving data for 1875342: {'created_time': 1769544316.530021, 'last_price_update_time': 1769544316.530032, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875342') HTTP/1.1" 204 0
2026-01-27 20:05:16 [ayvens.es] INFO: Found listing with ID: 1875348
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875348%27 HTTP/1.1" 200 None
2026-01-27 20:05:16 [ayvens.es] INFO: Scrape type for 1875348: 1
2026-01-27 20:05:16 [ayvens.es] INFO: Extracting data for car ID: 1875348
2026-01-27 20:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cb2d802-236a-5222-b1a8-079ccc8cf263 with identifier: 1875348
2026-01-27 20:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb2d802-236a-5222-b1a8-079ccc8cf263 with scrape type 1
2026-01-27 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2cb2d802-236a-5222-b1a8-079ccc8cf263
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F751%252F2c23c187001a4d0ab564b534221bf16f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/751/2c23c187001a4d0ab564b534221bf16f/images/large/1.jpg not downloaded yet
2026-01-27 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57093bb90>
2026-01-27 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c626bc2-5126-5440-8c3d-1d483e83da0e/0c626bc2-5126-5440-8c3d-1d483e83da0e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F43466b51b27f4f63b19aa74601a788e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/43466b51b27f4f63b19aa74601a788e6/images/large/1.jpg saved to cache
2026-01-27 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c626bc2-5126-5440-8c3d-1d483e83da0e
2026-01-27 20:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c626bc2-5126-5440-8c3d-1d483e83da0e, skipping ID generation
2026-01-27 20:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c626bc2-5126-5440-8c3d-1d483e83da0e with scrape type 1
2026-01-27 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0c626bc2-5126-5440-8c3d-1d483e83da0e from tracking dictionaries
2026-01-27 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c626bc2-5126-5440-8c3d-1d483e83da0e sending to next pipeline
2026-01-27 20:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c626bc2-5126-5440-8c3d-1d483e83da0e, identifier: 1875344
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875349
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875349%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875349: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875349
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54436c05-1604-5580-9111-91b52cbb0613 with identifier: 1875349
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54436c05-1604-5580-9111-91b52cbb0613 with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 54436c05-1604-5580-9111-91b52cbb0613
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F1f48fceedec34555a6cc72e6d6531e4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/1f48fceedec34555a6cc72e6d6531e4c/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c626bc2-5126-5440-8c3d-1d483e83da0e with identifier: 1875344
2026-01-27 20:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c626bc2-5126-5440-8c3d-1d483e83da0e with identifier: 1875344
2026-01-27 20:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco s', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'transit courier', 'trim': 'van 1.5 tdci 56kw trend', 'title': 'ford transit courier van 1.5 tdci 56kw trend', 'price': 0, 'odometer': 214027, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-27', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 112, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0c626bc2-5126-5440-8c3d-1d483e83da0e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c626bc2-5126-5440-8c3d-1d483e83da0e/0c626bc2-5126-5440-8c3d-1d483e83da0e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/43466b51b27f4f63b19aa74601a788e6/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 556478}], 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'ford transit courier', 'sanitized_make': 'ford', 'odometer_in_km': 214027}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'color': 'blanco s',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '0c626bc2-5126-5440-8c3d-1d483e83da0e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford transit courier',
     'model': 'transit courier',
     'odometer': 214027,
     'odometer_in_km': 214027,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c626bc2-5126-5440-8c3d-1d483e83da0e/0c626bc2-5126-5440-8c3d-1d483e83da0e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 556478,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/43466b51b27f4f63b19aa74601a788e6/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-02-27',
     'sanitized_make': 'ford',
     'seats_number': 2,
     'seller_name': None,
     'title': 'ford transit courier van 1.5 tdci 56kw trend',
     'transmission': 'manual',
     'trim': 'van 1.5 tdci 56kw trend',
     'vin': None,
     'year': 2020}
2026-01-27 20:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 0c626bc2-5126-5440-8c3d-1d483e83da0e spider: ayvens.es
2026-01-27 20:05:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0c626bc2-5126-5440-8c3d-1d483e83da0e due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco s', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'transit courier', 'trim': 'van 1.5 tdci 56kw trend', 'title': 'ford transit courier van 1.5 tdci 56kw trend', 'price': 0, 'odometer': 214027, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-27', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 112, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0c626bc2-5126-5440-8c3d-1d483e83da0e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c626bc2-5126-5440-8c3d-1d483e83da0e/0c626bc2-5126-5440-8c3d-1d483e83da0e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/43466b51b27f4f63b19aa74601a788e6/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 556478}], 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'ford transit courier', 'sanitized_make': 'ford', 'odometer_in_km': 214027}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 112,
     'color': 'blanco s',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '0c626bc2-5126-5440-8c3d-1d483e83da0e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford transit courier',
     'model': 'transit courier',
     'odometer': 214027,
     'odometer_in_km': 214027,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c626bc2-5126-5440-8c3d-1d483e83da0e/0c626bc2-5126-5440-8c3d-1d483e83da0e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 556478,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/43466b51b27f4f63b19aa74601a788e6/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-02-27',
     'sanitized_make': 'ford',
     'seats_number': 2,
     'seller_name': None,
     'title': 'ford transit courier van 1.5 tdci 56kw trend',
     'transmission': 'manual',
     'trim': 'van 1.5 tdci 56kw trend',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c626bc2-5126-5440-8c3d-1d483e83da0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 214027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c626bc2-5126-5440-8c3d-1d483e83da0e/0c626bc2-5126-5440-8c3d-1d483e83da0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/43466b51b27f4f63b19aa74601a788e6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875344%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Saving data for 1875344: {'created_time': 1769544317.427932, 'last_price_update_time': 1769544317.427944, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875344') HTTP/1.1" 204 0
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875350
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875350%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875350: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875350
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 with identifier: 1875350
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252Fefed2ea7270149779e71f684e44b31e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/efed2ea7270149779e71f684e44b31e1/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875351
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875351%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875351: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875351
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c with identifier: 1875351
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F514%252F018ad782a72e4d16aba1d1b5d26f5ba6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/514/018ad782a72e4d16aba1d1b5d26f5ba6/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875352
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875352%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875352: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875352
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9fc5bb3-0148-5c17-b282-0f63dba5deed with identifier: 1875352
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9fc5bb3-0148-5c17-b282-0f63dba5deed with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e9fc5bb3-0148-5c17-b282-0f63dba5deed
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F383%252Fedaf4a86b80a49f9b250a64354f57092%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/383/edaf4a86b80a49f9b250a64354f57092/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875353
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875353%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875353: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875353
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b23d0ae1-9050-5fa2-b7ee-70e686ed4115 with identifier: 1875353
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23d0ae1-9050-5fa2-b7ee-70e686ed4115 with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b23d0ae1-9050-5fa2-b7ee-70e686ed4115
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F331%252Fcb60b726e4294a418aca1df2ef3b9abd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/331/cb60b726e4294a418aca1df2ef3b9abd/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875354
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875354%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875354: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875354
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d14e3f-e527-59cd-9549-e50fa17922ad with identifier: 1875354
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d14e3f-e527-59cd-9549-e50fa17922ad with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3d14e3f-e527-59cd-9549-e50fa17922ad
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F270%252F1ba1969ac6a74d159efae80c9e4734ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/270/1ba1969ac6a74d159efae80c9e4734ed/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875355
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875355%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875355: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875355
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 with identifier: 1875355
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2db7acfc-1628-5b8f-8e05-ccb9db508fc7
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F099%252F323de6f708ab420ba6a898b6ea6ab0ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/099/323de6f708ab420ba6a898b6ea6ab0ad/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875356
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875356%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875356: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875356
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa4b2d8-c367-5698-aa8c-130cd4c55dcf with identifier: 1875356
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa4b2d8-c367-5698-aa8c-130cd4c55dcf with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afa4b2d8-c367-5698-aa8c-130cd4c55dcf
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F096%252F59b65b02960e441a953968477c09a60c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/096/59b65b02960e441a953968477c09a60c/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875357
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875357%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875357: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875357
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edb43840-dbe1-5abc-8811-dd1b8faf8256 with identifier: 1875357
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edb43840-dbe1-5abc-8811-dd1b8faf8256 with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item edb43840-dbe1-5abc-8811-dd1b8faf8256
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252F23a905a28b6f4d24a0d2f4a7ce0ae246%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/23a905a28b6f4d24a0d2f4a7ce0ae246/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/751/2c23c187001a4d0ab564b534221bf16f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/842/9e85def0f6ed4fc9b907c13c09ca37ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/efed2ea7270149779e71f684e44b31e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875358
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875358%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [ayvens.es] INFO: Scrape type for 1875358: 1
2026-01-27 20:05:17 [ayvens.es] INFO: Extracting data for car ID: 1875358
2026-01-27 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d with identifier: 1875358
2026-01-27 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d with scrape type 1
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F670%252Fc6dbc39739024761a213be75abe2f1b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/670/c6dbc39739024761a213be75abe2f1b5/images/large/1.jpg not downloaded yet
2026-01-27 20:05:17 [ayvens.es] INFO: Found listing with ID: 1875359
2026-01-27 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875359%27 HTTP/1.1" 200 None
2026-01-27 20:05:18 [ayvens.es] INFO: Scrape type for 1875359: 1
2026-01-27 20:05:18 [ayvens.es] INFO: Extracting data for car ID: 1875359
2026-01-27 20:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 with identifier: 1875359
2026-01-27 20:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 with scrape type 1
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252F575a5e8f222d4677bd47801018f27cc7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/575a5e8f222d4677bd47801018f27cc7/images/large/1.jpg not downloaded yet
2026-01-27 20:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/514/018ad782a72e4d16aba1d1b5d26f5ba6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/270/1ba1969ac6a74d159efae80c9e4734ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:18 [ayvens.es] INFO: Found listing with ID: 1875360
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875360%27 HTTP/1.1" 200 None
2026-01-27 20:05:18 [ayvens.es] INFO: Scrape type for 1875360: 1
2026-01-27 20:05:18 [ayvens.es] INFO: Extracting data for car ID: 1875360
2026-01-27 20:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61f536c9-ed07-531d-99db-cb825e7c53dd with identifier: 1875360
2026-01-27 20:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f536c9-ed07-531d-99db-cb825e7c53dd with scrape type 1
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 61f536c9-ed07-531d-99db-cb825e7c53dd
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F151%252F1c6ca9c6a55a432d9dc285a86568ed86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/151/1c6ca9c6a55a432d9dc285a86568ed86/images/large/1.jpg not downloaded yet
2026-01-27 20:05:18 [ayvens.es] INFO: Found listing with ID: 1875361
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875361%27 HTTP/1.1" 200 None
2026-01-27 20:05:18 [ayvens.es] INFO: Scrape type for 1875361: 1
2026-01-27 20:05:18 [ayvens.es] INFO: Extracting data for car ID: 1875361
2026-01-27 20:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54eae523-a0bd-59a7-81a2-28b874920924 with identifier: 1875361
2026-01-27 20:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54eae523-a0bd-59a7-81a2-28b874920924 with scrape type 1
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 54eae523-a0bd-59a7-81a2-28b874920924
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252F4a0492d6331e43b2a07a56db7ab3b379%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/4a0492d6331e43b2a07a56db7ab3b379/images/large/1.jpg not downloaded yet
2026-01-27 20:05:18 [ayvens.es] INFO: Found listing with ID: 1875362
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875362%27 HTTP/1.1" 200 None
2026-01-27 20:05:18 [ayvens.es] INFO: Scrape type for 1875362: 1
2026-01-27 20:05:18 [ayvens.es] INFO: Extracting data for car ID: 1875362
2026-01-27 20:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3398b042-6a0b-50c2-8482-4bc346541bf3 with identifier: 1875362
2026-01-27 20:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3398b042-6a0b-50c2-8482-4bc346541bf3 with scrape type 1
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3398b042-6a0b-50c2-8482-4bc346541bf3
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F734%252F7308de535f25491ba8ecc94f66ccf642%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/734/7308de535f25491ba8ecc94f66ccf642/images/large/1.jpg not downloaded yet
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570911290>
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cb2d802-236a-5222-b1a8-079ccc8cf263/2cb2d802-236a-5222-b1a8-079ccc8cf263_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F751%252F2c23c187001a4d0ab564b534221bf16f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/751/2c23c187001a4d0ab564b534221bf16f/images/large/1.jpg saved to cache
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cb2d802-236a-5222-b1a8-079ccc8cf263
2026-01-27 20:05:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cb2d802-236a-5222-b1a8-079ccc8cf263, skipping ID generation
2026-01-27 20:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb2d802-236a-5222-b1a8-079ccc8cf263 with scrape type 1
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2cb2d802-236a-5222-b1a8-079ccc8cf263 from tracking dictionaries
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cb2d802-236a-5222-b1a8-079ccc8cf263 sending to next pipeline
2026-01-27 20:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2cb2d802-236a-5222-b1a8-079ccc8cf263, identifier: 1875348
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d2f10>
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08696edd-72c9-5262-b4a9-8243be187e04/08696edd-72c9-5262-b4a9-8243be187e04_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F842%252F9e85def0f6ed4fc9b907c13c09ca37ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/842/9e85def0f6ed4fc9b907c13c09ca37ec/images/large/1.jpg saved to cache
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08696edd-72c9-5262-b4a9-8243be187e04
2026-01-27 20:05:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08696edd-72c9-5262-b4a9-8243be187e04, skipping ID generation
2026-01-27 20:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08696edd-72c9-5262-b4a9-8243be187e04 with scrape type 1
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08696edd-72c9-5262-b4a9-8243be187e04 from tracking dictionaries
2026-01-27 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08696edd-72c9-5262-b4a9-8243be187e04 sending to next pipeline
2026-01-27 20:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 08696edd-72c9-5262-b4a9-8243be187e04, identifier: 1875347
2026-01-27 20:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57093c950>
2026-01-27 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48eb1cb8-bf6c-50d0-a698-8d2ac0bca663/48eb1cb8-bf6c-50d0-a698-8d2ac0bca663_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252Fefed2ea7270149779e71f684e44b31e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/efed2ea7270149779e71f684e44b31e1/images/large/1.jpg saved to cache
2026-01-27 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663
2026-01-27 20:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663, skipping ID generation
2026-01-27 20:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 with scrape type 1
2026-01-27 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 from tracking dictionaries
2026-01-27 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 sending to next pipeline
2026-01-27 20:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663, identifier: 1875350
2026-01-27 20:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/383/edaf4a86b80a49f9b250a64354f57092/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2cb2d802-236a-5222-b1a8-079ccc8cf263 with identifier: 1875348
2026-01-27 20:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2cb2d802-236a-5222-b1a8-079ccc8cf263 with identifier: 1875348
2026-01-27 20:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-27 20:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2cb2d802-236a-5222-b1a8-079ccc8cf263 spider: ayvens.es
2026-01-27 20:05:19 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 2cb2d802-236a-5222-b1a8-079ccc8cf263 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2cb2d802-236a-5222-b1a8-079ccc8cf263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 119896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cb2d802-236a-5222-b1a8-079ccc8cf263/2cb2d802-236a-5222-b1a8-079ccc8cf263_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/751/2c23c187001a4d0ab564b534221bf16f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'transmission': 'manual',
 'trim': 'Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'vin': None,
 'year': 2018}
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875348%27 HTTP/1.1" 200 None
2026-01-27 20:05:19 [ayvens.es] INFO: Saving data for 1875348: {'created_time': 1769544319.776669, 'last_price_update_time': 1769544319.77668, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875348') HTTP/1.1" 204 0
2026-01-27 20:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 08696edd-72c9-5262-b4a9-8243be187e04 with identifier: 1875347
2026-01-27 20:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 08696edd-72c9-5262-b4a9-8243be187e04 with identifier: 1875347
2026-01-27 20:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'nv300' containing 'nv'
2026-01-27 20:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 08696edd-72c9-5262-b4a9-8243be187e04 spider: ayvens.es
2026-01-27 20:05:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 08696edd-72c9-5262-b4a9-8243be187e04 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'nv300' containing 'nv'
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '08696edd-72c9-5262-b4a9-8243be187e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV300',
 'odometer': 182467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08696edd-72c9-5262-b4a9-8243be187e04/08696edd-72c9-5262-b4a9-8243be187e04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/842/9e85def0f6ed4fc9b907c13c09ca37ec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV300 2.0dCi 88kW (120CV) L1H1 1T Comfort',
 'transmission': 'manual',
 'trim': '2.0dCi 88kW (120CV) L1H1 1T Comfort',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875347%27 HTTP/1.1" 200 None
2026-01-27 20:05:20 [ayvens.es] INFO: Saving data for 1875347: {'created_time': 1769544320.129154, 'last_price_update_time': 1769544320.129166, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875347') HTTP/1.1" 204 0
2026-01-27 20:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 with identifier: 1875350
2026-01-27 20:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 with identifier: 1875350
2026-01-27 20:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-27 20:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 spider: ayvens.es
2026-01-27 20:05:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 48eb1cb8-bf6c-50d0-a698-8d2ac0bca663 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '48eb1cb8-bf6c-50d0-a698-8d2ac0bca663',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 131468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48eb1cb8-bf6c-50d0-a698-8d2ac0bca663/48eb1cb8-bf6c-50d0-a698-8d2ac0bca663_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/efed2ea7270149779e71f684e44b31e1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Kombi 2.0 TDCI 96kW 320 L1 Trend',
 'transmission': 'manual',
 'trim': 'Kombi 2.0 TDCI 96kW 320 L1 Trend',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875350%27 HTTP/1.1" 200 None
2026-01-27 20:05:20 [ayvens.es] INFO: Saving data for 1875350: {'created_time': 1769544320.385071, 'last_price_update_time': 1769544320.385081, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875350') HTTP/1.1" 204 0
2026-01-27 20:05:20 [ayvens.es] INFO: Found listing with ID: 1875363
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875363%27 HTTP/1.1" 200 None
2026-01-27 20:05:20 [ayvens.es] INFO: Scrape type for 1875363: 1
2026-01-27 20:05:20 [ayvens.es] INFO: Extracting data for car ID: 1875363
2026-01-27 20:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 940ce5cc-a38f-5221-8653-2f35a2b4032f with identifier: 1875363
2026-01-27 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 940ce5cc-a38f-5221-8653-2f35a2b4032f with scrape type 1
2026-01-27 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 940ce5cc-a38f-5221-8653-2f35a2b4032f
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252F7a1476213c54434aa758601eed935b55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/7a1476213c54434aa758601eed935b55/images/large/1.jpg not downloaded yet
2026-01-27 20:05:20 [ayvens.es] INFO: Found listing with ID: 1875364
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875364%27 HTTP/1.1" 200 None
2026-01-27 20:05:20 [ayvens.es] INFO: Scrape type for 1875364: 1
2026-01-27 20:05:20 [ayvens.es] INFO: Extracting data for car ID: 1875364
2026-01-27 20:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44929abd-70bf-5631-ac70-8b56989b5c5e with identifier: 1875364
2026-01-27 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44929abd-70bf-5631-ac70-8b56989b5c5e with scrape type 1
2026-01-27 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 44929abd-70bf-5631-ac70-8b56989b5c5e
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F903%252F1f27f03b5d23438d933cc6037c1661b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/903/1f27f03b5d23438d933cc6037c1661b6/images/large/1.jpg not downloaded yet
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d3f50>
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c/e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F514%252F018ad782a72e4d16aba1d1b5d26f5ba6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/514/018ad782a72e4d16aba1d1b5d26f5ba6/images/large/1.jpg saved to cache
2026-01-27 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c
2026-01-27 20:05:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c, skipping ID generation
2026-01-27 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c with scrape type 1
2026-01-27 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c from tracking dictionaries
2026-01-27 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c sending to next pipeline
2026-01-27 20:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c, identifier: 1875351
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5721a64d0>
2026-01-27 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d14e3f-e527-59cd-9549-e50fa17922ad/d3d14e3f-e527-59cd-9549-e50fa17922ad_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F270%252F1ba1969ac6a74d159efae80c9e4734ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/270/1ba1969ac6a74d159efae80c9e4734ed/images/large/1.jpg saved to cache
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3d14e3f-e527-59cd-9549-e50fa17922ad
2026-01-27 20:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3d14e3f-e527-59cd-9549-e50fa17922ad, skipping ID generation
2026-01-27 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d14e3f-e527-59cd-9549-e50fa17922ad with scrape type 1
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d3d14e3f-e527-59cd-9549-e50fa17922ad from tracking dictionaries
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3d14e3f-e527-59cd-9549-e50fa17922ad sending to next pipeline
2026-01-27 20:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3d14e3f-e527-59cd-9549-e50fa17922ad, identifier: 1875354
2026-01-27 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5723f3ed0>
2026-01-27 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9fc5bb3-0148-5c17-b282-0f63dba5deed/e9fc5bb3-0148-5c17-b282-0f63dba5deed_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F383%252Fedaf4a86b80a49f9b250a64354f57092%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/383/edaf4a86b80a49f9b250a64354f57092/images/large/1.jpg saved to cache
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9fc5bb3-0148-5c17-b282-0f63dba5deed
2026-01-27 20:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9fc5bb3-0148-5c17-b282-0f63dba5deed, skipping ID generation
2026-01-27 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9fc5bb3-0148-5c17-b282-0f63dba5deed with scrape type 1
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e9fc5bb3-0148-5c17-b282-0f63dba5deed from tracking dictionaries
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9fc5bb3-0148-5c17-b282-0f63dba5deed sending to next pipeline
2026-01-27 20:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e9fc5bb3-0148-5c17-b282-0f63dba5deed, identifier: 1875352
2026-01-27 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/129/23a905a28b6f4d24a0d2f4a7ce0ae246/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:21 [ayvens.es] INFO: Found listing with ID: 1875365
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875365%27 HTTP/1.1" 200 None
2026-01-27 20:05:21 [ayvens.es] INFO: Scrape type for 1875365: 1
2026-01-27 20:05:21 [ayvens.es] INFO: Extracting data for car ID: 1875365
2026-01-27 20:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aec23561-7b41-5921-9732-04cc278d90de with identifier: 1875365
2026-01-27 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec23561-7b41-5921-9732-04cc278d90de with scrape type 1
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aec23561-7b41-5921-9732-04cc278d90de
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F171%252F66db1ecb1e764b56b0fc64fa58afdf23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/171/66db1ecb1e764b56b0fc64fa58afdf23/images/large/1.jpg not downloaded yet
2026-01-27 20:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c with identifier: 1875351
2026-01-27 20:05:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c with identifier: 1875351
2026-01-27 20:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-27 20:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c spider: ayvens.es
2026-01-27 20:05:21 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 167517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c/e856e4bf-0a98-56f5-ad1c-4e78f67d4f1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/514/018ad782a72e4d16aba1d1b5d26f5ba6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 70 kW(95 CV) '
          '-SS)+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875351%27 HTTP/1.1" 200 None
2026-01-27 20:05:21 [ayvens.es] INFO: Saving data for 1875351: {'created_time': 1769544321.991296, 'last_price_update_time': 1769544321.991309, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875351') HTTP/1.1" 204 0
2026-01-27 20:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3d14e3f-e527-59cd-9549-e50fa17922ad with identifier: 1875354
2026-01-27 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3d14e3f-e527-59cd-9549-e50fa17922ad with identifier: 1875354
2026-01-27 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-27 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d3d14e3f-e527-59cd-9549-e50fa17922ad spider: ayvens.es
2026-01-27 20:05:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: d3d14e3f-e527-59cd-9549-e50fa17922ad due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Banquise blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3d14e3f-e527-59cd-9549-e50fa17922ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 193580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d14e3f-e527-59cd-9549-e50fa17922ad/d3d14e3f-e527-59cd-9549-e50fa17922ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/270/1ba1969ac6a74d159efae80c9e4734ed/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Premium Long 1000kg BlueHDi 73kW+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Premium Long 1000kg BlueHDi 73kW+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875354%27 HTTP/1.1" 200 None
2026-01-27 20:05:22 [ayvens.es] INFO: Saving data for 1875354: {'created_time': 1769544322.220612, 'last_price_update_time': 1769544322.220623, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875354') HTTP/1.1" 204 0
2026-01-27 20:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e9fc5bb3-0148-5c17-b282-0f63dba5deed with identifier: 1875352
2026-01-27 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e9fc5bb3-0148-5c17-b282-0f63dba5deed with identifier: 1875352
2026-01-27 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-27 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e9fc5bb3-0148-5c17-b282-0f63dba5deed spider: ayvens.es
2026-01-27 20:05:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e9fc5bb3-0148-5c17-b282-0f63dba5deed due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9fc5bb3-0148-5c17-b282-0f63dba5deed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 97520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9fc5bb3-0148-5c17-b282-0f63dba5deed/e9fc5bb3-0148-5c17-b282-0f63dba5deed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/383/edaf4a86b80a49f9b250a64354f57092/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 70 kW(95 CV) '
          '-SS)+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875352%27 HTTP/1.1" 200 None
2026-01-27 20:05:22 [ayvens.es] INFO: Saving data for 1875352: {'created_time': 1769544322.473337, 'last_price_update_time': 1769544322.47335, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875352') HTTP/1.1" 204 0
2026-01-27 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/331/cb60b726e4294a418aca1df2ef3b9abd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/1f48fceedec34555a6cc72e6d6531e4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:22 [ayvens.es] INFO: Found listing with ID: 1875366
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875366%27 HTTP/1.1" 200 None
2026-01-27 20:05:22 [ayvens.es] INFO: Scrape type for 1875366: 1
2026-01-27 20:05:22 [ayvens.es] INFO: Extracting data for car ID: 1875366
2026-01-27 20:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 673de013-12d7-5cf6-910a-8f55e413b0db with identifier: 1875366
2026-01-27 20:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 673de013-12d7-5cf6-910a-8f55e413b0db with scrape type 1
2026-01-27 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 673de013-12d7-5cf6-910a-8f55e413b0db
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252Ff882b70c2ba84a72906b7c1b5d9499e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/f882b70c2ba84a72906b7c1b5d9499e2/images/large/1.jpg not downloaded yet
2026-01-27 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/096/59b65b02960e441a953968477c09a60c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/670/c6dbc39739024761a213be75abe2f1b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/099/323de6f708ab420ba6a898b6ea6ab0ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/940/575a5e8f222d4677bd47801018f27cc7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:22 [ayvens.es] INFO: Found listing with ID: 1875367
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875367%27 HTTP/1.1" 200 None
2026-01-27 20:05:22 [ayvens.es] INFO: Scrape type for 1875367: 1
2026-01-27 20:05:22 [ayvens.es] INFO: Extracting data for car ID: 1875367
2026-01-27 20:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5722f142-1315-5e56-b3f7-fdc811e87ef9 with identifier: 1875367
2026-01-27 20:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5722f142-1315-5e56-b3f7-fdc811e87ef9 with scrape type 1
2026-01-27 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5722f142-1315-5e56-b3f7-fdc811e87ef9
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F794%252F4549560a67ee4ffb852d69dfe0fa67f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/794/4549560a67ee4ffb852d69dfe0fa67f9/images/large/1.jpg not downloaded yet
2026-01-27 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57232d950>
2026-01-27 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edb43840-dbe1-5abc-8811-dd1b8faf8256/edb43840-dbe1-5abc-8811-dd1b8faf8256_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252F23a905a28b6f4d24a0d2f4a7ce0ae246%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/23a905a28b6f4d24a0d2f4a7ce0ae246/images/large/1.jpg saved to cache
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edb43840-dbe1-5abc-8811-dd1b8faf8256
2026-01-27 20:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edb43840-dbe1-5abc-8811-dd1b8faf8256, skipping ID generation
2026-01-27 20:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edb43840-dbe1-5abc-8811-dd1b8faf8256 with scrape type 1
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item edb43840-dbe1-5abc-8811-dd1b8faf8256 from tracking dictionaries
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edb43840-dbe1-5abc-8811-dd1b8faf8256 sending to next pipeline
2026-01-27 20:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: edb43840-dbe1-5abc-8811-dd1b8faf8256, identifier: 1875357
2026-01-27 20:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: edb43840-dbe1-5abc-8811-dd1b8faf8256 with identifier: 1875357
2026-01-27 20:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: edb43840-dbe1-5abc-8811-dd1b8faf8256 with identifier: 1875357
2026-01-27 20:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-27 20:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: edb43840-dbe1-5abc-8811-dd1b8faf8256 spider: ayvens.es
2026-01-27 20:05:23 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: edb43840-dbe1-5abc-8811-dd1b8faf8256 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'edb43840-dbe1-5abc-8811-dd1b8faf8256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 97605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb43840-dbe1-5abc-8811-dd1b8faf8256/edb43840-dbe1-5abc-8811-dd1b8faf8256_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/129/23a905a28b6f4d24a0d2f4a7ce0ae246/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 300 L2 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 300 L2 Trend',
 'vin': None,
 'year': 2022}
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875357%27 HTTP/1.1" 200 None
2026-01-27 20:05:23 [ayvens.es] INFO: Saving data for 1875357: {'created_time': 1769544323.487171, 'last_price_update_time': 1769544323.487182, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875357') HTTP/1.1" 204 0
2026-01-27 20:05:23 [ayvens.es] INFO: Found listing with ID: 1875368
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875368%27 HTTP/1.1" 200 None
2026-01-27 20:05:23 [ayvens.es] INFO: Scrape type for 1875368: 1
2026-01-27 20:05:23 [ayvens.es] INFO: Extracting data for car ID: 1875368
2026-01-27 20:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce963e1-7028-504d-91fa-e54e374d09d5 with identifier: 1875368
2026-01-27 20:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce963e1-7028-504d-91fa-e54e374d09d5 with scrape type 1
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bce963e1-7028-504d-91fa-e54e374d09d5
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F459%252Fc1fd9fb11ce148b7b0ed570d0558cfdc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/459/c1fd9fb11ce148b7b0ed570d0558cfdc/images/large/1.jpg not downloaded yet
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725c4c50>
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b23d0ae1-9050-5fa2-b7ee-70e686ed4115/b23d0ae1-9050-5fa2-b7ee-70e686ed4115_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F331%252Fcb60b726e4294a418aca1df2ef3b9abd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/331/cb60b726e4294a418aca1df2ef3b9abd/images/large/1.jpg saved to cache
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b23d0ae1-9050-5fa2-b7ee-70e686ed4115
2026-01-27 20:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b23d0ae1-9050-5fa2-b7ee-70e686ed4115, skipping ID generation
2026-01-27 20:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23d0ae1-9050-5fa2-b7ee-70e686ed4115 with scrape type 1
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b23d0ae1-9050-5fa2-b7ee-70e686ed4115 from tracking dictionaries
2026-01-27 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b23d0ae1-9050-5fa2-b7ee-70e686ed4115 sending to next pipeline
2026-01-27 20:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b23d0ae1-9050-5fa2-b7ee-70e686ed4115, identifier: 1875353
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57219a290>
2026-01-27 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54436c05-1604-5580-9111-91b52cbb0613/54436c05-1604-5580-9111-91b52cbb0613_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F1f48fceedec34555a6cc72e6d6531e4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/1f48fceedec34555a6cc72e6d6531e4c/images/large/1.jpg saved to cache
2026-01-27 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54436c05-1604-5580-9111-91b52cbb0613
2026-01-27 20:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54436c05-1604-5580-9111-91b52cbb0613, skipping ID generation
2026-01-27 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54436c05-1604-5580-9111-91b52cbb0613 with scrape type 1
2026-01-27 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 54436c05-1604-5580-9111-91b52cbb0613 from tracking dictionaries
2026-01-27 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54436c05-1604-5580-9111-91b52cbb0613 sending to next pipeline
2026-01-27 20:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 54436c05-1604-5580-9111-91b52cbb0613, identifier: 1875349
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a9d390>
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afa4b2d8-c367-5698-aa8c-130cd4c55dcf/afa4b2d8-c367-5698-aa8c-130cd4c55dcf_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F096%252F59b65b02960e441a953968477c09a60c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/096/59b65b02960e441a953968477c09a60c/images/large/1.jpg saved to cache
2026-01-27 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afa4b2d8-c367-5698-aa8c-130cd4c55dcf
2026-01-27 20:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afa4b2d8-c367-5698-aa8c-130cd4c55dcf, skipping ID generation
2026-01-27 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa4b2d8-c367-5698-aa8c-130cd4c55dcf with scrape type 1
2026-01-27 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item afa4b2d8-c367-5698-aa8c-130cd4c55dcf from tracking dictionaries
2026-01-27 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afa4b2d8-c367-5698-aa8c-130cd4c55dcf sending to next pipeline
2026-01-27 20:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: afa4b2d8-c367-5698-aa8c-130cd4c55dcf, identifier: 1875356
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57094ded0>
2026-01-27 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d/423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F670%252Fc6dbc39739024761a213be75abe2f1b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/670/c6dbc39739024761a213be75abe2f1b5/images/large/1.jpg saved to cache
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d
2026-01-27 20:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d, skipping ID generation
2026-01-27 20:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d with scrape type 1
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d from tracking dictionaries
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d sending to next pipeline
2026-01-27 20:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d, identifier: 1875358
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57230a550>
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2db7acfc-1628-5b8f-8e05-ccb9db508fc7/2db7acfc-1628-5b8f-8e05-ccb9db508fc7_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F099%252F323de6f708ab420ba6a898b6ea6ab0ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/099/323de6f708ab420ba6a898b6ea6ab0ad/images/large/1.jpg saved to cache
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2db7acfc-1628-5b8f-8e05-ccb9db508fc7
2026-01-27 20:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2db7acfc-1628-5b8f-8e05-ccb9db508fc7, skipping ID generation
2026-01-27 20:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 with scrape type 1
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 from tracking dictionaries
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 sending to next pipeline
2026-01-27 20:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2db7acfc-1628-5b8f-8e05-ccb9db508fc7, identifier: 1875355
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f5ac50>
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5/4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252F575a5e8f222d4677bd47801018f27cc7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/575a5e8f222d4677bd47801018f27cc7/images/large/1.jpg saved to cache
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5
2026-01-27 20:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5, skipping ID generation
2026-01-27 20:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 with scrape type 1
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 from tracking dictionaries
2026-01-27 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 sending to next pipeline
2026-01-27 20:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5, identifier: 1875359
2026-01-27 20:05:26 [ayvens.es] INFO: Found listing with ID: 1875369
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875369%27 HTTP/1.1" 200 None
2026-01-27 20:05:26 [ayvens.es] INFO: Scrape type for 1875369: 1
2026-01-27 20:05:26 [ayvens.es] INFO: Extracting data for car ID: 1875369
2026-01-27 20:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1e3ea41-3a70-5715-aad4-1101af51167e with identifier: 1875369
2026-01-27 20:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e3ea41-3a70-5715-aad4-1101af51167e with scrape type 1
2026-01-27 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a1e3ea41-3a70-5715-aad4-1101af51167e
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F497%252Fc52bfbbbc8854077ba1b2ff1a004b18c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/497/c52bfbbbc8854077ba1b2ff1a004b18c/images/large/1.jpg not downloaded yet
2026-01-27 20:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b23d0ae1-9050-5fa2-b7ee-70e686ed4115 with identifier: 1875353
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b23d0ae1-9050-5fa2-b7ee-70e686ed4115 with identifier: 1875353
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b23d0ae1-9050-5fa2-b7ee-70e686ed4115 spider: ayvens.es
2026-01-27 20:05:26 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b23d0ae1-9050-5fa2-b7ee-70e686ed4115 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Amarillo correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b23d0ae1-9050-5fa2-b7ee-70e686ed4115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 76083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b23d0ae1-9050-5fa2-b7ee-70e686ed4115/b23d0ae1-9050-5fa2-b7ee-70e686ed4115_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/331/cb60b726e4294a418aca1df2ef3b9abd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Maxi 2p dCi 66 kW (90 '
          'CV+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '(O) Profesional Maxi 2p dCi 66 kW (90 CV+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875353%27 HTTP/1.1" 200 None
2026-01-27 20:05:26 [ayvens.es] INFO: Saving data for 1875353: {'created_time': 1769544326.346286, 'last_price_update_time': 1769544326.346296, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875353') HTTP/1.1" 204 0
2026-01-27 20:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 54436c05-1604-5580-9111-91b52cbb0613 with identifier: 1875349
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 54436c05-1604-5580-9111-91b52cbb0613 with identifier: 1875349
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 54436c05-1604-5580-9111-91b52cbb0613 spider: ayvens.es
2026-01-27 20:05:26 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 54436c05-1604-5580-9111-91b52cbb0613 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '54436c05-1604-5580-9111-91b52cbb0613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 161087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54436c05-1604-5580-9111-91b52cbb0613/54436c05-1604-5580-9111-91b52cbb0613_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/1f48fceedec34555a6cc72e6d6531e4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Kombi 2.0 TDCI 96kW 320 L1 Trend',
 'transmission': 'manual',
 'trim': 'Kombi 2.0 TDCI 96kW 320 L1 Trend',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875349%27 HTTP/1.1" 200 None
2026-01-27 20:05:26 [ayvens.es] INFO: Saving data for 1875349: {'created_time': 1769544326.596062, 'last_price_update_time': 1769544326.596075, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875349') HTTP/1.1" 204 0
2026-01-27 20:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: afa4b2d8-c367-5698-aa8c-130cd4c55dcf with identifier: 1875356
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: afa4b2d8-c367-5698-aa8c-130cd4c55dcf with identifier: 1875356
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: afa4b2d8-c367-5698-aa8c-130cd4c55dcf spider: ayvens.es
2026-01-27 20:05:26 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: afa4b2d8-c367-5698-aa8c-130cd4c55dcf due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'afa4b2d8-c367-5698-aa8c-130cd4c55dcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 172023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa4b2d8-c367-5698-aa8c-130cd4c55dcf/afa4b2d8-c367-5698-aa8c-130cd4c55dcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/096/59b65b02960e441a953968477c09a60c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Compact dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional Compact dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875356%27 HTTP/1.1" 200 None
2026-01-27 20:05:26 [ayvens.es] INFO: Saving data for 1875356: {'created_time': 1769544326.83649, 'last_price_update_time': 1769544326.836504, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875356') HTTP/1.1" 204 0
2026-01-27 20:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d with identifier: 1875358
2026-01-27 20:05:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d with identifier: 1875358
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2026-01-27 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d spider: ayvens.es
2026-01-27 20:05:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 115283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d/423c683b-fd5a-581b-b3ae-2cc1e8a0fe0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/670/c6dbc39739024761a213be75abe2f1b5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 Energy BluedCi 88 kW',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 Energy BluedCi 88 kW',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875358%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [ayvens.es] INFO: Saving data for 1875358: {'created_time': 1769544327.100227, 'last_price_update_time': 1769544327.100238, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875358') HTTP/1.1" 204 0
2026-01-27 20:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 with identifier: 1875355
2026-01-27 20:05:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 with identifier: 1875355
2026-01-27 20:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-27 20:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 spider: ayvens.es
2026-01-27 20:05:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 2db7acfc-1628-5b8f-8e05-ccb9db508fc7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco blanquise',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2db7acfc-1628-5b8f-8e05-ccb9db508fc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 77225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2db7acfc-1628-5b8f-8e05-ccb9db508fc7/2db7acfc-1628-5b8f-8e05-ccb9db508fc7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/099/323de6f708ab420ba6a898b6ea6ab0ad/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875355%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [ayvens.es] INFO: Saving data for 1875355: {'created_time': 1769544327.357368, 'last_price_update_time': 1769544327.357378, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875355') HTTP/1.1" 204 0
2026-01-27 20:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 with identifier: 1875359
2026-01-27 20:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 with identifier: 1875359
2026-01-27 20:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-27 20:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 spider: ayvens.es
2026-01-27 20:05:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco jade',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 90770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5/4c1c8aa4-c081-5c21-a0d8-48bb1fa442c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/940/575a5e8f222d4677bd47801018f27cc7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 74kW (100CV) S Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 74kW (100CV) S Std Express',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875359%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [ayvens.es] INFO: Saving data for 1875359: {'created_time': 1769544327.613155, 'last_price_update_time': 1769544327.613165, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875359') HTTP/1.1" 204 0
2026-01-27 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/151/1c6ca9c6a55a432d9dc285a86568ed86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:27 [ayvens.es] INFO: Found listing with ID: 1875370
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875370%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [ayvens.es] INFO: Scrape type for 1875370: 1
2026-01-27 20:05:27 [ayvens.es] INFO: Extracting data for car ID: 1875370
2026-01-27 20:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cace6fec-0c47-5a34-89d8-814a74f1f599 with identifier: 1875370
2026-01-27 20:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cace6fec-0c47-5a34-89d8-814a74f1f599 with scrape type 1
2026-01-27 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cace6fec-0c47-5a34-89d8-814a74f1f599
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F526%252Ff18c4011ff664cbf9cf91b122668342c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/526/f18c4011ff664cbf9cf91b122668342c/images/large/1.jpg not downloaded yet
2026-01-27 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/903/1f27f03b5d23438d933cc6037c1661b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/171/66db1ecb1e764b56b0fc64fa58afdf23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:27 [ayvens.es] INFO: Found listing with ID: 1875371
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875371%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [ayvens.es] INFO: Scrape type for 1875371: 1
2026-01-27 20:05:27 [ayvens.es] INFO: Extracting data for car ID: 1875371
2026-01-27 20:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e512767a-82b9-5a2e-a910-5e9463a1123d with identifier: 1875371
2026-01-27 20:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e512767a-82b9-5a2e-a910-5e9463a1123d with scrape type 1
2026-01-27 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e512767a-82b9-5a2e-a910-5e9463a1123d
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F585%252F56108ce9d63e4c81b2690f3a869b6110%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/585/56108ce9d63e4c81b2690f3a869b6110/images/large/1.jpg not downloaded yet
2026-01-27 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/478/4a0492d6331e43b2a07a56db7ab3b379/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/734/7308de535f25491ba8ecc94f66ccf642/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/021/7a1476213c54434aa758601eed935b55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:27 [ayvens.es] INFO: Found listing with ID: 1875372
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875372%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [ayvens.es] INFO: Scrape type for 1875372: 1
2026-01-27 20:05:27 [ayvens.es] INFO: Extracting data for car ID: 1875372
2026-01-27 20:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ca1e2c-cc29-552e-9f68-e69f3351ab89 with identifier: 1875372
2026-01-27 20:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ca1e2c-cc29-552e-9f68-e69f3351ab89 with scrape type 1
2026-01-27 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2ca1e2c-cc29-552e-9f68-e69f3351ab89
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F510%252F07c39efd4abe45c2b1c52f0fad5dc7ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/510/07c39efd4abe45c2b1c52f0fad5dc7ab/images/large/1.jpg not downloaded yet
2026-01-27 20:05:27 [ayvens.es] INFO: Found listing with ID: 1875373
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875373%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [ayvens.es] INFO: Scrape type for 1875373: 1
2026-01-27 20:05:27 [ayvens.es] INFO: Extracting data for car ID: 1875373
2026-01-27 20:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a3ba499-d173-5a16-b02a-38c9d8d538d3 with identifier: 1875373
2026-01-27 20:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3ba499-d173-5a16-b02a-38c9d8d538d3 with scrape type 1
2026-01-27 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a3ba499-d173-5a16-b02a-38c9d8d538d3
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F227%252Fcead81b8cec2421c80a1c248ad93b6fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/227/cead81b8cec2421c80a1c248ad93b6fe/images/large/1.jpg not downloaded yet
2026-01-27 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/317/f882b70c2ba84a72906b7c1b5d9499e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572351210>
2026-01-27 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f536c9-ed07-531d-99db-cb825e7c53dd/61f536c9-ed07-531d-99db-cb825e7c53dd_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F151%252F1c6ca9c6a55a432d9dc285a86568ed86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/151/1c6ca9c6a55a432d9dc285a86568ed86/images/large/1.jpg saved to cache
2026-01-27 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61f536c9-ed07-531d-99db-cb825e7c53dd
2026-01-27 20:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61f536c9-ed07-531d-99db-cb825e7c53dd, skipping ID generation
2026-01-27 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f536c9-ed07-531d-99db-cb825e7c53dd with scrape type 1
2026-01-27 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 61f536c9-ed07-531d-99db-cb825e7c53dd from tracking dictionaries
2026-01-27 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61f536c9-ed07-531d-99db-cb825e7c53dd sending to next pipeline
2026-01-27 20:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 61f536c9-ed07-531d-99db-cb825e7c53dd, identifier: 1875360
2026-01-27 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/794/4549560a67ee4ffb852d69dfe0fa67f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:28 [ayvens.es] INFO: Found listing with ID: 1875374
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875374%27 HTTP/1.1" 200 None
2026-01-27 20:05:28 [ayvens.es] INFO: Scrape type for 1875374: 1
2026-01-27 20:05:28 [ayvens.es] INFO: Extracting data for car ID: 1875374
2026-01-27 20:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 with identifier: 1875374
2026-01-27 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 with scrape type 1
2026-01-27 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4f57162e-a88b-5e61-a8f9-978b83fd3fa6
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F694%252F368aac1d1c6346db85106075a48c4b7a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/694/368aac1d1c6346db85106075a48c4b7a/images/large/1.jpg not downloaded yet
2026-01-27 20:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 61f536c9-ed07-531d-99db-cb825e7c53dd with identifier: 1875360
2026-01-27 20:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 61f536c9-ed07-531d-99db-cb825e7c53dd with identifier: 1875360
2026-01-27 20:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-27 20:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 61f536c9-ed07-531d-99db-cb825e7c53dd spider: ayvens.es
2026-01-27 20:05:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 61f536c9-ed07-531d-99db-cb825e7c53dd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Rojo race',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '61f536c9-ed07-531d-99db-cb825e7c53dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 175906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f536c9-ed07-531d-99db-cb825e7c53dd/61f536c9-ed07-531d-99db-cb825e7c53dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/151/1c6ca9c6a55a432d9dc285a86568ed86/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 310 77kW L2H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '310 77kW L2H2 Van Trend FWD',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875360%27 HTTP/1.1" 200 None
2026-01-27 20:05:28 [ayvens.es] INFO: Saving data for 1875360: {'created_time': 1769544328.575591, 'last_price_update_time': 1769544328.575602, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875360') HTTP/1.1" 204 0
2026-01-27 20:05:28 [scrapy.extensions.logstats] INFO: Crawled 12 pages (at 8 pages/min), scraped 188 items (at 19 items/min)
2026-01-27 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57092dcd0>
2026-01-27 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44929abd-70bf-5631-ac70-8b56989b5c5e/44929abd-70bf-5631-ac70-8b56989b5c5e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F903%252F1f27f03b5d23438d933cc6037c1661b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/903/1f27f03b5d23438d933cc6037c1661b6/images/large/1.jpg saved to cache
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44929abd-70bf-5631-ac70-8b56989b5c5e
2026-01-27 20:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44929abd-70bf-5631-ac70-8b56989b5c5e, skipping ID generation
2026-01-27 20:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44929abd-70bf-5631-ac70-8b56989b5c5e with scrape type 1
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 44929abd-70bf-5631-ac70-8b56989b5c5e from tracking dictionaries
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44929abd-70bf-5631-ac70-8b56989b5c5e sending to next pipeline
2026-01-27 20:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 44929abd-70bf-5631-ac70-8b56989b5c5e, identifier: 1875364
2026-01-27 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722f3790>
2026-01-27 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec23561-7b41-5921-9732-04cc278d90de/aec23561-7b41-5921-9732-04cc278d90de_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F171%252F66db1ecb1e764b56b0fc64fa58afdf23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/171/66db1ecb1e764b56b0fc64fa58afdf23/images/large/1.jpg saved to cache
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aec23561-7b41-5921-9732-04cc278d90de
2026-01-27 20:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aec23561-7b41-5921-9732-04cc278d90de, skipping ID generation
2026-01-27 20:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec23561-7b41-5921-9732-04cc278d90de with scrape type 1
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aec23561-7b41-5921-9732-04cc278d90de from tracking dictionaries
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aec23561-7b41-5921-9732-04cc278d90de sending to next pipeline
2026-01-27 20:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aec23561-7b41-5921-9732-04cc278d90de, identifier: 1875365
2026-01-27 20:05:29 [ayvens.es] INFO: Found listing with ID: 1875375
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875375%27 HTTP/1.1" 200 None
2026-01-27 20:05:29 [ayvens.es] INFO: Scrape type for 1875375: 1
2026-01-27 20:05:29 [ayvens.es] INFO: Extracting data for car ID: 1875375
2026-01-27 20:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 with identifier: 1875375
2026-01-27 20:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 with scrape type 1
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252Fba7d3ae434a24e2f8af937ae180a793d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/ba7d3ae434a24e2f8af937ae180a793d/images/large/1.jpg not downloaded yet
2026-01-27 20:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 44929abd-70bf-5631-ac70-8b56989b5c5e with identifier: 1875364
2026-01-27 20:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 44929abd-70bf-5631-ac70-8b56989b5c5e with identifier: 1875364
2026-01-27 20:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 44929abd-70bf-5631-ac70-8b56989b5c5e spider: ayvens.es
2026-01-27 20:05:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 44929abd-70bf-5631-ac70-8b56989b5c5e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '44929abd-70bf-5631-ac70-8b56989b5c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 108938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44929abd-70bf-5631-ac70-8b56989b5c5e/44929abd-70bf-5631-ac70-8b56989b5c5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/903/1f27f03b5d23438d933cc6037c1661b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875364%27 HTTP/1.1" 200 None
2026-01-27 20:05:29 [ayvens.es] INFO: Saving data for 1875364: {'created_time': 1769544329.882832, 'last_price_update_time': 1769544329.882844, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875364') HTTP/1.1" 204 0
2026-01-27 20:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aec23561-7b41-5921-9732-04cc278d90de with identifier: 1875365
2026-01-27 20:05:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aec23561-7b41-5921-9732-04cc278d90de with identifier: 1875365
2026-01-27 20:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: aec23561-7b41-5921-9732-04cc278d90de spider: ayvens.es
2026-01-27 20:05:30 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: aec23561-7b41-5921-9732-04cc278d90de due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aec23561-7b41-5921-9732-04cc278d90de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 24850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec23561-7b41-5921-9732-04cc278d90de/aec23561-7b41-5921-9732-04cc278d90de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/171/66db1ecb1e764b56b0fc64fa58afdf23/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875365%27 HTTP/1.1" 200 None
2026-01-27 20:05:30 [ayvens.es] INFO: Saving data for 1875365: {'created_time': 1769544330.128218, 'last_price_update_time': 1769544330.128228, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875365') HTTP/1.1" 204 0
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5724fb750>
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54eae523-a0bd-59a7-81a2-28b874920924/54eae523-a0bd-59a7-81a2-28b874920924_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252F4a0492d6331e43b2a07a56db7ab3b379%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/4a0492d6331e43b2a07a56db7ab3b379/images/large/1.jpg saved to cache
2026-01-27 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54eae523-a0bd-59a7-81a2-28b874920924
2026-01-27 20:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54eae523-a0bd-59a7-81a2-28b874920924, skipping ID generation
2026-01-27 20:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54eae523-a0bd-59a7-81a2-28b874920924 with scrape type 1
2026-01-27 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 54eae523-a0bd-59a7-81a2-28b874920924 from tracking dictionaries
2026-01-27 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54eae523-a0bd-59a7-81a2-28b874920924 sending to next pipeline
2026-01-27 20:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 54eae523-a0bd-59a7-81a2-28b874920924, identifier: 1875361
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5727a1c90>
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3398b042-6a0b-50c2-8482-4bc346541bf3/3398b042-6a0b-50c2-8482-4bc346541bf3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F734%252F7308de535f25491ba8ecc94f66ccf642%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/734/7308de535f25491ba8ecc94f66ccf642/images/large/1.jpg saved to cache
2026-01-27 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3398b042-6a0b-50c2-8482-4bc346541bf3
2026-01-27 20:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3398b042-6a0b-50c2-8482-4bc346541bf3, skipping ID generation
2026-01-27 20:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3398b042-6a0b-50c2-8482-4bc346541bf3 with scrape type 1
2026-01-27 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3398b042-6a0b-50c2-8482-4bc346541bf3 from tracking dictionaries
2026-01-27 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3398b042-6a0b-50c2-8482-4bc346541bf3 sending to next pipeline
2026-01-27 20:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3398b042-6a0b-50c2-8482-4bc346541bf3, identifier: 1875362
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722f1b10>
2026-01-27 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_940ce5cc-a38f-5221-8653-2f35a2b4032f/940ce5cc-a38f-5221-8653-2f35a2b4032f_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252F7a1476213c54434aa758601eed935b55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/7a1476213c54434aa758601eed935b55/images/large/1.jpg saved to cache
2026-01-27 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 940ce5cc-a38f-5221-8653-2f35a2b4032f
2026-01-27 20:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 940ce5cc-a38f-5221-8653-2f35a2b4032f, skipping ID generation
2026-01-27 20:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 940ce5cc-a38f-5221-8653-2f35a2b4032f with scrape type 1
2026-01-27 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 940ce5cc-a38f-5221-8653-2f35a2b4032f from tracking dictionaries
2026-01-27 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 940ce5cc-a38f-5221-8653-2f35a2b4032f sending to next pipeline
2026-01-27 20:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 940ce5cc-a38f-5221-8653-2f35a2b4032f, identifier: 1875363
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a7ecd0>
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_673de013-12d7-5cf6-910a-8f55e413b0db/673de013-12d7-5cf6-910a-8f55e413b0db_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252Ff882b70c2ba84a72906b7c1b5d9499e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/f882b70c2ba84a72906b7c1b5d9499e2/images/large/1.jpg saved to cache
2026-01-27 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 673de013-12d7-5cf6-910a-8f55e413b0db
2026-01-27 20:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 673de013-12d7-5cf6-910a-8f55e413b0db, skipping ID generation
2026-01-27 20:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 673de013-12d7-5cf6-910a-8f55e413b0db with scrape type 1
2026-01-27 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 673de013-12d7-5cf6-910a-8f55e413b0db from tracking dictionaries
2026-01-27 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 673de013-12d7-5cf6-910a-8f55e413b0db sending to next pipeline
2026-01-27 20:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 673de013-12d7-5cf6-910a-8f55e413b0db, identifier: 1875366
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572341d50>
2026-01-27 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5722f142-1315-5e56-b3f7-fdc811e87ef9/5722f142-1315-5e56-b3f7-fdc811e87ef9_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F794%252F4549560a67ee4ffb852d69dfe0fa67f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/794/4549560a67ee4ffb852d69dfe0fa67f9/images/large/1.jpg saved to cache
2026-01-27 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5722f142-1315-5e56-b3f7-fdc811e87ef9
2026-01-27 20:05:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5722f142-1315-5e56-b3f7-fdc811e87ef9, skipping ID generation
2026-01-27 20:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5722f142-1315-5e56-b3f7-fdc811e87ef9 with scrape type 1
2026-01-27 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5722f142-1315-5e56-b3f7-fdc811e87ef9 from tracking dictionaries
2026-01-27 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5722f142-1315-5e56-b3f7-fdc811e87ef9 sending to next pipeline
2026-01-27 20:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5722f142-1315-5e56-b3f7-fdc811e87ef9, identifier: 1875367
2026-01-27 20:05:32 [ayvens.es] INFO: Found listing with ID: 1875376
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875376%27 HTTP/1.1" 200 None
2026-01-27 20:05:32 [ayvens.es] INFO: Scrape type for 1875376: 1
2026-01-27 20:05:32 [ayvens.es] INFO: Extracting data for car ID: 1875376
2026-01-27 20:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8649ab-d9e3-5346-9d7f-486688113c55 with identifier: 1875376
2026-01-27 20:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8649ab-d9e3-5346-9d7f-486688113c55 with scrape type 1
2026-01-27 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab8649ab-d9e3-5346-9d7f-486688113c55
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F599%252Fbee7f336db6b484482ead5876700fb4a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/599/bee7f336db6b484482ead5876700fb4a/images/large/1.jpg not downloaded yet
2026-01-27 20:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 54eae523-a0bd-59a7-81a2-28b874920924 with identifier: 1875361
2026-01-27 20:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 54eae523-a0bd-59a7-81a2-28b874920924 with identifier: 1875361
2026-01-27 20:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-27 20:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 54eae523-a0bd-59a7-81a2-28b874920924 spider: ayvens.es
2026-01-27 20:05:32 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 54eae523-a0bd-59a7-81a2-28b874920924 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '54eae523-a0bd-59a7-81a2-28b874920924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 111668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54eae523-a0bd-59a7-81a2-28b874920924/54eae523-a0bd-59a7-81a2-28b874920924_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/478/4a0492d6331e43b2a07a56db7ab3b379/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla M BlueHDi 70kW (95CV) Control',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 70kW (95CV) Control',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875361%27 HTTP/1.1" 200 None
2026-01-27 20:05:32 [ayvens.es] INFO: Saving data for 1875361: {'created_time': 1769544332.628156, 'last_price_update_time': 1769544332.628171, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875361') HTTP/1.1" 204 0
2026-01-27 20:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3398b042-6a0b-50c2-8482-4bc346541bf3 with identifier: 1875362
2026-01-27 20:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3398b042-6a0b-50c2-8482-4bc346541bf3 with identifier: 1875362
2026-01-27 20:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3398b042-6a0b-50c2-8482-4bc346541bf3 spider: ayvens.es
2026-01-27 20:05:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 3398b042-6a0b-50c2-8482-4bc346541bf3 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3398b042-6a0b-50c2-8482-4bc346541bf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 53400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3398b042-6a0b-50c2-8482-4bc346541bf3/3398b042-6a0b-50c2-8482-4bc346541bf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/734/7308de535f25491ba8ecc94f66ccf642/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875362%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [ayvens.es] INFO: Saving data for 1875362: {'created_time': 1769544333.034695, 'last_price_update_time': 1769544333.034708, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875362') HTTP/1.1" 204 0
2026-01-27 20:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 940ce5cc-a38f-5221-8653-2f35a2b4032f with identifier: 1875363
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 940ce5cc-a38f-5221-8653-2f35a2b4032f with identifier: 1875363
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 940ce5cc-a38f-5221-8653-2f35a2b4032f spider: ayvens.es
2026-01-27 20:05:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 940ce5cc-a38f-5221-8653-2f35a2b4032f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '940ce5cc-a38f-5221-8653-2f35a2b4032f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 34595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_940ce5cc-a38f-5221-8653-2f35a2b4032f/940ce5cc-a38f-5221-8653-2f35a2b4032f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/021/7a1476213c54434aa758601eed935b55/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875363%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [ayvens.es] INFO: Saving data for 1875363: {'created_time': 1769544333.313535, 'last_price_update_time': 1769544333.313549, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875363') HTTP/1.1" 204 0
2026-01-27 20:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 673de013-12d7-5cf6-910a-8f55e413b0db with identifier: 1875366
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 673de013-12d7-5cf6-910a-8f55e413b0db with identifier: 1875366
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 673de013-12d7-5cf6-910a-8f55e413b0db spider: ayvens.es
2026-01-27 20:05:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 673de013-12d7-5cf6-910a-8f55e413b0db due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '673de013-12d7-5cf6-910a-8f55e413b0db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 50259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673de013-12d7-5cf6-910a-8f55e413b0db/673de013-12d7-5cf6-910a-8f55e413b0db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/317/f882b70c2ba84a72906b7c1b5d9499e2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L2H1 Energy BluedCi 70 kW',
 'transmission': 'manual',
 'trim': 'Furgon 29 L2H1 Energy BluedCi 70 kW',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875366%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [ayvens.es] INFO: Saving data for 1875366: {'created_time': 1769544333.550356, 'last_price_update_time': 1769544333.550368, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875366') HTTP/1.1" 204 0
2026-01-27 20:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5722f142-1315-5e56-b3f7-fdc811e87ef9 with identifier: 1875367
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5722f142-1315-5e56-b3f7-fdc811e87ef9 with identifier: 1875367
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'nv200' containing 'nv'
2026-01-27 20:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5722f142-1315-5e56-b3f7-fdc811e87ef9 spider: ayvens.es
2026-01-27 20:05:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 5722f142-1315-5e56-b3f7-fdc811e87ef9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'nv200' containing 'nv'
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5722f142-1315-5e56-b3f7-fdc811e87ef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV200',
 'odometer': 105758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5722f142-1315-5e56-b3f7-fdc811e87ef9/5722f142-1315-5e56-b3f7-fdc811e87ef9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/794/4549560a67ee4ffb852d69dfe0fa67f9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'NISSAN NV200 1.5dCi 66kW (90CV) COMFORT Mam',
 'transmission': 'manual',
 'trim': '1.5dCi 66kW (90CV) COMFORT Mam',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875367%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [ayvens.es] INFO: Saving data for 1875367: {'created_time': 1769544333.804818, 'last_price_update_time': 1769544333.804829, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875367') HTTP/1.1" 204 0
2026-01-27 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/459/c1fd9fb11ce148b7b0ed570d0558cfdc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/526/f18c4011ff664cbf9cf91b122668342c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/497/c52bfbbbc8854077ba1b2ff1a004b18c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:33 [ayvens.es] INFO: Found listing with ID: 1875377
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875377%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [ayvens.es] INFO: Scrape type for 1875377: 1
2026-01-27 20:05:33 [ayvens.es] INFO: Extracting data for car ID: 1875377
2026-01-27 20:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb with identifier: 1875377
2026-01-27 20:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb with scrape type 1
2026-01-27 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Fcde038a5edb244c5a9280ce75a6533ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/cde038a5edb244c5a9280ce75a6533ff/images/large/1.jpg not downloaded yet
2026-01-27 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/510/07c39efd4abe45c2b1c52f0fad5dc7ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:33 [ayvens.es] INFO: Found listing with ID: 1875378
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875378%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [ayvens.es] INFO: Scrape type for 1875378: 1
2026-01-27 20:05:33 [ayvens.es] INFO: Extracting data for car ID: 1875378
2026-01-27 20:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 168298c7-2d2a-5dbe-b52c-ccb902e19492 with identifier: 1875378
2026-01-27 20:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 168298c7-2d2a-5dbe-b52c-ccb902e19492 with scrape type 1
2026-01-27 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 168298c7-2d2a-5dbe-b52c-ccb902e19492
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F858%252Fa13f6025b3fa44a69c7cfb737d51f79f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/858/a13f6025b3fa44a69c7cfb737d51f79f/images/large/1.jpg not downloaded yet
2026-01-27 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/585/56108ce9d63e4c81b2690f3a869b6110/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:33 [ayvens.es] INFO: Found listing with ID: 1875379
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875379%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [ayvens.es] INFO: Scrape type for 1875379: 1
2026-01-27 20:05:33 [ayvens.es] INFO: Extracting data for car ID: 1875379
2026-01-27 20:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63e0de89-efee-5e5d-9bbc-7d9f35767b35 with identifier: 1875379
2026-01-27 20:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e0de89-efee-5e5d-9bbc-7d9f35767b35 with scrape type 1
2026-01-27 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63e0de89-efee-5e5d-9bbc-7d9f35767b35
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F137%252F3d1a85e7a56a485197558235b5ae19e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/137/3d1a85e7a56a485197558235b5ae19e0/images/large/1.jpg not downloaded yet
2026-01-27 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/227/cead81b8cec2421c80a1c248ad93b6fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:33 [ayvens.es] INFO: Found listing with ID: 1875380
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875380%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [ayvens.es] INFO: Scrape type for 1875380: 1
2026-01-27 20:05:33 [ayvens.es] INFO: Extracting data for car ID: 1875380
2026-01-27 20:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe51e95e-30fe-54ec-be34-499a2d1f3c62 with identifier: 1875380
2026-01-27 20:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe51e95e-30fe-54ec-be34-499a2d1f3c62 with scrape type 1
2026-01-27 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fe51e95e-30fe-54ec-be34-499a2d1f3c62
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F584%252Fc1810646b6214516bacd33e49436d7c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/584/c1810646b6214516bacd33e49436d7c0/images/large/1.jpg not downloaded yet
2026-01-27 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/694/368aac1d1c6346db85106075a48c4b7a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f59ad0>
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce963e1-7028-504d-91fa-e54e374d09d5/bce963e1-7028-504d-91fa-e54e374d09d5_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F459%252Fc1fd9fb11ce148b7b0ed570d0558cfdc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/459/c1fd9fb11ce148b7b0ed570d0558cfdc/images/large/1.jpg saved to cache
2026-01-27 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bce963e1-7028-504d-91fa-e54e374d09d5
2026-01-27 20:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bce963e1-7028-504d-91fa-e54e374d09d5, skipping ID generation
2026-01-27 20:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce963e1-7028-504d-91fa-e54e374d09d5 with scrape type 1
2026-01-27 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bce963e1-7028-504d-91fa-e54e374d09d5 from tracking dictionaries
2026-01-27 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bce963e1-7028-504d-91fa-e54e374d09d5 sending to next pipeline
2026-01-27 20:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bce963e1-7028-504d-91fa-e54e374d09d5, identifier: 1875368
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57211e750>
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cace6fec-0c47-5a34-89d8-814a74f1f599/cace6fec-0c47-5a34-89d8-814a74f1f599_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F526%252Ff18c4011ff664cbf9cf91b122668342c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/526/f18c4011ff664cbf9cf91b122668342c/images/large/1.jpg saved to cache
2026-01-27 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cace6fec-0c47-5a34-89d8-814a74f1f599
2026-01-27 20:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cace6fec-0c47-5a34-89d8-814a74f1f599, skipping ID generation
2026-01-27 20:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cace6fec-0c47-5a34-89d8-814a74f1f599 with scrape type 1
2026-01-27 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cace6fec-0c47-5a34-89d8-814a74f1f599 from tracking dictionaries
2026-01-27 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cace6fec-0c47-5a34-89d8-814a74f1f599 sending to next pipeline
2026-01-27 20:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cace6fec-0c47-5a34-89d8-814a74f1f599, identifier: 1875370
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57257a0d0>
2026-01-27 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e3ea41-3a70-5715-aad4-1101af51167e/a1e3ea41-3a70-5715-aad4-1101af51167e_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F497%252Fc52bfbbbc8854077ba1b2ff1a004b18c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/497/c52bfbbbc8854077ba1b2ff1a004b18c/images/large/1.jpg saved to cache
2026-01-27 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1e3ea41-3a70-5715-aad4-1101af51167e
2026-01-27 20:05:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1e3ea41-3a70-5715-aad4-1101af51167e, skipping ID generation
2026-01-27 20:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e3ea41-3a70-5715-aad4-1101af51167e with scrape type 1
2026-01-27 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a1e3ea41-3a70-5715-aad4-1101af51167e from tracking dictionaries
2026-01-27 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1e3ea41-3a70-5715-aad4-1101af51167e sending to next pipeline
2026-01-27 20:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a1e3ea41-3a70-5715-aad4-1101af51167e, identifier: 1875369
2026-01-27 20:05:35 [ayvens.es] INFO: Found listing with ID: 1875381
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875381%27 HTTP/1.1" 200 None
2026-01-27 20:05:35 [ayvens.es] INFO: Scrape type for 1875381: 1
2026-01-27 20:05:35 [ayvens.es] INFO: Extracting data for car ID: 1875381
2026-01-27 20:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11b21b5f-b908-5ead-927e-9c55b4f5f492 with identifier: 1875381
2026-01-27 20:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11b21b5f-b908-5ead-927e-9c55b4f5f492 with scrape type 1
2026-01-27 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 11b21b5f-b908-5ead-927e-9c55b4f5f492
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F262%252Fad1d77410d054e479e1930357ede2d6f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/262/ad1d77410d054e479e1930357ede2d6f/images/large/1.jpg not downloaded yet
2026-01-27 20:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bce963e1-7028-504d-91fa-e54e374d09d5 with identifier: 1875368
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bce963e1-7028-504d-91fa-e54e374d09d5 with identifier: 1875368
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'navara' containing 'navara'
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bce963e1-7028-504d-91fa-e54e374d09d5 spider: ayvens.es
2026-01-27 20:05:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: bce963e1-7028-504d-91fa-e54e374d09d5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'navara' containing 'navara'
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bce963e1-7028-504d-91fa-e54e374d09d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NAVARA',
 'odometer': 126715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce963e1-7028-504d-91fa-e54e374d09d5/bce963e1-7028-504d-91fa-e54e374d09d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/459/c1fd9fb11ce148b7b0ed570d0558cfdc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN NAVARA D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'transmission': 'manual',
 'trim': 'D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875368%27 HTTP/1.1" 200 None
2026-01-27 20:05:35 [ayvens.es] INFO: Saving data for 1875368: {'created_time': 1769544335.527196, 'last_price_update_time': 1769544335.527207, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875368') HTTP/1.1" 204 0
2026-01-27 20:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cace6fec-0c47-5a34-89d8-814a74f1f599 with identifier: 1875370
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cace6fec-0c47-5a34-89d8-814a74f1f599 with identifier: 1875370
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cace6fec-0c47-5a34-89d8-814a74f1f599 spider: ayvens.es
2026-01-27 20:05:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: cace6fec-0c47-5a34-89d8-814a74f1f599 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cace6fec-0c47-5a34-89d8-814a74f1f599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 91649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cace6fec-0c47-5a34-89d8-814a74f1f599/cace6fec-0c47-5a34-89d8-814a74f1f599_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/526/f18c4011ff664cbf9cf91b122668342c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.0 EcoBoost 75kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.0 EcoBoost 75kW Trend',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875370%27 HTTP/1.1" 200 None
2026-01-27 20:05:35 [ayvens.es] INFO: Saving data for 1875370: {'created_time': 1769544335.755947, 'last_price_update_time': 1769544335.755961, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875370') HTTP/1.1" 204 0
2026-01-27 20:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a1e3ea41-3a70-5715-aad4-1101af51167e with identifier: 1875369
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a1e3ea41-3a70-5715-aad4-1101af51167e with identifier: 1875369
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-27 20:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a1e3ea41-3a70-5715-aad4-1101af51167e spider: ayvens.es
2026-01-27 20:05:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: a1e3ea41-3a70-5715-aad4-1101af51167e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a1e3ea41-3a70-5715-aad4-1101af51167e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 67197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e3ea41-3a70-5715-aad4-1101af51167e/a1e3ea41-3a70-5715-aad4-1101af51167e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/497/c52bfbbbc8854077ba1b2ff1a004b18c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.0 EcoBoost 75kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.0 EcoBoost 75kW Trend',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875369%27 HTTP/1.1" 200 None
2026-01-27 20:05:35 [ayvens.es] INFO: Saving data for 1875369: {'created_time': 1769544335.987311, 'last_price_update_time': 1769544335.987323, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875369') HTTP/1.1" 204 0
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57211e4d0>
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2ca1e2c-cc29-552e-9f68-e69f3351ab89/b2ca1e2c-cc29-552e-9f68-e69f3351ab89_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F510%252F07c39efd4abe45c2b1c52f0fad5dc7ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/510/07c39efd4abe45c2b1c52f0fad5dc7ab/images/large/1.jpg saved to cache
2026-01-27 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2ca1e2c-cc29-552e-9f68-e69f3351ab89
2026-01-27 20:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2ca1e2c-cc29-552e-9f68-e69f3351ab89, skipping ID generation
2026-01-27 20:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ca1e2c-cc29-552e-9f68-e69f3351ab89 with scrape type 1
2026-01-27 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2ca1e2c-cc29-552e-9f68-e69f3351ab89 from tracking dictionaries
2026-01-27 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2ca1e2c-cc29-552e-9f68-e69f3351ab89 sending to next pipeline
2026-01-27 20:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2ca1e2c-cc29-552e-9f68-e69f3351ab89, identifier: 1875372
2026-01-27 20:05:36 [ayvens.es] INFO: Found listing with ID: 1875382
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875382%27 HTTP/1.1" 200 None
2026-01-27 20:05:36 [ayvens.es] INFO: Scrape type for 1875382: 1
2026-01-27 20:05:36 [ayvens.es] INFO: Extracting data for car ID: 1875382
2026-01-27 20:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed46ebf8-3635-520f-b361-bbbcd6b001f4 with identifier: 1875382
2026-01-27 20:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed46ebf8-3635-520f-b361-bbbcd6b001f4 with scrape type 1
2026-01-27 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ed46ebf8-3635-520f-b361-bbbcd6b001f4
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F895%252Fea175d0651b042d3a7ebba7fc7b520a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/895/ea175d0651b042d3a7ebba7fc7b520a0/images/large/1.jpg not downloaded yet
2026-01-27 20:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2ca1e2c-cc29-552e-9f68-e69f3351ab89 with identifier: 1875372
2026-01-27 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2ca1e2c-cc29-552e-9f68-e69f3351ab89 with identifier: 1875372
2026-01-27 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b2ca1e2c-cc29-552e-9f68-e69f3351ab89 spider: ayvens.es
2026-01-27 20:05:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: b2ca1e2c-cc29-552e-9f68-e69f3351ab89 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2ca1e2c-cc29-552e-9f68-e69f3351ab89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 139645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ca1e2c-cc29-552e-9f68-e69f3351ab89/b2ca1e2c-cc29-552e-9f68-e69f3351ab89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/510/07c39efd4abe45c2b1c52f0fad5dc7ab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875372%27 HTTP/1.1" 200 None
2026-01-27 20:05:36 [ayvens.es] INFO: Saving data for 1875372: {'created_time': 1769544336.740879, 'last_price_update_time': 1769544336.740892, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875372') HTTP/1.1" 204 0
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725a3850>
2026-01-27 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e512767a-82b9-5a2e-a910-5e9463a1123d/e512767a-82b9-5a2e-a910-5e9463a1123d_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F585%252F56108ce9d63e4c81b2690f3a869b6110%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/585/56108ce9d63e4c81b2690f3a869b6110/images/large/1.jpg saved to cache
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e512767a-82b9-5a2e-a910-5e9463a1123d
2026-01-27 20:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e512767a-82b9-5a2e-a910-5e9463a1123d, skipping ID generation
2026-01-27 20:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e512767a-82b9-5a2e-a910-5e9463a1123d with scrape type 1
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e512767a-82b9-5a2e-a910-5e9463a1123d from tracking dictionaries
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e512767a-82b9-5a2e-a910-5e9463a1123d sending to next pipeline
2026-01-27 20:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e512767a-82b9-5a2e-a910-5e9463a1123d, identifier: 1875371
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725a36d0>
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a3ba499-d173-5a16-b02a-38c9d8d538d3/1a3ba499-d173-5a16-b02a-38c9d8d538d3_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F227%252Fcead81b8cec2421c80a1c248ad93b6fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/227/cead81b8cec2421c80a1c248ad93b6fe/images/large/1.jpg saved to cache
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a3ba499-d173-5a16-b02a-38c9d8d538d3
2026-01-27 20:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a3ba499-d173-5a16-b02a-38c9d8d538d3, skipping ID generation
2026-01-27 20:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3ba499-d173-5a16-b02a-38c9d8d538d3 with scrape type 1
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a3ba499-d173-5a16-b02a-38c9d8d538d3 from tracking dictionaries
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a3ba499-d173-5a16-b02a-38c9d8d538d3 sending to next pipeline
2026-01-27 20:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1a3ba499-d173-5a16-b02a-38c9d8d538d3, identifier: 1875373
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572478e90>
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f57162e-a88b-5e61-a8f9-978b83fd3fa6/4f57162e-a88b-5e61-a8f9-978b83fd3fa6_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F694%252F368aac1d1c6346db85106075a48c4b7a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/694/368aac1d1c6346db85106075a48c4b7a/images/large/1.jpg saved to cache
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f57162e-a88b-5e61-a8f9-978b83fd3fa6
2026-01-27 20:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f57162e-a88b-5e61-a8f9-978b83fd3fa6, skipping ID generation
2026-01-27 20:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 with scrape type 1
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 from tracking dictionaries
2026-01-27 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 sending to next pipeline
2026-01-27 20:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4f57162e-a88b-5e61-a8f9-978b83fd3fa6, identifier: 1875374
2026-01-27 20:05:38 [ayvens.es] INFO: Found listing with ID: 1875383
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875383%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [ayvens.es] INFO: Scrape type for 1875383: 1
2026-01-27 20:05:38 [ayvens.es] INFO: Extracting data for car ID: 1875383
2026-01-27 20:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 with identifier: 1875383
2026-01-27 20:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 with scrape type 1
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5aad7e0f-0e75-5ab9-8f35-26601ebe3506
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F549%252F2fc186aad7074511b36bd35af773c67a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/549/2fc186aad7074511b36bd35af773c67a/images/large/1.jpg not downloaded yet
2026-01-27 20:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e512767a-82b9-5a2e-a910-5e9463a1123d with identifier: 1875371
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e512767a-82b9-5a2e-a910-5e9463a1123d with identifier: 1875371
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e512767a-82b9-5a2e-a910-5e9463a1123d spider: ayvens.es
2026-01-27 20:05:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: e512767a-82b9-5a2e-a910-5e9463a1123d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e512767a-82b9-5a2e-a910-5e9463a1123d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 112802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e512767a-82b9-5a2e-a910-5e9463a1123d/e512767a-82b9-5a2e-a910-5e9463a1123d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/585/56108ce9d63e4c81b2690f3a869b6110/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875371%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [ayvens.es] INFO: Saving data for 1875371: {'created_time': 1769544338.307007, 'last_price_update_time': 1769544338.307019, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875371') HTTP/1.1" 204 0
2026-01-27 20:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1a3ba499-d173-5a16-b02a-38c9d8d538d3 with identifier: 1875373
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1a3ba499-d173-5a16-b02a-38c9d8d538d3 with identifier: 1875373
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1a3ba499-d173-5a16-b02a-38c9d8d538d3 spider: ayvens.es
2026-01-27 20:05:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1a3ba499-d173-5a16-b02a-38c9d8d538d3 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1a3ba499-d173-5a16-b02a-38c9d8d538d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 128191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a3ba499-d173-5a16-b02a-38c9d8d538d3/1a3ba499-d173-5a16-b02a-38c9d8d538d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/227/cead81b8cec2421c80a1c248ad93b6fe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 73kW CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 73kW CONTROL',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875373%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [ayvens.es] INFO: Saving data for 1875373: {'created_time': 1769544338.55965, 'last_price_update_time': 1769544338.559662, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875373') HTTP/1.1" 204 0
2026-01-27 20:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 with identifier: 1875374
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 with identifier: 1875374
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-27 20:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 spider: ayvens.es
2026-01-27 20:05:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 4f57162e-a88b-5e61-a8f9-978b83fd3fa6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4f57162e-a88b-5e61-a8f9-978b83fd3fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 126567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f57162e-a88b-5e61-a8f9-978b83fd3fa6/4f57162e-a88b-5e61-a8f9-978b83fd3fa6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/694/368aac1d1c6346db85106075a48c4b7a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER (E) 3.5T Heavy L3 BlueHDi 103kW (140CV)',
 'transmission': 'manual',
 'trim': '(E) 3.5T Heavy L3 BlueHDi 103kW (140CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875374%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [ayvens.es] INFO: Saving data for 1875374: {'created_time': 1769544338.788325, 'last_price_update_time': 1769544338.788369, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875374') HTTP/1.1" 204 0
2026-01-27 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/378/ba7d3ae434a24e2f8af937ae180a793d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:38 [ayvens.es] INFO: Found listing with ID: 1875384
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875384%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [ayvens.es] INFO: Scrape type for 1875384: 1
2026-01-27 20:05:38 [ayvens.es] INFO: Extracting data for car ID: 1875384
2026-01-27 20:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672922ac-1071-5dc8-85f2-aa360dd96d46 with identifier: 1875384
2026-01-27 20:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672922ac-1071-5dc8-85f2-aa360dd96d46 with scrape type 1
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 672922ac-1071-5dc8-85f2-aa360dd96d46
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F462%252Fc66905f9907c41a9bd92bb23b7dc13fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/462/c66905f9907c41a9bd92bb23b7dc13fd/images/large/1.jpg not downloaded yet
2026-01-27 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/567/cde038a5edb244c5a9280ce75a6533ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/599/bee7f336db6b484482ead5876700fb4a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:38 [ayvens.es] INFO: Found listing with ID: 1875385
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875385%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [ayvens.es] INFO: Scrape type for 1875385: 1
2026-01-27 20:05:38 [ayvens.es] INFO: Extracting data for car ID: 1875385
2026-01-27 20:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a1b0be5-3dae-5128-b636-ac3216eaa845 with identifier: 1875385
2026-01-27 20:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1b0be5-3dae-5128-b636-ac3216eaa845 with scrape type 1
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a1b0be5-3dae-5128-b636-ac3216eaa845
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F434%252Fa1d08097ecdf4600aead4ab0caf4f44c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/434/a1d08097ecdf4600aead4ab0caf4f44c/images/large/1.jpg not downloaded yet
2026-01-27 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/858/a13f6025b3fa44a69c7cfb737d51f79f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/584/c1810646b6214516bacd33e49436d7c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/137/3d1a85e7a56a485197558235b5ae19e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:38 [ayvens.es] INFO: Found listing with ID: 1875386
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875386%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [ayvens.es] INFO: Scrape type for 1875386: 1
2026-01-27 20:05:38 [ayvens.es] INFO: Extracting data for car ID: 1875386
2026-01-27 20:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab82f8ac-5d53-5f48-aea4-b6f7b14570dc with identifier: 1875386
2026-01-27 20:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab82f8ac-5d53-5f48-aea4-b6f7b14570dc with scrape type 1
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab82f8ac-5d53-5f48-aea4-b6f7b14570dc
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F306%252Fbbf68d7d7e19463ea7e76829cb543610%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/306/bbf68d7d7e19463ea7e76829cb543610/images/large/1.jpg not downloaded yet
2026-01-27 20:05:38 [ayvens.es] INFO: Found listing with ID: 1875387
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875387%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [ayvens.es] INFO: Scrape type for 1875387: 1
2026-01-27 20:05:38 [ayvens.es] INFO: Extracting data for car ID: 1875387
2026-01-27 20:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 with identifier: 1875387
2026-01-27 20:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 with scrape type 1
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af12cc3c-2186-5286-9b8a-a6cdcdbc86a4
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F391%252F3ad24074c2274fc691cb86dcae89194a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/391/3ad24074c2274fc691cb86dcae89194a/images/large/1.jpg not downloaded yet
2026-01-27 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722059d0>
2026-01-27 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae25f2b-5b5e-50ac-a172-9296c0da3ae9/7ae25f2b-5b5e-50ac-a172-9296c0da3ae9_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252Fba7d3ae434a24e2f8af937ae180a793d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/ba7d3ae434a24e2f8af937ae180a793d/images/large/1.jpg saved to cache
2026-01-27 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9
2026-01-27 20:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9, skipping ID generation
2026-01-27 20:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 with scrape type 1
2026-01-27 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 from tracking dictionaries
2026-01-27 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 sending to next pipeline
2026-01-27 20:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9, identifier: 1875375
2026-01-27 20:05:39 [ayvens.es] INFO: Found listing with ID: 1875388
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875388%27 HTTP/1.1" 200 None
2026-01-27 20:05:39 [ayvens.es] INFO: Scrape type for 1875388: 1
2026-01-27 20:05:39 [ayvens.es] INFO: Extracting data for car ID: 1875388
2026-01-27 20:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7241217a-cff6-54fe-84fc-a2a7f4a956bb with identifier: 1875388
2026-01-27 20:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7241217a-cff6-54fe-84fc-a2a7f4a956bb with scrape type 1
2026-01-27 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7241217a-cff6-54fe-84fc-a2a7f4a956bb
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F794%252F7eccb8bc9da14b2288f3df243cbc52b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/794/7eccb8bc9da14b2288f3df243cbc52b9/images/large/1.jpg not downloaded yet
2026-01-27 20:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 with identifier: 1875375
2026-01-27 20:05:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 with identifier: 1875375
2026-01-27 20:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-27 20:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 spider: ayvens.es
2026-01-27 20:05:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7ae25f2b-5b5e-50ac-a172-9296c0da3ae9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ae25f2b-5b5e-50ac-a172-9296c0da3ae9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CITAN',
 'odometer': 123525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae25f2b-5b5e-50ac-a172-9296c0da3ae9/7ae25f2b-5b5e-50ac-a172-9296c0da3ae9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/378/ba7d3ae434a24e2f8af937ae180a793d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CITAN 110 CDI 70kW Tourer Base Largo',
 'transmission': 'manual',
 'trim': '110 CDI 70kW Tourer Base Largo',
 'vin': None,
 'year': 2022}
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875375%27 HTTP/1.1" 200 None
2026-01-27 20:05:39 [ayvens.es] INFO: Saving data for 1875375: {'created_time': 1769544339.751892, 'last_price_update_time': 1769544339.751905, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875375') HTTP/1.1" 204 0
2026-01-27 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572204e90>
2026-01-27 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb/9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Fcde038a5edb244c5a9280ce75a6533ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/cde038a5edb244c5a9280ce75a6533ff/images/large/1.jpg saved to cache
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb
2026-01-27 20:05:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb, skipping ID generation
2026-01-27 20:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb with scrape type 1
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb from tracking dictionaries
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb sending to next pipeline
2026-01-27 20:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb, identifier: 1875377
2026-01-27 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a8e290>
2026-01-27 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab8649ab-d9e3-5346-9d7f-486688113c55/ab8649ab-d9e3-5346-9d7f-486688113c55_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F599%252Fbee7f336db6b484482ead5876700fb4a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/599/bee7f336db6b484482ead5876700fb4a/images/large/1.jpg saved to cache
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab8649ab-d9e3-5346-9d7f-486688113c55
2026-01-27 20:05:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab8649ab-d9e3-5346-9d7f-486688113c55, skipping ID generation
2026-01-27 20:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8649ab-d9e3-5346-9d7f-486688113c55 with scrape type 1
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ab8649ab-d9e3-5346-9d7f-486688113c55 from tracking dictionaries
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab8649ab-d9e3-5346-9d7f-486688113c55 sending to next pipeline
2026-01-27 20:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab8649ab-d9e3-5346-9d7f-486688113c55, identifier: 1875376
2026-01-27 20:05:40 [ayvens.es] INFO: Found listing with ID: 1875389
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875389%27 HTTP/1.1" 200 None
2026-01-27 20:05:40 [ayvens.es] INFO: Scrape type for 1875389: 1
2026-01-27 20:05:40 [ayvens.es] INFO: Extracting data for car ID: 1875389
2026-01-27 20:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfd1bab0-47f1-5e07-a4f2-75a179c97051 with identifier: 1875389
2026-01-27 20:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfd1bab0-47f1-5e07-a4f2-75a179c97051 with scrape type 1
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item cfd1bab0-47f1-5e07-a4f2-75a179c97051
2026-01-27 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item cfd1bab0-47f1-5e07-a4f2-75a179c97051
2026-01-27 20:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cfd1bab0-47f1-5e07-a4f2-75a179c97051, identifier: 1875389
2026-01-27 20:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb with identifier: 1875377
2026-01-27 20:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb with identifier: 1875377
2026-01-27 20:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-27 20:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb spider: ayvens.es
2026-01-27 20:05:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 85451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb/9ed9d9db-d62e-5d5a-b0b9-c6411b5e27fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/cde038a5edb244c5a9280ce75a6533ff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875377%27 HTTP/1.1" 200 None
2026-01-27 20:05:41 [ayvens.es] INFO: Saving data for 1875377: {'created_time': 1769544341.083505, 'last_price_update_time': 1769544341.083521, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875377') HTTP/1.1" 204 0
2026-01-27 20:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab8649ab-d9e3-5346-9d7f-486688113c55 with identifier: 1875376
2026-01-27 20:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab8649ab-d9e3-5346-9d7f-486688113c55 with identifier: 1875376
2026-01-27 20:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-27 20:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ab8649ab-d9e3-5346-9d7f-486688113c55 spider: ayvens.es
2026-01-27 20:05:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ab8649ab-d9e3-5346-9d7f-486688113c55 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab8649ab-d9e3-5346-9d7f-486688113c55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 169003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab8649ab-d9e3-5346-9d7f-486688113c55/ab8649ab-d9e3-5346-9d7f-486688113c55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/599/bee7f336db6b484482ead5876700fb4a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Premium 1.5 BlueHDi 100 Standard',
 'transmission': 'manual',
 'trim': 'Furgon Premium 1.5 BlueHDi 100 Standard',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875376%27 HTTP/1.1" 200 None
2026-01-27 20:05:41 [ayvens.es] INFO: Saving data for 1875376: {'created_time': 1769544341.362187, 'last_price_update_time': 1769544341.362199, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875376') HTTP/1.1" 204 0
2026-01-27 20:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cfd1bab0-47f1-5e07-a4f2-75a179c97051 with identifier: 1875389
2026-01-27 20:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cfd1bab0-47f1-5e07-a4f2-75a179c97051 with identifier: 1875389
2026-01-27 20:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-27 20:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cfd1bab0-47f1-5e07-a4f2-75a179c97051 spider: ayvens.es
2026-01-27 20:05:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: cfd1bab0-47f1-5e07-a4f2-75a179c97051 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cfd1bab0-47f1-5e07-a4f2-75a179c97051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 92125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER (E) 3.5T Heavy L3 BlueHDi 103kW (140CV)',
 'transmission': 'manual',
 'trim': '(E) 3.5T Heavy L3 BlueHDi 103kW (140CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875389%27 HTTP/1.1" 200 None
2026-01-27 20:05:41 [ayvens.es] INFO: Saving data for 1875389: {'created_time': 1769544341.725733, 'last_price_update_time': 1769544341.725743, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875389') HTTP/1.1" 204 0
2026-01-27 20:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572206310>
2026-01-27 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_168298c7-2d2a-5dbe-b52c-ccb902e19492/168298c7-2d2a-5dbe-b52c-ccb902e19492_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F858%252Fa13f6025b3fa44a69c7cfb737d51f79f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/858/a13f6025b3fa44a69c7cfb737d51f79f/images/large/1.jpg saved to cache
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 168298c7-2d2a-5dbe-b52c-ccb902e19492
2026-01-27 20:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 168298c7-2d2a-5dbe-b52c-ccb902e19492, skipping ID generation
2026-01-27 20:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 168298c7-2d2a-5dbe-b52c-ccb902e19492 with scrape type 1
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 168298c7-2d2a-5dbe-b52c-ccb902e19492 from tracking dictionaries
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 168298c7-2d2a-5dbe-b52c-ccb902e19492 sending to next pipeline
2026-01-27 20:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 168298c7-2d2a-5dbe-b52c-ccb902e19492, identifier: 1875378
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b5de90>
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe51e95e-30fe-54ec-be34-499a2d1f3c62/fe51e95e-30fe-54ec-be34-499a2d1f3c62_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F584%252Fc1810646b6214516bacd33e49436d7c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/584/c1810646b6214516bacd33e49436d7c0/images/large/1.jpg saved to cache
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe51e95e-30fe-54ec-be34-499a2d1f3c62
2026-01-27 20:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe51e95e-30fe-54ec-be34-499a2d1f3c62, skipping ID generation
2026-01-27 20:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe51e95e-30fe-54ec-be34-499a2d1f3c62 with scrape type 1
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fe51e95e-30fe-54ec-be34-499a2d1f3c62 from tracking dictionaries
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe51e95e-30fe-54ec-be34-499a2d1f3c62 sending to next pipeline
2026-01-27 20:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fe51e95e-30fe-54ec-be34-499a2d1f3c62, identifier: 1875380
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5725cee90>
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e0de89-efee-5e5d-9bbc-7d9f35767b35/63e0de89-efee-5e5d-9bbc-7d9f35767b35_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F137%252F3d1a85e7a56a485197558235b5ae19e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/137/3d1a85e7a56a485197558235b5ae19e0/images/large/1.jpg saved to cache
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63e0de89-efee-5e5d-9bbc-7d9f35767b35
2026-01-27 20:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63e0de89-efee-5e5d-9bbc-7d9f35767b35, skipping ID generation
2026-01-27 20:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e0de89-efee-5e5d-9bbc-7d9f35767b35 with scrape type 1
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 63e0de89-efee-5e5d-9bbc-7d9f35767b35 from tracking dictionaries
2026-01-27 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63e0de89-efee-5e5d-9bbc-7d9f35767b35 sending to next pipeline
2026-01-27 20:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 63e0de89-efee-5e5d-9bbc-7d9f35767b35, identifier: 1875379
2026-01-27 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/549/2fc186aad7074511b36bd35af773c67a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:43 [ayvens.es] INFO: Found listing with ID: 1875390
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875390%27 HTTP/1.1" 200 None
2026-01-27 20:05:43 [ayvens.es] INFO: Scrape type for 1875390: 1
2026-01-27 20:05:43 [ayvens.es] INFO: Extracting data for car ID: 1875390
2026-01-27 20:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c3811e-1a63-5d4e-a5af-665ab47b7866 with identifier: 1875390
2026-01-27 20:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c3811e-1a63-5d4e-a5af-665ab47b7866 with scrape type 1
2026-01-27 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26c3811e-1a63-5d4e-a5af-665ab47b7866
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252Fb939c70aa04b49b8bba8a3f4dde0cfe6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/b939c70aa04b49b8bba8a3f4dde0cfe6/images/large/1.jpg not downloaded yet
2026-01-27 20:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 168298c7-2d2a-5dbe-b52c-ccb902e19492 with identifier: 1875378
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 168298c7-2d2a-5dbe-b52c-ccb902e19492 with identifier: 1875378
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 168298c7-2d2a-5dbe-b52c-ccb902e19492 spider: ayvens.es
2026-01-27 20:05:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 168298c7-2d2a-5dbe-b52c-ccb902e19492 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '168298c7-2d2a-5dbe-b52c-ccb902e19492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 93006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168298c7-2d2a-5dbe-b52c-ccb902e19492/168298c7-2d2a-5dbe-b52c-ccb902e19492_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/858/a13f6025b3fa44a69c7cfb737d51f79f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Premium 1.5 BlueHDi 100 Standard',
 'transmission': 'manual',
 'trim': 'Furgon Premium 1.5 BlueHDi 100 Standard',
 'vin': None,
 'year': 2022}
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875378%27 HTTP/1.1" 200 None
2026-01-27 20:05:43 [ayvens.es] INFO: Saving data for 1875378: {'created_time': 1769544343.294787, 'last_price_update_time': 1769544343.294799, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875378') HTTP/1.1" 204 0
2026-01-27 20:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fe51e95e-30fe-54ec-be34-499a2d1f3c62 with identifier: 1875380
2026-01-27 20:05:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fe51e95e-30fe-54ec-be34-499a2d1f3c62 with identifier: 1875380
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fe51e95e-30fe-54ec-be34-499a2d1f3c62 spider: ayvens.es
2026-01-27 20:05:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: fe51e95e-30fe-54ec-be34-499a2d1f3c62 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco banquise s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe51e95e-30fe-54ec-be34-499a2d1f3c62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 140672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe51e95e-30fe-54ec-be34-499a2d1f3c62/fe51e95e-30fe-54ec-be34-499a2d1f3c62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/584/c1810646b6214516bacd33e49436d7c0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875380%27 HTTP/1.1" 200 None
2026-01-27 20:05:43 [ayvens.es] INFO: Saving data for 1875380: {'created_time': 1769544343.545556, 'last_price_update_time': 1769544343.545566, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875380') HTTP/1.1" 204 0
2026-01-27 20:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 63e0de89-efee-5e5d-9bbc-7d9f35767b35 with identifier: 1875379
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 63e0de89-efee-5e5d-9bbc-7d9f35767b35 with identifier: 1875379
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
2026-01-27 20:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 63e0de89-efee-5e5d-9bbc-7d9f35767b35 spider: ayvens.es
2026-01-27 20:05:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 63e0de89-efee-5e5d-9bbc-7d9f35767b35 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '63e0de89-efee-5e5d-9bbc-7d9f35767b35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 96851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e0de89-efee-5e5d-9bbc-7d9f35767b35/63e0de89-efee-5e5d-9bbc-7d9f35767b35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/137/3d1a85e7a56a485197558235b5ae19e0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'vin': None,
 'year': 2018}
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875379%27 HTTP/1.1" 200 None
2026-01-27 20:05:43 [ayvens.es] INFO: Saving data for 1875379: {'created_time': 1769544343.76709, 'last_price_update_time': 1769544343.767102, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875379') HTTP/1.1" 204 0
2026-01-27 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/462/c66905f9907c41a9bd92bb23b7dc13fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/262/ad1d77410d054e479e1930357ede2d6f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/895/ea175d0651b042d3a7ebba7fc7b520a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:43 [ayvens.es] INFO: Found listing with ID: 1875391
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875391%27 HTTP/1.1" 200 None
2026-01-27 20:05:43 [ayvens.es] INFO: Scrape type for 1875391: 1
2026-01-27 20:05:43 [ayvens.es] INFO: Extracting data for car ID: 1875391
2026-01-27 20:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd2ad23-15aa-59cd-892e-551a89fa35da with identifier: 1875391
2026-01-27 20:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd2ad23-15aa-59cd-892e-551a89fa35da with scrape type 1
2026-01-27 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0fd2ad23-15aa-59cd-892e-551a89fa35da
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F477%252Fa46ef7d14f3d4a1d8126985562febab0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-27 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/477/a46ef7d14f3d4a1d8126985562febab0/images/large/1.jpg not downloaded yet
2026-01-27 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/306/bbf68d7d7e19463ea7e76829cb543610/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff573e29690>
2026-01-27 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aad7e0f-0e75-5ab9-8f35-26601ebe3506/5aad7e0f-0e75-5ab9-8f35-26601ebe3506_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F549%252F2fc186aad7074511b36bd35af773c67a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/549/2fc186aad7074511b36bd35af773c67a/images/large/1.jpg saved to cache
2026-01-27 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5aad7e0f-0e75-5ab9-8f35-26601ebe3506
2026-01-27 20:05:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5aad7e0f-0e75-5ab9-8f35-26601ebe3506, skipping ID generation
2026-01-27 20:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 with scrape type 1
2026-01-27 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 from tracking dictionaries
2026-01-27 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 sending to next pipeline
2026-01-27 20:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5aad7e0f-0e75-5ab9-8f35-26601ebe3506, identifier: 1875383
2026-01-27 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/434/a1d08097ecdf4600aead4ab0caf4f44c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:44 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-01-27 20:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 with identifier: 1875383
2026-01-27 20:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 with identifier: 1875383
2026-01-27 20:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
2026-01-27 20:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 spider: ayvens.es
2026-01-27 20:05:44 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 5aad7e0f-0e75-5ab9-8f35-26601ebe3506 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5aad7e0f-0e75-5ab9-8f35-26601ebe3506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 186098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aad7e0f-0e75-5ab9-8f35-26601ebe3506/5aad7e0f-0e75-5ab9-8f35-26601ebe3506_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/549/2fc186aad7074511b36bd35af773c67a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Kombi 1.5 TDCi 74kW Trend 230 L2',
 'transmission': 'manual',
 'trim': 'Kombi 1.5 TDCi 74kW Trend 230 L2',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875383%27 HTTP/1.1" 200 None
2026-01-27 20:05:44 [ayvens.es] INFO: Saving data for 1875383: {'created_time': 1769544344.602566, 'last_price_update_time': 1769544344.602579, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875383') HTTP/1.1" 204 0
2026-01-27 20:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-27 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/391/3ad24074c2274fc691cb86dcae89194a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff573e5f290>
2026-01-27 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672922ac-1071-5dc8-85f2-aa360dd96d46/672922ac-1071-5dc8-85f2-aa360dd96d46_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F462%252Fc66905f9907c41a9bd92bb23b7dc13fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/462/c66905f9907c41a9bd92bb23b7dc13fd/images/large/1.jpg saved to cache
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 672922ac-1071-5dc8-85f2-aa360dd96d46
2026-01-27 20:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 672922ac-1071-5dc8-85f2-aa360dd96d46, skipping ID generation
2026-01-27 20:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672922ac-1071-5dc8-85f2-aa360dd96d46 with scrape type 1
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 672922ac-1071-5dc8-85f2-aa360dd96d46 from tracking dictionaries
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 672922ac-1071-5dc8-85f2-aa360dd96d46 sending to next pipeline
2026-01-27 20:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 672922ac-1071-5dc8-85f2-aa360dd96d46, identifier: 1875384
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff572408dd0>
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b21b5f-b908-5ead-927e-9c55b4f5f492/11b21b5f-b908-5ead-927e-9c55b4f5f492_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F262%252Fad1d77410d054e479e1930357ede2d6f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/262/ad1d77410d054e479e1930357ede2d6f/images/large/1.jpg saved to cache
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11b21b5f-b908-5ead-927e-9c55b4f5f492
2026-01-27 20:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11b21b5f-b908-5ead-927e-9c55b4f5f492, skipping ID generation
2026-01-27 20:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11b21b5f-b908-5ead-927e-9c55b4f5f492 with scrape type 1
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 11b21b5f-b908-5ead-927e-9c55b4f5f492 from tracking dictionaries
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11b21b5f-b908-5ead-927e-9c55b4f5f492 sending to next pipeline
2026-01-27 20:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 11b21b5f-b908-5ead-927e-9c55b4f5f492, identifier: 1875381
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570a92ed0>
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed46ebf8-3635-520f-b361-bbbcd6b001f4/ed46ebf8-3635-520f-b361-bbbcd6b001f4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F895%252Fea175d0651b042d3a7ebba7fc7b520a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/895/ea175d0651b042d3a7ebba7fc7b520a0/images/large/1.jpg saved to cache
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed46ebf8-3635-520f-b361-bbbcd6b001f4
2026-01-27 20:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed46ebf8-3635-520f-b361-bbbcd6b001f4, skipping ID generation
2026-01-27 20:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed46ebf8-3635-520f-b361-bbbcd6b001f4 with scrape type 1
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ed46ebf8-3635-520f-b361-bbbcd6b001f4 from tracking dictionaries
2026-01-27 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed46ebf8-3635-520f-b361-bbbcd6b001f4 sending to next pipeline
2026-01-27 20:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ed46ebf8-3635-520f-b361-bbbcd6b001f4, identifier: 1875382
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571f84250>
2026-01-27 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab82f8ac-5d53-5f48-aea4-b6f7b14570dc/ab82f8ac-5d53-5f48-aea4-b6f7b14570dc_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F306%252Fbbf68d7d7e19463ea7e76829cb543610%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/306/bbf68d7d7e19463ea7e76829cb543610/images/large/1.jpg saved to cache
2026-01-27 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab82f8ac-5d53-5f48-aea4-b6f7b14570dc
2026-01-27 20:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab82f8ac-5d53-5f48-aea4-b6f7b14570dc, skipping ID generation
2026-01-27 20:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab82f8ac-5d53-5f48-aea4-b6f7b14570dc with scrape type 1
2026-01-27 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ab82f8ac-5d53-5f48-aea4-b6f7b14570dc from tracking dictionaries
2026-01-27 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab82f8ac-5d53-5f48-aea4-b6f7b14570dc sending to next pipeline
2026-01-27 20:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab82f8ac-5d53-5f48-aea4-b6f7b14570dc, identifier: 1875386
2026-01-27 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff57236bd50>
2026-01-27 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1b0be5-3dae-5128-b636-ac3216eaa845/1a1b0be5-3dae-5128-b636-ac3216eaa845_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F434%252Fa1d08097ecdf4600aead4ab0caf4f44c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/434/a1d08097ecdf4600aead4ab0caf4f44c/images/large/1.jpg saved to cache
2026-01-27 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a1b0be5-3dae-5128-b636-ac3216eaa845
2026-01-27 20:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a1b0be5-3dae-5128-b636-ac3216eaa845, skipping ID generation
2026-01-27 20:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1b0be5-3dae-5128-b636-ac3216eaa845 with scrape type 1
2026-01-27 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a1b0be5-3dae-5128-b636-ac3216eaa845 from tracking dictionaries
2026-01-27 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a1b0be5-3dae-5128-b636-ac3216eaa845 sending to next pipeline
2026-01-27 20:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1a1b0be5-3dae-5128-b636-ac3216eaa845, identifier: 1875385
2026-01-27 20:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 672922ac-1071-5dc8-85f2-aa360dd96d46 with identifier: 1875384
2026-01-27 20:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 672922ac-1071-5dc8-85f2-aa360dd96d46 with identifier: 1875384
2026-01-27 20:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-27 20:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 672922ac-1071-5dc8-85f2-aa360dd96d46 spider: ayvens.es
2026-01-27 20:05:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 672922ac-1071-5dc8-85f2-aa360dd96d46 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '672922ac-1071-5dc8-85f2-aa360dd96d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 65682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672922ac-1071-5dc8-85f2-aa360dd96d46/672922ac-1071-5dc8-85f2-aa360dd96d46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/462/c66905f9907c41a9bd92bb23b7dc13fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875384%27 HTTP/1.1" 200 None
2026-01-27 20:05:47 [ayvens.es] INFO: Saving data for 1875384: {'created_time': 1769544347.021745, 'last_price_update_time': 1769544347.021756, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875384') HTTP/1.1" 204 0
2026-01-27 20:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 11b21b5f-b908-5ead-927e-9c55b4f5f492 with identifier: 1875381
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 11b21b5f-b908-5ead-927e-9c55b4f5f492 with identifier: 1875381
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 11b21b5f-b908-5ead-927e-9c55b4f5f492 spider: ayvens.es
2026-01-27 20:05:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 11b21b5f-b908-5ead-927e-9c55b4f5f492 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '11b21b5f-b908-5ead-927e-9c55b4f5f492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 106525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b21b5f-b908-5ead-927e-9c55b4f5f492/11b21b5f-b908-5ead-927e-9c55b4f5f492_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/262/ad1d77410d054e479e1930357ede2d6f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875381%27 HTTP/1.1" 200 None
2026-01-27 20:05:47 [ayvens.es] INFO: Saving data for 1875381: {'created_time': 1769544347.252798, 'last_price_update_time': 1769544347.252812, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875381') HTTP/1.1" 204 0
2026-01-27 20:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ed46ebf8-3635-520f-b361-bbbcd6b001f4 with identifier: 1875382
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ed46ebf8-3635-520f-b361-bbbcd6b001f4 with identifier: 1875382
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'kangoo', 'trim': 'profesional n1 energy dci 55kw (75cv)', 'title': 'renault kangoo profesional n1 energy dci 55kw (75cv)', 'price': 0, 'odometer': 231232, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-25', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 123, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ed46ebf8-3635-520f-b361-bbbcd6b001f4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed46ebf8-3635-520f-b361-bbbcd6b001f4/ed46ebf8-3635-520f-b361-bbbcd6b001f4_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/895/ea175d0651b042d3a7ebba7fc7b520a0/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 409483}], 'current_year_diff': 7, 'age_in_months': 76, 'make_model': 'renault kangoo', 'sanitized_make': 'renault', 'odometer_in_km': 231232}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 76,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'ed46ebf8-3635-520f-b361-bbbcd6b001f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault kangoo',
     'model': 'kangoo',
     'odometer': 231232,
     'odometer_in_km': 231232,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed46ebf8-3635-520f-b361-bbbcd6b001f4/ed46ebf8-3635-520f-b361-bbbcd6b001f4_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 409483,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/895/ea175d0651b042d3a7ebba7fc7b520a0/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-25',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kangoo profesional n1 energy dci 55kw (75cv)',
     'transmission': 'manual',
     'trim': 'profesional n1 energy dci 55kw (75cv)',
     'vin': None,
     'year': 2019}
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ed46ebf8-3635-520f-b361-bbbcd6b001f4 spider: ayvens.es
2026-01-27 20:05:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ed46ebf8-3635-520f-b361-bbbcd6b001f4 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanco', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'kangoo', 'trim': 'profesional n1 energy dci 55kw (75cv)', 'title': 'renault kangoo profesional n1 energy dci 55kw (75cv)', 'price': 0, 'odometer': 231232, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-25', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 123, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ed46ebf8-3635-520f-b361-bbbcd6b001f4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed46ebf8-3635-520f-b361-bbbcd6b001f4/ed46ebf8-3635-520f-b361-bbbcd6b001f4_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/895/ea175d0651b042d3a7ebba7fc7b520a0/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 409483}], 'current_year_diff': 7, 'age_in_months': 76, 'make_model': 'renault kangoo', 'sanitized_make': 'renault', 'odometer_in_km': 231232}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 76,
     'auction_title': '',
     'c_o_2_emission_value': 123,
     'color': 'blanco',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 4,
     'engine': '1.5l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': 'ed46ebf8-3635-520f-b361-bbbcd6b001f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault kangoo',
     'model': 'kangoo',
     'odometer': 231232,
     'odometer_in_km': 231232,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed46ebf8-3635-520f-b361-bbbcd6b001f4/ed46ebf8-3635-520f-b361-bbbcd6b001f4_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 409483,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/895/ea175d0651b042d3a7ebba7fc7b520a0/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-25',
     'sanitized_make': 'renault',
     'seats_number': 5,
     'seller_name': None,
     'title': 'renault kangoo profesional n1 energy dci 55kw (75cv)',
     'transmission': 'manual',
     'trim': 'profesional n1 energy dci 55kw (75cv)',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ed46ebf8-3635-520f-b361-bbbcd6b001f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 231232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed46ebf8-3635-520f-b361-bbbcd6b001f4/ed46ebf8-3635-520f-b361-bbbcd6b001f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/895/ea175d0651b042d3a7ebba7fc7b520a0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875382%27 HTTP/1.1" 200 None
2026-01-27 20:05:47 [ayvens.es] INFO: Saving data for 1875382: {'created_time': 1769544347.484877, 'last_price_update_time': 1769544347.484889, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875382') HTTP/1.1" 204 0
2026-01-27 20:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab82f8ac-5d53-5f48-aea4-b6f7b14570dc with identifier: 1875386
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab82f8ac-5d53-5f48-aea4-b6f7b14570dc with identifier: 1875386
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ab82f8ac-5d53-5f48-aea4-b6f7b14570dc spider: ayvens.es
2026-01-27 20:05:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: ab82f8ac-5d53-5f48-aea4-b6f7b14570dc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab82f8ac-5d53-5f48-aea4-b6f7b14570dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 62251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab82f8ac-5d53-5f48-aea4-b6f7b14570dc/ab82f8ac-5d53-5f48-aea4-b6f7b14570dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/306/bbf68d7d7e19463ea7e76829cb543610/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875386%27 HTTP/1.1" 200 None
2026-01-27 20:05:47 [ayvens.es] INFO: Saving data for 1875386: {'created_time': 1769544347.737915, 'last_price_update_time': 1769544347.737925, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875386') HTTP/1.1" 204 0
2026-01-27 20:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1a1b0be5-3dae-5128-b636-ac3216eaa845 with identifier: 1875385
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1a1b0be5-3dae-5128-b636-ac3216eaa845 with identifier: 1875385
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
2026-01-27 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1a1b0be5-3dae-5128-b636-ac3216eaa845 spider: ayvens.es
2026-01-27 20:05:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 1a1b0be5-3dae-5128-b636-ac3216eaa845 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1a1b0be5-3dae-5128-b636-ac3216eaa845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 125645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1b0be5-3dae-5128-b636-ac3216eaa845/1a1b0be5-3dae-5128-b636-ac3216eaa845_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/434/a1d08097ecdf4600aead4ab0caf4f44c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.0 EcoBoost 75kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.0 EcoBoost 75kW Trend',
 'vin': None,
 'year': 2021}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875385%27 HTTP/1.1" 200 None
2026-01-27 20:05:47 [ayvens.es] INFO: Saving data for 1875385: {'created_time': 1769544347.974333, 'last_price_update_time': 1769544347.974344, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875385') HTTP/1.1" 204 0
2026-01-27 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/794/7eccb8bc9da14b2288f3df243cbc52b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/170/b939c70aa04b49b8bba8a3f4dde0cfe6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff571b2a050>
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af12cc3c-2186-5286-9b8a-a6cdcdbc86a4/af12cc3c-2186-5286-9b8a-a6cdcdbc86a4_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F391%252F3ad24074c2274fc691cb86dcae89194a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/391/3ad24074c2274fc691cb86dcae89194a/images/large/1.jpg saved to cache
2026-01-27 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af12cc3c-2186-5286-9b8a-a6cdcdbc86a4
2026-01-27 20:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af12cc3c-2186-5286-9b8a-a6cdcdbc86a4, skipping ID generation
2026-01-27 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 with scrape type 1
2026-01-27 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 from tracking dictionaries
2026-01-27 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 sending to next pipeline
2026-01-27 20:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: af12cc3c-2186-5286-9b8a-a6cdcdbc86a4, identifier: 1875387
2026-01-27 20:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 with identifier: 1875387
2026-01-27 20:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 with identifier: 1875387
2026-01-27 20:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-27 20:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 spider: ayvens.es
2026-01-27 20:05:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: af12cc3c-2186-5286-9b8a-a6cdcdbc86a4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco jade',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'af12cc3c-2186-5286-9b8a-a6cdcdbc86a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 78368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af12cc3c-2186-5286-9b8a-a6cdcdbc86a4/af12cc3c-2186-5286-9b8a-a6cdcdbc86a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/391/3ad24074c2274fc691cb86dcae89194a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875387%27 HTTP/1.1" 200 None
2026-01-27 20:05:48 [ayvens.es] INFO: Saving data for 1875387: {'created_time': 1769544348.692264, 'last_price_update_time': 1769544348.692276, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875387') HTTP/1.1" 204 0
2026-01-27 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/477/a46ef7d14f3d4a1d8126985562febab0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5722a0910>
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7241217a-cff6-54fe-84fc-a2a7f4a956bb/7241217a-cff6-54fe-84fc-a2a7f4a956bb_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F794%252F7eccb8bc9da14b2288f3df243cbc52b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/794/7eccb8bc9da14b2288f3df243cbc52b9/images/large/1.jpg saved to cache
2026-01-27 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7241217a-cff6-54fe-84fc-a2a7f4a956bb
2026-01-27 20:05:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7241217a-cff6-54fe-84fc-a2a7f4a956bb, skipping ID generation
2026-01-27 20:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7241217a-cff6-54fe-84fc-a2a7f4a956bb with scrape type 1
2026-01-27 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7241217a-cff6-54fe-84fc-a2a7f4a956bb from tracking dictionaries
2026-01-27 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7241217a-cff6-54fe-84fc-a2a7f4a956bb sending to next pipeline
2026-01-27 20:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7241217a-cff6-54fe-84fc-a2a7f4a956bb, identifier: 1875388
2026-01-27 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff570935850>
2026-01-27 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26c3811e-1a63-5d4e-a5af-665ab47b7866/26c3811e-1a63-5d4e-a5af-665ab47b7866_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252Fb939c70aa04b49b8bba8a3f4dde0cfe6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/b939c70aa04b49b8bba8a3f4dde0cfe6/images/large/1.jpg saved to cache
2026-01-27 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26c3811e-1a63-5d4e-a5af-665ab47b7866
2026-01-27 20:05:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26c3811e-1a63-5d4e-a5af-665ab47b7866, skipping ID generation
2026-01-27 20:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c3811e-1a63-5d4e-a5af-665ab47b7866 with scrape type 1
2026-01-27 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 26c3811e-1a63-5d4e-a5af-665ab47b7866 from tracking dictionaries
2026-01-27 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26c3811e-1a63-5d4e-a5af-665ab47b7866 sending to next pipeline
2026-01-27 20:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 26c3811e-1a63-5d4e-a5af-665ab47b7866, identifier: 1875390
2026-01-27 20:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7241217a-cff6-54fe-84fc-a2a7f4a956bb with identifier: 1875388
2026-01-27 20:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7241217a-cff6-54fe-84fc-a2a7f4a956bb with identifier: 1875388
2026-01-27 20:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-27 20:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7241217a-cff6-54fe-84fc-a2a7f4a956bb spider: ayvens.es
2026-01-27 20:05:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 7241217a-cff6-54fe-84fc-a2a7f4a956bb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7241217a-cff6-54fe-84fc-a2a7f4a956bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 186189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7241217a-cff6-54fe-84fc-a2a7f4a956bb/7241217a-cff6-54fe-84fc-a2a7f4a956bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/794/7eccb8bc9da14b2288f3df243cbc52b9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Pro 1.5 BlueHDi 100 S&S Compact',
 'transmission': 'manual',
 'trim': 'Furgon Pro 1.5 BlueHDi 100 S&S Compact',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875388%27 HTTP/1.1" 200 None
2026-01-27 20:05:49 [ayvens.es] INFO: Saving data for 1875388: {'created_time': 1769544349.853071, 'last_price_update_time': 1769544349.853081, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875388') HTTP/1.1" 204 0
2026-01-27 20:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 26c3811e-1a63-5d4e-a5af-665ab47b7866 with identifier: 1875390
2026-01-27 20:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 26c3811e-1a63-5d4e-a5af-665ab47b7866 with identifier: 1875390
2026-01-27 20:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-27 20:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 26c3811e-1a63-5d4e-a5af-665ab47b7866 spider: ayvens.es
2026-01-27 20:05:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 26c3811e-1a63-5d4e-a5af-665ab47b7866 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '26c3811e-1a63-5d4e-a5af-665ab47b7866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 47953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26c3811e-1a63-5d4e-a5af-665ab47b7866/26c3811e-1a63-5d4e-a5af-665ab47b7866_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/170/b939c70aa04b49b8bba8a3f4dde0cfe6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875390%27 HTTP/1.1" 200 None
2026-01-27 20:05:50 [ayvens.es] INFO: Saving data for 1875390: {'created_time': 1769544350.084772, 'last_price_update_time': 1769544350.084782, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875390') HTTP/1.1" 204 0
2026-01-27 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-27 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-27 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-27 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff5708d7290>
2026-01-27 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-27 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd2ad23-15aa-59cd-892e-551a89fa35da/0fd2ad23-15aa-59cd-892e-551a89fa35da_image_0.jpg HTTP/1.1" 201 0
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F477%252Fa46ef7d14f3d4a1d8126985562febab0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-27 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/477/a46ef7d14f3d4a1d8126985562febab0/images/large/1.jpg saved to cache
2026-01-27 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fd2ad23-15aa-59cd-892e-551a89fa35da
2026-01-27 20:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fd2ad23-15aa-59cd-892e-551a89fa35da, skipping ID generation
2026-01-27 20:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd2ad23-15aa-59cd-892e-551a89fa35da with scrape type 1
2026-01-27 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0fd2ad23-15aa-59cd-892e-551a89fa35da from tracking dictionaries
2026-01-27 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fd2ad23-15aa-59cd-892e-551a89fa35da sending to next pipeline
2026-01-27 20:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0fd2ad23-15aa-59cd-892e-551a89fa35da, identifier: 1875391
2026-01-27 20:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0fd2ad23-15aa-59cd-892e-551a89fa35da with identifier: 1875391
2026-01-27 20:05:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-27 20:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0fd2ad23-15aa-59cd-892e-551a89fa35da with identifier: 1875391
2026-01-27 20:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'classic blanco s', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'toyota', 'model': 'hilux', 'trim': '2.4 d-4d cabina doble gx', 'title': 'toyota hilux 2.4 d-4d cabina doble gx', 'price': 0, 'odometer': 214202, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-26', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.4l', 'c_o_2_emission_value': 179, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0fd2ad23-15aa-59cd-892e-551a89fa35da', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd2ad23-15aa-59cd-892e-551a89fa35da/0fd2ad23-15aa-59cd-892e-551a89fa35da_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/477/a46ef7d14f3d4a1d8126985562febab0/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 337007}], 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'toyota hilux', 'sanitized_make': 'toyota', 'odometer_in_km': 214202}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 179,
     'color': 'classic blanco s',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 4,
     'engine': '2.4l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '0fd2ad23-15aa-59cd-892e-551a89fa35da',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'toyota',
     'make_model': 'toyota hilux',
     'model': 'hilux',
     'odometer': 214202,
     'odometer_in_km': 214202,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd2ad23-15aa-59cd-892e-551a89fa35da/0fd2ad23-15aa-59cd-892e-551a89fa35da_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 337007,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/477/a46ef7d14f3d4a1d8126985562febab0/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-26',
     'sanitized_make': 'toyota',
     'seats_number': 5,
     'seller_name': None,
     'title': 'toyota hilux 2.4 d-4d cabina doble gx',
     'transmission': 'manual',
     'trim': '2.4 d-4d cabina doble gx',
     'vin': None,
     'year': 2019}
2026-01-27 20:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 0fd2ad23-15aa-59cd-892e-551a89fa35da spider: ayvens.es
2026-01-27 20:05:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.es, Dropping listing: 0fd2ad23-15aa-59cd-892e-551a89fa35da due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'classic blanco s', 'original_photo_count': 1, 'seller_name': None, 'price_includes_vat': False, 'make': 'toyota', 'model': 'hilux', 'trim': '2.4 d-4d cabina doble gx', 'title': 'toyota hilux 2.4 d-4d cabina doble gx', 'price': 0, 'odometer': 214202, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-26', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118', 'expiration_date': '2026-01-28t12:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.4l', 'c_o_2_emission_value': 179, 'origin_country_code': 'es', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0fd2ad23-15aa-59cd-892e-551a89fa35da', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd2ad23-15aa-59cd-892e-551a89fa35da/0fd2ad23-15aa-59cd-892e-551a89fa35da_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/477/a46ef7d14f3d4a1d8126985562febab0/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 337007}], 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'toyota hilux', 'sanitized_make': 'toyota', 'odometer_in_km': 214202}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 179,
     'color': 'classic blanco s',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 4,
     'engine': '2.4l',
     'expiration_date': '2026-01-28t12:00:00z',
     'fuel_type': 'diesel',
     'id': '0fd2ad23-15aa-59cd-892e-551a89fa35da',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
     'listing': 'auction',
     'location': None,
     'make': 'toyota',
     'make_model': 'toyota hilux',
     'model': 'hilux',
     'odometer': 214202,
     'odometer_in_km': 214202,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 1,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd2ad23-15aa-59cd-892e-551a89fa35da/0fd2ad23-15aa-59cd-892e-551a89fa35da_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 337007,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/477/a46ef7d14f3d4a1d8126985562febab0/images/large/1.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-26',
     'sanitized_make': 'toyota',
     'seats_number': 5,
     'seller_name': None,
     'title': 'toyota hilux 2.4 d-4d cabina doble gx',
     'transmission': 'manual',
     'trim': '2.4 d-4d cabina doble gx',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Classic blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-01-28T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0fd2ad23-15aa-59cd-892e-551a89fa35da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39118',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 214202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd2ad23-15aa-59cd-892e-551a89fa35da/0fd2ad23-15aa-59cd-892e-551a89fa35da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/477/a46ef7d14f3d4a1d8126985562febab0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2019}
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271875391%27 HTTP/1.1" 200 None
2026-01-27 20:05:50 [ayvens.es] INFO: Saving data for 1875391: {'created_time': 1769544350.768941, 'last_price_update_time': 1769544350.768954, 'auction_closing_time': 1769601600.0}
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1875391') HTTP/1.1" 204 0
2026-01-27 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-27 20:05:51 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-27 20:05:51 [ayvens.es] INFO: ayvens.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 3, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20last_price_update_time%20lt%201769112351 HTTP/1.1" 200 None
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867368') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867369') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867370') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867371') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867372') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867373') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867374') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867375') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867376') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867377') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867378') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867379') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867380') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867381') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867382') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867383') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867384') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867385') HTTP/1.1" 204 0
2026-01-27 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867386') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867387') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867388') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867389') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867390') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867391') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867392') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867393') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867394') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867395') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867396') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867397') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867398') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867399') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867400') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867401') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867402') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867403') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867404') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867405') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867406') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867407') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867408') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867409') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867410') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867411') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867412') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867413') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867414') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867415') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867416') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867417') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867418') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867419') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867420') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867421') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867422') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867423') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867424') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867425') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867426') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867427') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867428') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867429') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867430') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867431') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867432') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867433') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867434') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867435') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867436') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867437') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867438') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867439') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867440') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867441') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867442') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867443') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867444') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867445') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867446') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867447') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867448') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867449') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867450') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867451') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867452') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867453') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867454') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867455') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867456') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867457') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867458') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867459') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867460') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867461') HTTP/1.1" 204 0
2026-01-27 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867462') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867463') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867464') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867465') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867466') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867467') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867468') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867469') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867470') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867471') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867472') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867473') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867474') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867475') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867476') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867477') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867478') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867479') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867480') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867481') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867482') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867483') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867484') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867485') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867486') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867487') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867488') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867489') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867490') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867491') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867492') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867493') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867494') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867495') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867496') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867497') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867498') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867499') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867500') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867501') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867502') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867503') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867504') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867505') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867506') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867507') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867508') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867509') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867510') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867511') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867512') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867513') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867514') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867515') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867516') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867517') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867518') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867519') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867520') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867521') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867522') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867523') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867524') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867525') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867526') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867527') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867528') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867529') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867530') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867531') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867532') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867533') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867534') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867535') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867536') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867537') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867538') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867539') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867540') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867541') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867542') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867543') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867544') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867545') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867546') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867547') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867548') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867549') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867550') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867551') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867552') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867553') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867554') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867555') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867556') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867557') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867558') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867559') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867560') HTTP/1.1" 204 0
2026-01-27 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867561') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867562') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867563') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867564') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867565') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867566') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867567') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867568') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867569') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867570') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867571') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867572') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867573') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867574') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867575') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867576') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867577') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867578') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867579') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867580') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867581') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867582') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867583') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867584') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867585') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867586') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867587') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867588') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867589') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867590') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867591') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867592') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867593') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867594') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867595') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867596') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867597') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867598') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867599') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867600') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867601') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867602') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867603') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867604') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867605') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867606') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867607') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867608') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867609') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867610') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867611') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867612') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867613') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867614') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867615') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867616') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867617') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867618') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867619') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867620') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867621') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867622') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867623') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867624') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867625') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867626') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867627') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867628') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867629') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867630') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867631') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867632') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867633') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867634') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867635') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867636') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867637') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867638') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867639') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867640') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867641') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867642') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867643') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867644') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867645') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867646') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867647') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867648') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867649') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867650') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867651') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867652') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867653') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867654') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867655') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867656') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867657') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867658') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867659') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867660') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867661') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867662') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867663') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867664') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867665') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867666') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867667') HTTP/1.1" 204 0
2026-01-27 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867668') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867669') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867670') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867671') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867672') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867673') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867674') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867675') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867676') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867677') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867678') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867679') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867680') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867681') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867682') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867683') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867684') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867685') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867686') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867687') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867688') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867689') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867690') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867691') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867692') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867693') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867694') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867695') HTTP/1.1" 204 0
2026-01-27 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.es',RowKey='1867696') HTTP/1.1" 204 0
2026-01-27 20:05:55 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (188 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.es/task_54_2026-01-27T20_00_00.jl
2026-01-27 20:05:55 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 4,
 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 4,
 'downloader/request_bytes': 166715,
 'downloader/request_count': 349,
 'downloader/request_method_count/GET': 344,
 'downloader/request_method_count/POST': 5,
 'downloader/response_bytes': 143789704,
 'downloader/response_count': 345,
 'downloader/response_status_count/200': 345,
 'elapsed_time_seconds': 327.306394,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 27, 20, 5, 55, 239631, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 157,
 'item_dropped_reasons_count/DropItem': 157,
 'item_scraped_count': 188,
 'log_count/DEBUG': 7056,
 'log_count/ERROR': 1,
 'log_count/INFO': 8313,
 'memusage/max': 188174336,
 'memusage/startup': 126894080,
 'photo_download_count': 339,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 129,
 'playwright/request_count/aborted': 13,
 'playwright/request_count/method/GET': 125,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 25,
 'playwright/request_count/resource_type/script': 79,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 114,
 'playwright/response_count/method/GET': 111,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 12,
 'playwright/response_count/resource_type/script': 79,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 3,
 'request_depth_max': 5,
 'response_received_count': 6,
 'scheduler/dequeued': 349,
 'scheduler/dequeued/memory': 349,
 'scheduler/enqueued': 349,
 'scheduler/enqueued/memory': 349,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 5,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 7.012361797876656,
 'scrapy-zyte-api/mean_response_seconds': 7.017654476128518,
 'scrapy-zyte-api/processed': 5,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 5,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 5,
 'scrapy-zyte-api/request_args/httpRequestBody': 5,
 'scrapy-zyte-api/request_args/httpRequestMethod': 5,
 'scrapy-zyte-api/request_args/httpResponseBody': 5,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 5,
 'scrapy-zyte-api/request_args/url': 5,
 'scrapy-zyte-api/status_codes/200': 5,
 'scrapy-zyte-api/success': 5,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 27, 20, 0, 27, 933237, tzinfo=datetime.timezone.utc)}
2026-01-27 20:05:55 [scrapy.core.engine] INFO: Spider closed (finished)