2026-03-27 13:30:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 13:30:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 13:30:04 [ayvens.es] INFO: Starting spider ayvens.es
2026-03-27 13:30:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 13:30:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 13:30:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 13:30:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 13:30:04 [scrapy.extensions.telnet] INFO: Telnet Password: 88685f5f37486eef
2026-03-27 13:30:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 13:30:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.es/task_38_2026-03-27T13_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 13:30:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 13:30:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 13:30:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 13:30:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 13:30:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 13:30:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 13:30:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 13:30:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-27 13:30:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 13:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 13:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-27 13:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-27 13:30:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 13:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 13:30:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 13:30:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 13:30:05 [scrapy.core.engine] INFO: Spider opened
2026-03-27 13:30:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 13:30:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 13:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-27 13:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-27 13:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-27 13:30:10 [scrapy-playwright] INFO: Launching browser firefox
2026-03-27 13:30:10 [scrapy-playwright] INFO: Browser firefox launched
2026-03-27 13:30:10 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-27 13:30:11 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-27 13:30:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 13:30:11 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 13:30:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-27 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-27 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-27 13:30:17 [ayvens.es] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'UvA1XjZat4c+5iEidKKnqJ|2026-03-27T13:30:15.808Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806154215, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'GYm0zbI2MZTopORIhuweS+|1774618217539|1774618217539', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774620017, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-27 13:30:17 [ayvens.es] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'UvA1XjZat4c+5iEidKKnqJ|2026-03-27T13:30:15.808Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'GYm0zbI2MZTopORIhuweS+|1774618217539|1774618217539', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-27 13:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-27 13:30:17 [ayvens.es] INFO: Intercepting token...
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 13:30:17 [ayvens.es] INFO: Scrolling element to trigger lazy load...
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-27 13:30:17 [ayvens.es] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-27 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-27 13:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-27 13:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-27 13:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-27 13:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-27 13:30:19 [ayvens.es] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-27 13:30:19 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-27 13:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 13:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-27 13:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-27 13:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 13:30:25 [ayvens.es] INFO: Found listing with ID: 1986564
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986564%27 HTTP/1.1" 200 None
2026-03-27 13:30:25 [ayvens.es] INFO: Scrape type for 1986564: 1
2026-03-27 13:30:25 [ayvens.es] INFO: Extracting data for car ID: 1986564
2026-03-27 13:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590c5d01-49fc-582a-ab77-c03884a81e34 with identifier: 1986564
2026-03-27 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590c5d01-49fc-582a-ab77-c03884a81e34 with scrape type 1
2026-03-27 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 590c5d01-49fc-582a-ab77-c03884a81e34
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F935%252Fdbcb3052c0cb4a4aa78762b40c8820ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/935/dbcb3052c0cb4a4aa78762b40c8820ed/images/large/1.jpg not downloaded yet
2026-03-27 13:30:25 [ayvens.es] INFO: Found listing with ID: 1986565
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986565%27 HTTP/1.1" 200 None
2026-03-27 13:30:25 [ayvens.es] INFO: Scrape type for 1986565: 1
2026-03-27 13:30:25 [ayvens.es] INFO: Extracting data for car ID: 1986565
2026-03-27 13:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7490e233-4c38-57e9-9124-5c5e8e635a5d with identifier: 1986565
2026-03-27 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7490e233-4c38-57e9-9124-5c5e8e635a5d with scrape type 1
2026-03-27 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7490e233-4c38-57e9-9124-5c5e8e635a5d
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F741%252F735da36af98e47428dbdd2c5e84485c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/741/735da36af98e47428dbdd2c5e84485c3/images/large/1.jpg not downloaded yet
2026-03-27 13:30:25 [ayvens.es] INFO: Found listing with ID: 1986566
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986566%27 HTTP/1.1" 200 None
2026-03-27 13:30:25 [ayvens.es] INFO: Scrape type for 1986566: 1
2026-03-27 13:30:25 [ayvens.es] INFO: Extracting data for car ID: 1986566
2026-03-27 13:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af26bb18-6a14-5f0f-9d7c-382122ebad96 with identifier: 1986566
2026-03-27 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af26bb18-6a14-5f0f-9d7c-382122ebad96 with scrape type 1
2026-03-27 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af26bb18-6a14-5f0f-9d7c-382122ebad96
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252Ff7e307acf14244e0802f2691aadf4efa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/f7e307acf14244e0802f2691aadf4efa/images/large/1.jpg not downloaded yet
2026-03-27 13:30:25 [ayvens.es] INFO: Found listing with ID: 1986567
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986567%27 HTTP/1.1" 200 None
2026-03-27 13:30:25 [ayvens.es] INFO: Scrape type for 1986567: 1
2026-03-27 13:30:25 [ayvens.es] INFO: Extracting data for car ID: 1986567
2026-03-27 13:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221294ac-7579-56cd-81f8-bec708739866 with identifier: 1986567
2026-03-27 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221294ac-7579-56cd-81f8-bec708739866 with scrape type 1
2026-03-27 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 221294ac-7579-56cd-81f8-bec708739866
2026-03-27 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 221294ac-7579-56cd-81f8-bec708739866
2026-03-27 13:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 221294ac-7579-56cd-81f8-bec708739866, identifier: 1986567
2026-03-27 13:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 221294ac-7579-56cd-81f8-bec708739866 with identifier: 1986567
2026-03-27 13:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 221294ac-7579-56cd-81f8-bec708739866 with identifier: 1986567
2026-03-27 13:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 221294ac-7579-56cd-81f8-bec708739866 with identifier: 1986567 to the API
2026-03-27 13:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '221294ac-7579-56cd-81f8-bec708739866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 38426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986567%27 HTTP/1.1" 200 None
2026-03-27 13:30:28 [ayvens.es] INFO: Saving data for 1986567: {'created_time': 1774618228.428868, 'last_price_update_time': 1774618228.42888, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986567') HTTP/1.1" 204 0
2026-03-27 13:30:28 [ayvens.es] INFO: Found listing with ID: 1986568
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986568%27 HTTP/1.1" 200 None
2026-03-27 13:30:28 [ayvens.es] INFO: Scrape type for 1986568: 1
2026-03-27 13:30:28 [ayvens.es] INFO: Extracting data for car ID: 1986568
2026-03-27 13:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7da8baf5-b2a5-5acf-b760-6e2ee523f000 with identifier: 1986568
2026-03-27 13:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7da8baf5-b2a5-5acf-b760-6e2ee523f000 with scrape type 1
2026-03-27 13:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7da8baf5-b2a5-5acf-b760-6e2ee523f000
2026-03-27 13:30:28 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7da8baf5-b2a5-5acf-b760-6e2ee523f000
2026-03-27 13:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7da8baf5-b2a5-5acf-b760-6e2ee523f000, identifier: 1986568
2026-03-27 13:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7da8baf5-b2a5-5acf-b760-6e2ee523f000 with identifier: 1986568
2026-03-27 13:30:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7da8baf5-b2a5-5acf-b760-6e2ee523f000 with identifier: 1986568
2026-03-27 13:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7da8baf5-b2a5-5acf-b760-6e2ee523f000 with identifier: 1986568 to the API
2026-03-27 13:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blancos',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7da8baf5-b2a5-5acf-b760-6e2ee523f000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 162661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'transmission': 'manual',
 'trim': 'Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'vin': None,
 'year': 2018}
2026-03-27 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986568%27 HTTP/1.1" 200 None
2026-03-27 13:30:29 [ayvens.es] INFO: Saving data for 1986568: {'created_time': 1774618229.993629, 'last_price_update_time': 1774618229.99364, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986568') HTTP/1.1" 204 0
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986569
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986569%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Scrape type for 1986569: 1
2026-03-27 13:30:30 [ayvens.es] INFO: Extracting data for car ID: 1986569
2026-03-27 13:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ace7ef5e-e37b-5f81-9967-269cce2bedc8 with identifier: 1986569
2026-03-27 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace7ef5e-e37b-5f81-9967-269cce2bedc8 with scrape type 1
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ace7ef5e-e37b-5f81-9967-269cce2bedc8
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252Fe4008782b0374ccd903df9a1142efc78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/e4008782b0374ccd903df9a1142efc78/images/large/1.jpg not downloaded yet
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986570
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986570%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Scrape type for 1986570: 1
2026-03-27 13:30:30 [ayvens.es] INFO: Extracting data for car ID: 1986570
2026-03-27 13:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209f7aa8-f955-5811-a591-f47bcaebab76 with identifier: 1986570
2026-03-27 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209f7aa8-f955-5811-a591-f47bcaebab76 with scrape type 1
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 209f7aa8-f955-5811-a591-f47bcaebab76
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F475%252F001968b2cc204c5189def4cac8ebd06a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/475/001968b2cc204c5189def4cac8ebd06a/images/large/1.jpg not downloaded yet
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986571
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986571%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Scrape type for 1986571: 1
2026-03-27 13:30:30 [ayvens.es] INFO: Extracting data for car ID: 1986571
2026-03-27 13:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with identifier: 1986571
2026-03-27 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with scrape type 1
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F550%252F99bdb8a10dfa40fa8e0497652c633d51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/550/99bdb8a10dfa40fa8e0497652c633d51/images/large/1.jpg not downloaded yet
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986572
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986572%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Scrape type for 1986572: 1
2026-03-27 13:30:30 [ayvens.es] INFO: Extracting data for car ID: 1986572
2026-03-27 13:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with identifier: 1986572
2026-03-27 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with scrape type 1
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F477%252F077a19e8dcce4f258ca71ee26462c0c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/477/077a19e8dcce4f258ca71ee26462c0c8/images/large/1.jpg not downloaded yet
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986573
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986573%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Scrape type for 1986573: 1
2026-03-27 13:30:30 [ayvens.es] INFO: Extracting data for car ID: 1986573
2026-03-27 13:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with identifier: 1986573
2026-03-27 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with scrape type 1
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F553%252F7c5547a2697d4b408adb33ef908a1a48%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/553/7c5547a2697d4b408adb33ef908a1a48/images/large/1.jpg not downloaded yet
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986574
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986574%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Scrape type for 1986574: 1
2026-03-27 13:30:30 [ayvens.es] INFO: Extracting data for car ID: 1986574
2026-03-27 13:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcd2d1f1-0316-54cb-b41d-8e112e2654c6 with identifier: 1986574
2026-03-27 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcd2d1f1-0316-54cb-b41d-8e112e2654c6 with scrape type 1
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bcd2d1f1-0316-54cb-b41d-8e112e2654c6
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F254%252F78ebc9a369b847909a61877968435a9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/254/78ebc9a369b847909a61877968435a9d/images/large/1.jpg not downloaded yet
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986575
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986575%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Scrape type for 1986575: 1
2026-03-27 13:30:30 [ayvens.es] INFO: Extracting data for car ID: 1986575
2026-03-27 13:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 918d684e-5151-5690-8273-d765ac446c54 with identifier: 1986575
2026-03-27 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 918d684e-5151-5690-8273-d765ac446c54 with scrape type 1
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 918d684e-5151-5690-8273-d765ac446c54
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F392%252Fb2d51ddabff34acd8e816b56318de8db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/392/b2d51ddabff34acd8e816b56318de8db/images/large/1.jpg not downloaded yet
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986576
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986576%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Scrape type for 1986576: 1
2026-03-27 13:30:30 [ayvens.es] INFO: Extracting data for car ID: 1986576
2026-03-27 13:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c02b31-09d9-5a36-afc6-534d0edda49c with identifier: 1986576
2026-03-27 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c02b31-09d9-5a36-afc6-534d0edda49c with scrape type 1
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 39c02b31-09d9-5a36-afc6-534d0edda49c
2026-03-27 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 39c02b31-09d9-5a36-afc6-534d0edda49c
2026-03-27 13:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 39c02b31-09d9-5a36-afc6-534d0edda49c, identifier: 1986576
2026-03-27 13:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 39c02b31-09d9-5a36-afc6-534d0edda49c with identifier: 1986576
2026-03-27 13:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 39c02b31-09d9-5a36-afc6-534d0edda49c with identifier: 1986576
2026-03-27 13:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 39c02b31-09d9-5a36-afc6-534d0edda49c with identifier: 1986576 to the API
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '39c02b31-09d9-5a36-afc6-534d0edda49c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 64750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon BlueHDi 120 S&S 6v Standard',
 'transmission': 'manual',
 'trim': 'Furgon BlueHDi 120 S&S 6v Standard',
 'vin': None,
 'year': 2023}
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986576%27 HTTP/1.1" 200 None
2026-03-27 13:30:30 [ayvens.es] INFO: Saving data for 1986576: {'created_time': 1774618230.868319, 'last_price_update_time': 1774618230.868331, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986576') HTTP/1.1" 204 0
2026-03-27 13:30:30 [ayvens.es] INFO: Found listing with ID: 1986577
2026-03-27 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986577%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [ayvens.es] INFO: Scrape type for 1986577: 1
2026-03-27 13:30:31 [ayvens.es] INFO: Extracting data for car ID: 1986577
2026-03-27 13:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2447010-84d0-5561-a25e-00a18d45f99a with identifier: 1986577
2026-03-27 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2447010-84d0-5561-a25e-00a18d45f99a with scrape type 1
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c2447010-84d0-5561-a25e-00a18d45f99a
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F982%252F50eb8b92b4d542a3adfe3cf2ac6fea5d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/982/50eb8b92b4d542a3adfe3cf2ac6fea5d/images/large/1.jpg not downloaded yet
2026-03-27 13:30:31 [ayvens.es] INFO: Found listing with ID: 1986578
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986578%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [ayvens.es] INFO: Scrape type for 1986578: 1
2026-03-27 13:30:31 [ayvens.es] INFO: Extracting data for car ID: 1986578
2026-03-27 13:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with identifier: 1986578
2026-03-27 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with scrape type 1
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F96a9a48fe8fb435988e3f968f76acfa2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/96a9a48fe8fb435988e3f968f76acfa2/images/large/1.jpg not downloaded yet
2026-03-27 13:30:31 [ayvens.es] INFO: Found listing with ID: 1986579
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986579%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [ayvens.es] INFO: Scrape type for 1986579: 1
2026-03-27 13:30:31 [ayvens.es] INFO: Extracting data for car ID: 1986579
2026-03-27 13:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d691370-bdbe-55aa-9c9a-f505922f0840 with identifier: 1986579
2026-03-27 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d691370-bdbe-55aa-9c9a-f505922f0840 with scrape type 1
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2d691370-bdbe-55aa-9c9a-f505922f0840
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F286%252F56eb8ddab78b41799b6eac3e718e25b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/286/56eb8ddab78b41799b6eac3e718e25b6/images/large/1.jpg not downloaded yet
2026-03-27 13:30:31 [ayvens.es] INFO: Found listing with ID: 1986580
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986580%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [ayvens.es] INFO: Scrape type for 1986580: 1
2026-03-27 13:30:31 [ayvens.es] INFO: Extracting data for car ID: 1986580
2026-03-27 13:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f91f979-9195-5a36-b2e4-51c68c94d18b with identifier: 1986580
2026-03-27 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f91f979-9195-5a36-b2e4-51c68c94d18b with scrape type 1
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6f91f979-9195-5a36-b2e4-51c68c94d18b
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F782%252Fd7cfacdc56744f2191acffee8e3bce4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/782/d7cfacdc56744f2191acffee8e3bce4b/images/large/1.jpg not downloaded yet
2026-03-27 13:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/765/f7e307acf14244e0802f2691aadf4efa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/935/dbcb3052c0cb4a4aa78762b40c8820ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:31 [ayvens.es] INFO: Found listing with ID: 1986581
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986581%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [ayvens.es] INFO: Scrape type for 1986581: 1
2026-03-27 13:30:31 [ayvens.es] INFO: Extracting data for car ID: 1986581
2026-03-27 13:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26016bb2-ebd3-5ce6-a789-05d91a018d21 with identifier: 1986581
2026-03-27 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26016bb2-ebd3-5ce6-a789-05d91a018d21 with scrape type 1
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26016bb2-ebd3-5ce6-a789-05d91a018d21
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252F072c975b1b85454a85ab1d704b46a6e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/072c975b1b85454a85ab1d704b46a6e0/images/large/1.jpg not downloaded yet
2026-03-27 13:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/741/735da36af98e47428dbdd2c5e84485c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:31 [ayvens.es] INFO: Found listing with ID: 1986582
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986582%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [ayvens.es] INFO: Scrape type for 1986582: 1
2026-03-27 13:30:31 [ayvens.es] INFO: Extracting data for car ID: 1986582
2026-03-27 13:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9d4eba-8c6b-5452-9000-21466f185964 with identifier: 1986582
2026-03-27 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9d4eba-8c6b-5452-9000-21466f185964 with scrape type 1
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec9d4eba-8c6b-5452-9000-21466f185964
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252F88a3537a785b4991a579431aa80c06c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/88a3537a785b4991a579431aa80c06c2/images/large/1.jpg not downloaded yet
2026-03-27 13:30:31 [ayvens.es] INFO: Found listing with ID: 1986583
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986583%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [ayvens.es] INFO: Scrape type for 1986583: 1
2026-03-27 13:30:31 [ayvens.es] INFO: Extracting data for car ID: 1986583
2026-03-27 13:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8feb59be-6f6c-5439-a973-a60bbc9e7175 with identifier: 1986583
2026-03-27 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8feb59be-6f6c-5439-a973-a60bbc9e7175 with scrape type 1
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8feb59be-6f6c-5439-a973-a60bbc9e7175
2026-03-27 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8feb59be-6f6c-5439-a973-a60bbc9e7175
2026-03-27 13:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8feb59be-6f6c-5439-a973-a60bbc9e7175, identifier: 1986583
2026-03-27 13:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8feb59be-6f6c-5439-a973-a60bbc9e7175 with identifier: 1986583
2026-03-27 13:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8feb59be-6f6c-5439-a973-a60bbc9e7175 with identifier: 1986583
2026-03-27 13:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8feb59be-6f6c-5439-a973-a60bbc9e7175 with identifier: 1986583 to the API
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '8feb59be-6f6c-5439-a973-a60bbc9e7175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 88040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P GT PureTech 180 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P GT PureTech 180 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986583%27 HTTP/1.1" 200 None
2026-03-27 13:30:31 [ayvens.es] INFO: Saving data for 1986583: {'created_time': 1774618231.867744, 'last_price_update_time': 1774618231.867756, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986583') HTTP/1.1" 204 0
2026-03-27 13:30:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 13:30:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 13:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295c0a7d0>
2026-03-27 13:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af26bb18-6a14-5f0f-9d7c-382122ebad96/af26bb18-6a14-5f0f-9d7c-382122ebad96_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252Ff7e307acf14244e0802f2691aadf4efa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/f7e307acf14244e0802f2691aadf4efa/images/large/1.jpg saved to cache
2026-03-27 13:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af26bb18-6a14-5f0f-9d7c-382122ebad96
2026-03-27 13:30:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af26bb18-6a14-5f0f-9d7c-382122ebad96, skipping ID generation
2026-03-27 13:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af26bb18-6a14-5f0f-9d7c-382122ebad96 with scrape type 1
2026-03-27 13:30:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af26bb18-6a14-5f0f-9d7c-382122ebad96 sending to next pipeline
2026-03-27 13:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: af26bb18-6a14-5f0f-9d7c-382122ebad96, identifier: 1986566
2026-03-27 13:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295720350>
2026-03-27 13:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_590c5d01-49fc-582a-ab77-c03884a81e34/590c5d01-49fc-582a-ab77-c03884a81e34_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F935%252Fdbcb3052c0cb4a4aa78762b40c8820ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/935/dbcb3052c0cb4a4aa78762b40c8820ed/images/large/1.jpg saved to cache
2026-03-27 13:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 590c5d01-49fc-582a-ab77-c03884a81e34
2026-03-27 13:30:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 590c5d01-49fc-582a-ab77-c03884a81e34, skipping ID generation
2026-03-27 13:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590c5d01-49fc-582a-ab77-c03884a81e34 with scrape type 1
2026-03-27 13:30:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 590c5d01-49fc-582a-ab77-c03884a81e34 sending to next pipeline
2026-03-27 13:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 590c5d01-49fc-582a-ab77-c03884a81e34, identifier: 1986564
2026-03-27 13:30:32 [ayvens.es] INFO: Found listing with ID: 1986584
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986584%27 HTTP/1.1" 200 None
2026-03-27 13:30:32 [ayvens.es] INFO: Scrape type for 1986584: 1
2026-03-27 13:30:32 [ayvens.es] INFO: Extracting data for car ID: 1986584
2026-03-27 13:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with identifier: 1986584
2026-03-27 13:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with scrape type 1
2026-03-27 13:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252F966019de4c904788973146efe9dcffa0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/966019de4c904788973146efe9dcffa0/images/large/1.jpg not downloaded yet
2026-03-27 13:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: af26bb18-6a14-5f0f-9d7c-382122ebad96 with identifier: 1986566
2026-03-27 13:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: af26bb18-6a14-5f0f-9d7c-382122ebad96 with identifier: 1986566
2026-03-27 13:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: af26bb18-6a14-5f0f-9d7c-382122ebad96 with identifier: 1986566 to the API
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/765/f7e307acf14244e0802f2691aadf4efa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'af26bb18-6a14-5f0f-9d7c-382122ebad96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 122947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af26bb18-6a14-5f0f-9d7c-382122ebad96/af26bb18-6a14-5f0f-9d7c-382122ebad96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/765/f7e307acf14244e0802f2691aadf4efa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986566%27 HTTP/1.1" 200 None
2026-03-27 13:30:33 [ayvens.es] INFO: Saving data for 1986566: {'created_time': 1774618233.070055, 'last_price_update_time': 1774618233.070072, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986566') HTTP/1.1" 204 0
2026-03-27 13:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 590c5d01-49fc-582a-ab77-c03884a81e34 with identifier: 1986564
2026-03-27 13:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 590c5d01-49fc-582a-ab77-c03884a81e34 with identifier: 1986564
2026-03-27 13:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 590c5d01-49fc-582a-ab77-c03884a81e34 with identifier: 1986564 to the API
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/935/dbcb3052c0cb4a4aa78762b40c8820ed/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '590c5d01-49fc-582a-ab77-c03884a81e34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 127109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_590c5d01-49fc-582a-ab77-c03884a81e34/590c5d01-49fc-582a-ab77-c03884a81e34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/935/dbcb3052c0cb4a4aa78762b40c8820ed/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Pro Standard 600kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Pro Standard 600kg BlueHDi 73kW',
 'vin': None,
 'year': 2019}
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986564%27 HTTP/1.1" 200 None
2026-03-27 13:30:33 [ayvens.es] INFO: Saving data for 1986564: {'created_time': 1774618233.463344, 'last_price_update_time': 1774618233.463356, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986564') HTTP/1.1" 204 0
2026-03-27 13:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bf0a10>
2026-03-27 13:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7490e233-4c38-57e9-9124-5c5e8e635a5d/7490e233-4c38-57e9-9124-5c5e8e635a5d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F741%252F735da36af98e47428dbdd2c5e84485c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/741/735da36af98e47428dbdd2c5e84485c3/images/large/1.jpg saved to cache
2026-03-27 13:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7490e233-4c38-57e9-9124-5c5e8e635a5d
2026-03-27 13:30:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7490e233-4c38-57e9-9124-5c5e8e635a5d, skipping ID generation
2026-03-27 13:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7490e233-4c38-57e9-9124-5c5e8e635a5d with scrape type 1
2026-03-27 13:30:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7490e233-4c38-57e9-9124-5c5e8e635a5d sending to next pipeline
2026-03-27 13:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7490e233-4c38-57e9-9124-5c5e8e635a5d, identifier: 1986565
2026-03-27 13:30:33 [ayvens.es] INFO: Found listing with ID: 1986585
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986585%27 HTTP/1.1" 200 None
2026-03-27 13:30:33 [ayvens.es] INFO: Scrape type for 1986585: 1
2026-03-27 13:30:33 [ayvens.es] INFO: Extracting data for car ID: 1986585
2026-03-27 13:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2983285f-b6e9-519c-b21d-2d9dce5c6475 with identifier: 1986585
2026-03-27 13:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2983285f-b6e9-519c-b21d-2d9dce5c6475 with scrape type 1
2026-03-27 13:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2983285f-b6e9-519c-b21d-2d9dce5c6475
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252F76ac6594db9d4cb4a161e4a661b7f165%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/76ac6594db9d4cb4a161e4a661b7f165/images/large/1.jpg not downloaded yet
2026-03-27 13:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7490e233-4c38-57e9-9124-5c5e8e635a5d with identifier: 1986565
2026-03-27 13:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7490e233-4c38-57e9-9124-5c5e8e635a5d with identifier: 1986565
2026-03-27 13:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7490e233-4c38-57e9-9124-5c5e8e635a5d with identifier: 1986565 to the API
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/741/735da36af98e47428dbdd2c5e84485c3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '7490e233-4c38-57e9-9124-5c5e8e635a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 116456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7490e233-4c38-57e9-9124-5c5e8e635a5d/7490e233-4c38-57e9-9124-5c5e8e635a5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/741/735da36af98e47428dbdd2c5e84485c3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.0 EcoBoost 75kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.0 EcoBoost 75kW Trend',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986565%27 HTTP/1.1" 200 None
2026-03-27 13:30:34 [ayvens.es] INFO: Saving data for 1986565: {'created_time': 1774618234.01631, 'last_price_update_time': 1774618234.016322, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986565') HTTP/1.1" 204 0
2026-03-27 13:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/538/e4008782b0374ccd903df9a1142efc78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/475/001968b2cc204c5189def4cac8ebd06a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:34 [ayvens.es] INFO: Found listing with ID: 1986586
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986586%27 HTTP/1.1" 200 None
2026-03-27 13:30:34 [ayvens.es] INFO: Scrape type for 1986586: 1
2026-03-27 13:30:34 [ayvens.es] INFO: Extracting data for car ID: 1986586
2026-03-27 13:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d210b3f-8592-5c95-9020-367d43e0dbf1 with identifier: 1986586
2026-03-27 13:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d210b3f-8592-5c95-9020-367d43e0dbf1 with scrape type 1
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3d210b3f-8592-5c95-9020-367d43e0dbf1
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3d210b3f-8592-5c95-9020-367d43e0dbf1
2026-03-27 13:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d210b3f-8592-5c95-9020-367d43e0dbf1, identifier: 1986586
2026-03-27 13:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/254/78ebc9a369b847909a61877968435a9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/982/50eb8b92b4d542a3adfe3cf2ac6fea5d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/553/7c5547a2697d4b408adb33ef908a1a48/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/392/b2d51ddabff34acd8e816b56318de8db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/477/077a19e8dcce4f258ca71ee26462c0c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d210b3f-8592-5c95-9020-367d43e0dbf1 with identifier: 1986586
2026-03-27 13:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d210b3f-8592-5c95-9020-367d43e0dbf1 with identifier: 1986586
2026-03-27 13:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d210b3f-8592-5c95-9020-367d43e0dbf1 with identifier: 1986586 to the API
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3d210b3f-8592-5c95-9020-367d43e0dbf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 109032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Allure Pack BlueHDi 100 S&S',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 100 S&S',
 'vin': None,
 'year': 2020}
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986586%27 HTTP/1.1" 200 None
2026-03-27 13:30:34 [ayvens.es] INFO: Saving data for 1986586: {'created_time': 1774618234.508202, 'last_price_update_time': 1774618234.508213, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986586') HTTP/1.1" 204 0
2026-03-27 13:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/550/99bdb8a10dfa40fa8e0497652c633d51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:34 [ayvens.es] INFO: Found listing with ID: 1986587
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986587%27 HTTP/1.1" 200 None
2026-03-27 13:30:34 [ayvens.es] INFO: Scrape type for 1986587: 1
2026-03-27 13:30:34 [ayvens.es] INFO: Extracting data for car ID: 1986587
2026-03-27 13:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72658a27-788b-5bda-a3f2-0b29015de199 with identifier: 1986587
2026-03-27 13:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72658a27-788b-5bda-a3f2-0b29015de199 with scrape type 1
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72658a27-788b-5bda-a3f2-0b29015de199
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F040%252F6fa2c863370b46aab23c6ef164e3f7a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/040/6fa2c863370b46aab23c6ef164e3f7a3/images/large/1.jpg not downloaded yet
2026-03-27 13:30:34 [ayvens.es] INFO: Found listing with ID: 1986588
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986588%27 HTTP/1.1" 200 None
2026-03-27 13:30:34 [ayvens.es] INFO: Scrape type for 1986588: 1
2026-03-27 13:30:34 [ayvens.es] INFO: Extracting data for car ID: 1986588
2026-03-27 13:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6be2cd2-8738-541e-aeb9-9916c574b8e3 with identifier: 1986588
2026-03-27 13:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6be2cd2-8738-541e-aeb9-9916c574b8e3 with scrape type 1
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a6be2cd2-8738-541e-aeb9-9916c574b8e3
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F305b0d39137a4e8f9911097b3f29b9b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/305b0d39137a4e8f9911097b3f29b9b3/images/large/1.jpg not downloaded yet
2026-03-27 13:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1b190>
2026-03-27 13:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ace7ef5e-e37b-5f81-9967-269cce2bedc8/ace7ef5e-e37b-5f81-9967-269cce2bedc8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252Fe4008782b0374ccd903df9a1142efc78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/e4008782b0374ccd903df9a1142efc78/images/large/1.jpg saved to cache
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ace7ef5e-e37b-5f81-9967-269cce2bedc8
2026-03-27 13:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ace7ef5e-e37b-5f81-9967-269cce2bedc8, skipping ID generation
2026-03-27 13:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace7ef5e-e37b-5f81-9967-269cce2bedc8 with scrape type 1
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ace7ef5e-e37b-5f81-9967-269cce2bedc8 sending to next pipeline
2026-03-27 13:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ace7ef5e-e37b-5f81-9967-269cce2bedc8, identifier: 1986569
2026-03-27 13:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956f7dd0>
2026-03-27 13:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209f7aa8-f955-5811-a591-f47bcaebab76/209f7aa8-f955-5811-a591-f47bcaebab76_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F475%252F001968b2cc204c5189def4cac8ebd06a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/475/001968b2cc204c5189def4cac8ebd06a/images/large/1.jpg saved to cache
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 209f7aa8-f955-5811-a591-f47bcaebab76
2026-03-27 13:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 209f7aa8-f955-5811-a591-f47bcaebab76, skipping ID generation
2026-03-27 13:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209f7aa8-f955-5811-a591-f47bcaebab76 with scrape type 1
2026-03-27 13:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 209f7aa8-f955-5811-a591-f47bcaebab76 sending to next pipeline
2026-03-27 13:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 209f7aa8-f955-5811-a591-f47bcaebab76, identifier: 1986570
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956fe050>
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd2d1f1-0316-54cb-b41d-8e112e2654c6/bcd2d1f1-0316-54cb-b41d-8e112e2654c6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F254%252F78ebc9a369b847909a61877968435a9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/254/78ebc9a369b847909a61877968435a9d/images/large/1.jpg saved to cache
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcd2d1f1-0316-54cb-b41d-8e112e2654c6
2026-03-27 13:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcd2d1f1-0316-54cb-b41d-8e112e2654c6, skipping ID generation
2026-03-27 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcd2d1f1-0316-54cb-b41d-8e112e2654c6 with scrape type 1
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcd2d1f1-0316-54cb-b41d-8e112e2654c6 sending to next pipeline
2026-03-27 13:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bcd2d1f1-0316-54cb-b41d-8e112e2654c6, identifier: 1986574
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960d9090>
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2447010-84d0-5561-a25e-00a18d45f99a/c2447010-84d0-5561-a25e-00a18d45f99a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F982%252F50eb8b92b4d542a3adfe3cf2ac6fea5d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/982/50eb8b92b4d542a3adfe3cf2ac6fea5d/images/large/1.jpg saved to cache
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2447010-84d0-5561-a25e-00a18d45f99a
2026-03-27 13:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2447010-84d0-5561-a25e-00a18d45f99a, skipping ID generation
2026-03-27 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2447010-84d0-5561-a25e-00a18d45f99a with scrape type 1
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2447010-84d0-5561-a25e-00a18d45f99a sending to next pipeline
2026-03-27 13:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c2447010-84d0-5561-a25e-00a18d45f99a, identifier: 1986577
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529610b9d0>
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46af0bb6-a44a-5bb6-9a29-265d89ed2ead/46af0bb6-a44a-5bb6-9a29-265d89ed2ead_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F553%252F7c5547a2697d4b408adb33ef908a1a48%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/553/7c5547a2697d4b408adb33ef908a1a48/images/large/1.jpg saved to cache
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead
2026-03-27 13:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead, skipping ID generation
2026-03-27 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with scrape type 1
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46af0bb6-a44a-5bb6-9a29-265d89ed2ead sending to next pipeline
2026-03-27 13:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead, identifier: 1986573
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295723c50>
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d684e-5151-5690-8273-d765ac446c54/918d684e-5151-5690-8273-d765ac446c54_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F392%252Fb2d51ddabff34acd8e816b56318de8db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/392/b2d51ddabff34acd8e816b56318de8db/images/large/1.jpg saved to cache
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 918d684e-5151-5690-8273-d765ac446c54
2026-03-27 13:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 918d684e-5151-5690-8273-d765ac446c54, skipping ID generation
2026-03-27 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 918d684e-5151-5690-8273-d765ac446c54 with scrape type 1
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 918d684e-5151-5690-8273-d765ac446c54 sending to next pipeline
2026-03-27 13:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 918d684e-5151-5690-8273-d765ac446c54, identifier: 1986575
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960e5610>
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef2bb93-9bec-5d56-90cd-49bab6b81728/5ef2bb93-9bec-5d56-90cd-49bab6b81728_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F477%252F077a19e8dcce4f258ca71ee26462c0c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/477/077a19e8dcce4f258ca71ee26462c0c8/images/large/1.jpg saved to cache
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728
2026-03-27 13:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ef2bb93-9bec-5d56-90cd-49bab6b81728, skipping ID generation
2026-03-27 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with scrape type 1
2026-03-27 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ef2bb93-9bec-5d56-90cd-49bab6b81728 sending to next pipeline
2026-03-27 13:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5ef2bb93-9bec-5d56-90cd-49bab6b81728, identifier: 1986572
2026-03-27 13:30:36 [ayvens.es] INFO: Found listing with ID: 1986589
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986589%27 HTTP/1.1" 200 None
2026-03-27 13:30:36 [ayvens.es] INFO: Scrape type for 1986589: 1
2026-03-27 13:30:36 [ayvens.es] INFO: Extracting data for car ID: 1986589
2026-03-27 13:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5cbaba9-c55a-5323-819d-42b04c75a02c with identifier: 1986589
2026-03-27 13:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5cbaba9-c55a-5323-819d-42b04c75a02c with scrape type 1
2026-03-27 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e5cbaba9-c55a-5323-819d-42b04c75a02c
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252F7e26d5d4904146f09f005e796b8e36a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/7e26d5d4904146f09f005e796b8e36a9/images/large/1.jpg not downloaded yet
2026-03-27 13:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ace7ef5e-e37b-5f81-9967-269cce2bedc8 with identifier: 1986569
2026-03-27 13:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ace7ef5e-e37b-5f81-9967-269cce2bedc8 with identifier: 1986569
2026-03-27 13:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ace7ef5e-e37b-5f81-9967-269cce2bedc8 with identifier: 1986569 to the API
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/538/e4008782b0374ccd903df9a1142efc78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ace7ef5e-e37b-5f81-9967-269cce2bedc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 110723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ace7ef5e-e37b-5f81-9967-269cce2bedc8/ace7ef5e-e37b-5f81-9967-269cce2bedc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/538/e4008782b0374ccd903df9a1142efc78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2019}
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986569%27 HTTP/1.1" 200 None
2026-03-27 13:30:36 [ayvens.es] INFO: Saving data for 1986569: {'created_time': 1774618236.407461, 'last_price_update_time': 1774618236.407472, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986569') HTTP/1.1" 204 0
2026-03-27 13:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 209f7aa8-f955-5811-a591-f47bcaebab76 with identifier: 1986570
2026-03-27 13:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 209f7aa8-f955-5811-a591-f47bcaebab76 with identifier: 1986570
2026-03-27 13:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 209f7aa8-f955-5811-a591-f47bcaebab76 with identifier: 1986570 to the API
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/475/001968b2cc204c5189def4cac8ebd06a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '209f7aa8-f955-5811-a591-f47bcaebab76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 121309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209f7aa8-f955-5811-a591-f47bcaebab76/209f7aa8-f955-5811-a591-f47bcaebab76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/475/001968b2cc204c5189def4cac8ebd06a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 9,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) M Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) M Std Express',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986570%27 HTTP/1.1" 200 None
2026-03-27 13:30:36 [ayvens.es] INFO: Saving data for 1986570: {'created_time': 1774618236.863346, 'last_price_update_time': 1774618236.863357, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986570') HTTP/1.1" 204 0
2026-03-27 13:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bcd2d1f1-0316-54cb-b41d-8e112e2654c6 with identifier: 1986574
2026-03-27 13:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bcd2d1f1-0316-54cb-b41d-8e112e2654c6 with identifier: 1986574
2026-03-27 13:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bcd2d1f1-0316-54cb-b41d-8e112e2654c6 with identifier: 1986574 to the API
2026-03-27 13:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/254/78ebc9a369b847909a61877968435a9d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bcd2d1f1-0316-54cb-b41d-8e112e2654c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 244499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd2d1f1-0316-54cb-b41d-8e112e2654c6/bcd2d1f1-0316-54cb-b41d-8e112e2654c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/254/78ebc9a369b847909a61877968435a9d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'vin': None,
 'year': 2017}
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986574%27 HTTP/1.1" 200 None
2026-03-27 13:30:37 [ayvens.es] INFO: Saving data for 1986574: {'created_time': 1774618237.208523, 'last_price_update_time': 1774618237.208533, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986574') HTTP/1.1" 204 0
2026-03-27 13:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c2447010-84d0-5561-a25e-00a18d45f99a with identifier: 1986577
2026-03-27 13:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c2447010-84d0-5561-a25e-00a18d45f99a with identifier: 1986577
2026-03-27 13:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c2447010-84d0-5561-a25e-00a18d45f99a with identifier: 1986577 to the API
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/982/50eb8b92b4d542a3adfe3cf2ac6fea5d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c2447010-84d0-5561-a25e-00a18d45f99a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 12649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2447010-84d0-5561-a25e-00a18d45f99a/c2447010-84d0-5561-a25e-00a18d45f99a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/982/50eb8b92b4d542a3adfe3cf2ac6fea5d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Kombi 2.0 EcoBlue 110kW 320 L1 Trend',
 'transmission': 'manual',
 'trim': 'Kombi 2.0 EcoBlue 110kW 320 L1 Trend',
 'vin': None,
 'year': 2023}
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986577%27 HTTP/1.1" 200 None
2026-03-27 13:30:37 [ayvens.es] INFO: Saving data for 1986577: {'created_time': 1774618237.520052, 'last_price_update_time': 1774618237.520062, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986577') HTTP/1.1" 204 0
2026-03-27 13:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with identifier: 1986573
2026-03-27 13:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with identifier: 1986573
2026-03-27 13:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 46af0bb6-a44a-5bb6-9a29-265d89ed2ead with identifier: 1986573 to the API
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/553/7c5547a2697d4b408adb33ef908a1a48/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'gas',
 'id': '46af0bb6-a44a-5bb6-9a29-265d89ed2ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 112432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46af0bb6-a44a-5bb6-9a29-265d89ed2ead/46af0bb6-a44a-5bb6-9a29-265d89ed2ead_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/553/7c5547a2697d4b408adb33ef908a1a48/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.4 66kW (90CV) Selective Pro GLP',
 'transmission': 'manual',
 'trim': '1.4 66kW (90CV) Selective Pro GLP',
 'vin': None,
 'year': 2019}
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986573%27 HTTP/1.1" 200 None
2026-03-27 13:30:37 [ayvens.es] INFO: Saving data for 1986573: {'created_time': 1774618237.866081, 'last_price_update_time': 1774618237.86609, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986573') HTTP/1.1" 204 0
2026-03-27 13:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 918d684e-5151-5690-8273-d765ac446c54 with identifier: 1986575
2026-03-27 13:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 918d684e-5151-5690-8273-d765ac446c54 with identifier: 1986575
2026-03-27 13:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 918d684e-5151-5690-8273-d765ac446c54 with identifier: 1986575 to the API
2026-03-27 13:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/392/b2d51ddabff34acd8e816b56318de8db/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '918d684e-5151-5690-8273-d765ac446c54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 62107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d684e-5151-5690-8273-d765ac446c54/918d684e-5151-5690-8273-d765ac446c54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/392/b2d51ddabff34acd8e816b56318de8db/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'vin': None,
 'year': 2017}
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986575%27 HTTP/1.1" 200 None
2026-03-27 13:30:38 [ayvens.es] INFO: Saving data for 1986575: {'created_time': 1774618238.216877, 'last_price_update_time': 1774618238.216888, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986575') HTTP/1.1" 204 0
2026-03-27 13:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with identifier: 1986572
2026-03-27 13:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with identifier: 1986572
2026-03-27 13:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5ef2bb93-9bec-5d56-90cd-49bab6b81728 with identifier: 1986572 to the API
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/477/077a19e8dcce4f258ca71ee26462c0c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ef2bb93-9bec-5d56-90cd-49bab6b81728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 91097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef2bb93-9bec-5d56-90cd-49bab6b81728/5ef2bb93-9bec-5d56-90cd-49bab6b81728_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/477/077a19e8dcce4f258ca71ee26462c0c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986572%27 HTTP/1.1" 200 None
2026-03-27 13:30:38 [ayvens.es] INFO: Saving data for 1986572: {'created_time': 1774618238.537226, 'last_price_update_time': 1774618238.537239, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986572') HTTP/1.1" 204 0
2026-03-27 13:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/286/56eb8ddab78b41799b6eac3e718e25b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960e6d50>
2026-03-27 13:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e36009-44bd-51fc-ba4d-65ab7ec62b44/68e36009-44bd-51fc-ba4d-65ab7ec62b44_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F550%252F99bdb8a10dfa40fa8e0497652c633d51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/550/99bdb8a10dfa40fa8e0497652c633d51/images/large/1.jpg saved to cache
2026-03-27 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44
2026-03-27 13:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68e36009-44bd-51fc-ba4d-65ab7ec62b44, skipping ID generation
2026-03-27 13:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with scrape type 1
2026-03-27 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68e36009-44bd-51fc-ba4d-65ab7ec62b44 sending to next pipeline
2026-03-27 13:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 68e36009-44bd-51fc-ba4d-65ab7ec62b44, identifier: 1986571
2026-03-27 13:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/96a9a48fe8fb435988e3f968f76acfa2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:38 [ayvens.es] INFO: Found listing with ID: 1986590
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986590%27 HTTP/1.1" 200 None
2026-03-27 13:30:38 [ayvens.es] INFO: Scrape type for 1986590: 1
2026-03-27 13:30:38 [ayvens.es] INFO: Extracting data for car ID: 1986590
2026-03-27 13:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 379e40c5-32d3-5c8e-bd40-5caf86c2734a with identifier: 1986590
2026-03-27 13:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a with scrape type 1
2026-03-27 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F9fbf252f0c314154af42f76399cba1e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/9fbf252f0c314154af42f76399cba1e4/images/large/1.jpg not downloaded yet
2026-03-27 13:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with identifier: 1986571
2026-03-27 13:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with identifier: 1986571
2026-03-27 13:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 68e36009-44bd-51fc-ba4d-65ab7ec62b44 with identifier: 1986571 to the API
2026-03-27 13:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/550/99bdb8a10dfa40fa8e0497652c633d51/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '68e36009-44bd-51fc-ba4d-65ab7ec62b44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 106281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e36009-44bd-51fc-ba4d-65ab7ec62b44/68e36009-44bd-51fc-ba4d-65ab7ec62b44_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/550/99bdb8a10dfa40fa8e0497652c633d51/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 220 D 4MATIC',
 'transmission': 'manual',
 'trim': 'GLA 220 D 4MATIC',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986571%27 HTTP/1.1" 200 None
2026-03-27 13:30:39 [ayvens.es] INFO: Saving data for 1986571: {'created_time': 1774618239.158507, 'last_price_update_time': 1774618239.158517, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986571') HTTP/1.1" 204 0
2026-03-27 13:30:39 [ayvens.es] INFO: Found listing with ID: 1986591
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986591%27 HTTP/1.1" 200 None
2026-03-27 13:30:39 [ayvens.es] INFO: Scrape type for 1986591: 1
2026-03-27 13:30:39 [ayvens.es] INFO: Extracting data for car ID: 1986591
2026-03-27 13:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with identifier: 1986591
2026-03-27 13:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with scrape type 1
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F8da340b75f14407da25da84f5680c19e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/8da340b75f14407da25da84f5680c19e/images/large/1.jpg not downloaded yet
2026-03-27 13:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/002/88a3537a785b4991a579431aa80c06c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/782/d7cfacdc56744f2191acffee8e3bce4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:39 [ayvens.es] INFO: Found listing with ID: 1986592
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986592%27 HTTP/1.1" 200 None
2026-03-27 13:30:39 [ayvens.es] INFO: Scrape type for 1986592: 1
2026-03-27 13:30:39 [ayvens.es] INFO: Extracting data for car ID: 1986592
2026-03-27 13:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb9bd754-998e-5371-a92f-7e226e40e82a with identifier: 1986592
2026-03-27 13:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb9bd754-998e-5371-a92f-7e226e40e82a with scrape type 1
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb9bd754-998e-5371-a92f-7e226e40e82a
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F175%252Fb619f19a89bd42caa8d28d699ee90e35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/175/b619f19a89bd42caa8d28d699ee90e35/images/large/1.jpg not downloaded yet
2026-03-27 13:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960e68d0>
2026-03-27 13:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d691370-bdbe-55aa-9c9a-f505922f0840/2d691370-bdbe-55aa-9c9a-f505922f0840_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F286%252F56eb8ddab78b41799b6eac3e718e25b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/286/56eb8ddab78b41799b6eac3e718e25b6/images/large/1.jpg saved to cache
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d691370-bdbe-55aa-9c9a-f505922f0840
2026-03-27 13:30:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d691370-bdbe-55aa-9c9a-f505922f0840, skipping ID generation
2026-03-27 13:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d691370-bdbe-55aa-9c9a-f505922f0840 with scrape type 1
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d691370-bdbe-55aa-9c9a-f505922f0840 sending to next pipeline
2026-03-27 13:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2d691370-bdbe-55aa-9c9a-f505922f0840, identifier: 1986579
2026-03-27 13:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ef4290>
2026-03-27 13:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8cf809-cd6a-5a05-b5fd-50120c3d2c34/de8cf809-cd6a-5a05-b5fd-50120c3d2c34_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F96a9a48fe8fb435988e3f968f76acfa2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/96a9a48fe8fb435988e3f968f76acfa2/images/large/1.jpg saved to cache
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34
2026-03-27 13:30:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de8cf809-cd6a-5a05-b5fd-50120c3d2c34, skipping ID generation
2026-03-27 13:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with scrape type 1
2026-03-27 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de8cf809-cd6a-5a05-b5fd-50120c3d2c34 sending to next pipeline
2026-03-27 13:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de8cf809-cd6a-5a05-b5fd-50120c3d2c34, identifier: 1986578
2026-03-27 13:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2d691370-bdbe-55aa-9c9a-f505922f0840 with identifier: 1986579
2026-03-27 13:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2d691370-bdbe-55aa-9c9a-f505922f0840 with identifier: 1986579
2026-03-27 13:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2d691370-bdbe-55aa-9c9a-f505922f0840 with identifier: 1986579 to the API
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/286/56eb8ddab78b41799b6eac3e718e25b6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2d691370-bdbe-55aa-9c9a-f505922f0840',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 125299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d691370-bdbe-55aa-9c9a-f505922f0840/2d691370-bdbe-55aa-9c9a-f505922f0840_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/286/56eb8ddab78b41799b6eac3e718e25b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'vin': None,
 'year': 2017}
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986579%27 HTTP/1.1" 200 None
2026-03-27 13:30:40 [ayvens.es] INFO: Saving data for 1986579: {'created_time': 1774618240.030074, 'last_price_update_time': 1774618240.030085, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986579') HTTP/1.1" 204 0
2026-03-27 13:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with identifier: 1986578
2026-03-27 13:30:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with identifier: 1986578
2026-03-27 13:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de8cf809-cd6a-5a05-b5fd-50120c3d2c34 with identifier: 1986578 to the API
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/635/96a9a48fe8fb435988e3f968f76acfa2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Santorini',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de8cf809-cd6a-5a05-b5fd-50120c3d2c34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 96689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8cf809-cd6a-5a05-b5fd-50120c3d2c34/de8cf809-cd6a-5a05-b5fd-50120c3d2c34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/96a9a48fe8fb435988e3f968f76acfa2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 SE AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 SE AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986578%27 HTTP/1.1" 200 None
2026-03-27 13:30:40 [ayvens.es] INFO: Saving data for 1986578: {'created_time': 1774618240.364239, 'last_price_update_time': 1774618240.364249, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986578') HTTP/1.1" 204 0
2026-03-27 13:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/376/072c975b1b85454a85ab1d704b46a6e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/645/76ac6594db9d4cb4a161e4a661b7f165/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/040/6fa2c863370b46aab23c6ef164e3f7a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:40 [ayvens.es] INFO: Found listing with ID: 1986593
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986593%27 HTTP/1.1" 200 None
2026-03-27 13:30:40 [ayvens.es] INFO: Scrape type for 1986593: 1
2026-03-27 13:30:40 [ayvens.es] INFO: Extracting data for car ID: 1986593
2026-03-27 13:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb3982a-809d-5652-ad48-76c7175fa9a8 with identifier: 1986593
2026-03-27 13:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb3982a-809d-5652-ad48-76c7175fa9a8 with scrape type 1
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dcb3982a-809d-5652-ad48-76c7175fa9a8
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F812%252F8cd5640c93b34a289c436be6874e4bd6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/812/8cd5640c93b34a289c436be6874e4bd6/images/large/1.jpg not downloaded yet
2026-03-27 13:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/241/966019de4c904788973146efe9dcffa0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960c3990>
2026-03-27 13:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec9d4eba-8c6b-5452-9000-21466f185964/ec9d4eba-8c6b-5452-9000-21466f185964_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252F88a3537a785b4991a579431aa80c06c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/88a3537a785b4991a579431aa80c06c2/images/large/1.jpg saved to cache
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec9d4eba-8c6b-5452-9000-21466f185964
2026-03-27 13:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec9d4eba-8c6b-5452-9000-21466f185964, skipping ID generation
2026-03-27 13:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9d4eba-8c6b-5452-9000-21466f185964 with scrape type 1
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec9d4eba-8c6b-5452-9000-21466f185964 sending to next pipeline
2026-03-27 13:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ec9d4eba-8c6b-5452-9000-21466f185964, identifier: 1986582
2026-03-27 13:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529672e850>
2026-03-27 13:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f91f979-9195-5a36-b2e4-51c68c94d18b/6f91f979-9195-5a36-b2e4-51c68c94d18b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F782%252Fd7cfacdc56744f2191acffee8e3bce4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/782/d7cfacdc56744f2191acffee8e3bce4b/images/large/1.jpg saved to cache
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f91f979-9195-5a36-b2e4-51c68c94d18b
2026-03-27 13:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f91f979-9195-5a36-b2e4-51c68c94d18b, skipping ID generation
2026-03-27 13:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f91f979-9195-5a36-b2e4-51c68c94d18b with scrape type 1
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f91f979-9195-5a36-b2e4-51c68c94d18b sending to next pipeline
2026-03-27 13:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6f91f979-9195-5a36-b2e4-51c68c94d18b, identifier: 1986580
2026-03-27 13:30:40 [ayvens.es] INFO: Found listing with ID: 1986594
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986594%27 HTTP/1.1" 200 None
2026-03-27 13:30:40 [ayvens.es] INFO: Scrape type for 1986594: 1
2026-03-27 13:30:40 [ayvens.es] INFO: Extracting data for car ID: 1986594
2026-03-27 13:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with identifier: 1986594
2026-03-27 13:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with scrape type 1
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F492%252Fd48b5258521f4d39b1b6cb5adfc4200c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/492/d48b5258521f4d39b1b6cb5adfc4200c/images/large/1.jpg not downloaded yet
2026-03-27 13:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ec9d4eba-8c6b-5452-9000-21466f185964 with identifier: 1986582
2026-03-27 13:30:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ec9d4eba-8c6b-5452-9000-21466f185964 with identifier: 1986582
2026-03-27 13:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ec9d4eba-8c6b-5452-9000-21466f185964 with identifier: 1986582 to the API
2026-03-27 13:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/002/88a3537a785b4991a579431aa80c06c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ec9d4eba-8c6b-5452-9000-21466f185964',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 76909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec9d4eba-8c6b-5452-9000-21466f185964/ec9d4eba-8c6b-5452-9000-21466f185964_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/002/88a3537a785b4991a579431aa80c06c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': '(O) Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986582%27 HTTP/1.1" 200 None
2026-03-27 13:30:41 [ayvens.es] INFO: Saving data for 1986582: {'created_time': 1774618241.163907, 'last_price_update_time': 1774618241.163918, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986582') HTTP/1.1" 204 0
2026-03-27 13:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6f91f979-9195-5a36-b2e4-51c68c94d18b with identifier: 1986580
2026-03-27 13:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6f91f979-9195-5a36-b2e4-51c68c94d18b with identifier: 1986580
2026-03-27 13:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6f91f979-9195-5a36-b2e4-51c68c94d18b with identifier: 1986580 to the API
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/782/d7cfacdc56744f2191acffee8e3bce4b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6f91f979-9195-5a36-b2e4-51c68c94d18b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 107422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f91f979-9195-5a36-b2e4-51c68c94d18b/6f91f979-9195-5a36-b2e4-51c68c94d18b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/782/d7cfacdc56744f2191acffee8e3bce4b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 71kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 71kW Trend',
 'vin': None,
 'year': 2019}
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986580%27 HTTP/1.1" 200 None
2026-03-27 13:30:41 [ayvens.es] INFO: Saving data for 1986580: {'created_time': 1774618241.472132, 'last_price_update_time': 1774618241.472143, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986580') HTTP/1.1" 204 0
2026-03-27 13:30:41 [ayvens.es] INFO: Found listing with ID: 1986595
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986595%27 HTTP/1.1" 200 None
2026-03-27 13:30:41 [ayvens.es] INFO: Scrape type for 1986595: 1
2026-03-27 13:30:41 [ayvens.es] INFO: Extracting data for car ID: 1986595
2026-03-27 13:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f505b8e7-694b-506d-ab57-fd65b6303041 with identifier: 1986595
2026-03-27 13:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f505b8e7-694b-506d-ab57-fd65b6303041 with scrape type 1
2026-03-27 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f505b8e7-694b-506d-ab57-fd65b6303041
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F771%252F8f080b37d3394bbc9ffa54ac3c3b22a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/771/8f080b37d3394bbc9ffa54ac3c3b22a6/images/large/1.jpg not downloaded yet
2026-03-27 13:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/596/7e26d5d4904146f09f005e796b8e36a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529615a550>
2026-03-27 13:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26016bb2-ebd3-5ce6-a789-05d91a018d21/26016bb2-ebd3-5ce6-a789-05d91a018d21_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252F072c975b1b85454a85ab1d704b46a6e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/072c975b1b85454a85ab1d704b46a6e0/images/large/1.jpg saved to cache
2026-03-27 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26016bb2-ebd3-5ce6-a789-05d91a018d21
2026-03-27 13:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26016bb2-ebd3-5ce6-a789-05d91a018d21, skipping ID generation
2026-03-27 13:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26016bb2-ebd3-5ce6-a789-05d91a018d21 with scrape type 1
2026-03-27 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26016bb2-ebd3-5ce6-a789-05d91a018d21 sending to next pipeline
2026-03-27 13:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 26016bb2-ebd3-5ce6-a789-05d91a018d21, identifier: 1986581
2026-03-27 13:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f5fb90>
2026-03-27 13:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2983285f-b6e9-519c-b21d-2d9dce5c6475/2983285f-b6e9-519c-b21d-2d9dce5c6475_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252F76ac6594db9d4cb4a161e4a661b7f165%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/76ac6594db9d4cb4a161e4a661b7f165/images/large/1.jpg saved to cache
2026-03-27 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2983285f-b6e9-519c-b21d-2d9dce5c6475
2026-03-27 13:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2983285f-b6e9-519c-b21d-2d9dce5c6475, skipping ID generation
2026-03-27 13:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2983285f-b6e9-519c-b21d-2d9dce5c6475 with scrape type 1
2026-03-27 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2983285f-b6e9-519c-b21d-2d9dce5c6475 sending to next pipeline
2026-03-27 13:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2983285f-b6e9-519c-b21d-2d9dce5c6475, identifier: 1986585
2026-03-27 13:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529661b7d0>
2026-03-27 13:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72658a27-788b-5bda-a3f2-0b29015de199/72658a27-788b-5bda-a3f2-0b29015de199_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F040%252F6fa2c863370b46aab23c6ef164e3f7a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/040/6fa2c863370b46aab23c6ef164e3f7a3/images/large/1.jpg saved to cache
2026-03-27 13:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72658a27-788b-5bda-a3f2-0b29015de199
2026-03-27 13:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72658a27-788b-5bda-a3f2-0b29015de199, skipping ID generation
2026-03-27 13:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72658a27-788b-5bda-a3f2-0b29015de199 with scrape type 1
2026-03-27 13:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72658a27-788b-5bda-a3f2-0b29015de199 sending to next pipeline
2026-03-27 13:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 72658a27-788b-5bda-a3f2-0b29015de199, identifier: 1986587
2026-03-27 13:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529661ba90>
2026-03-27 13:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb5b85f-38c5-58eb-acec-4dcbdcd865d6/2bb5b85f-38c5-58eb-acec-4dcbdcd865d6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252F966019de4c904788973146efe9dcffa0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/966019de4c904788973146efe9dcffa0/images/large/1.jpg saved to cache
2026-03-27 13:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6
2026-03-27 13:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6, skipping ID generation
2026-03-27 13:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with scrape type 1
2026-03-27 13:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 sending to next pipeline
2026-03-27 13:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6, identifier: 1986584
2026-03-27 13:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/415/305b0d39137a4e8f9911097b3f29b9b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/9fbf252f0c314154af42f76399cba1e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:42 [ayvens.es] INFO: Found listing with ID: 1986596
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986596%27 HTTP/1.1" 200 None
2026-03-27 13:30:42 [ayvens.es] INFO: Scrape type for 1986596: 1
2026-03-27 13:30:42 [ayvens.es] INFO: Extracting data for car ID: 1986596
2026-03-27 13:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3723815-fb0a-51ad-9544-bd6f97a71365 with identifier: 1986596
2026-03-27 13:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3723815-fb0a-51ad-9544-bd6f97a71365 with scrape type 1
2026-03-27 13:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b3723815-fb0a-51ad-9544-bd6f97a71365
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F622%252Fdf91fd1a08bd4ba19cd047fabb65011d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/622/df91fd1a08bd4ba19cd047fabb65011d/images/large/1.jpg not downloaded yet
2026-03-27 13:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 26016bb2-ebd3-5ce6-a789-05d91a018d21 with identifier: 1986581
2026-03-27 13:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 26016bb2-ebd3-5ce6-a789-05d91a018d21 with identifier: 1986581
2026-03-27 13:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 26016bb2-ebd3-5ce6-a789-05d91a018d21 with identifier: 1986581 to the API
2026-03-27 13:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/376/072c975b1b85454a85ab1d704b46a6e0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '26016bb2-ebd3-5ce6-a789-05d91a018d21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 109189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26016bb2-ebd3-5ce6-a789-05d91a018d21/26016bb2-ebd3-5ce6-a789-05d91a018d21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/376/072c975b1b85454a85ab1d704b46a6e0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986581%27 HTTP/1.1" 200 None
2026-03-27 13:30:43 [ayvens.es] INFO: Saving data for 1986581: {'created_time': 1774618243.165086, 'last_price_update_time': 1774618243.165096, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986581') HTTP/1.1" 204 0
2026-03-27 13:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2983285f-b6e9-519c-b21d-2d9dce5c6475 with identifier: 1986585
2026-03-27 13:30:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2983285f-b6e9-519c-b21d-2d9dce5c6475 with identifier: 1986585
2026-03-27 13:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2983285f-b6e9-519c-b21d-2d9dce5c6475 with identifier: 1986585 to the API
2026-03-27 13:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/645/76ac6594db9d4cb4a161e4a661b7f165/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '2983285f-b6e9-519c-b21d-2d9dce5c6475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 114790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2983285f-b6e9-519c-b21d-2d9dce5c6475/2983285f-b6e9-519c-b21d-2d9dce5c6475_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/645/76ac6594db9d4cb4a161e4a661b7f165/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986585%27 HTTP/1.1" 200 None
2026-03-27 13:30:44 [ayvens.es] INFO: Saving data for 1986585: {'created_time': 1774618244.121258, 'last_price_update_time': 1774618244.121271, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986585') HTTP/1.1" 204 0
2026-03-27 13:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 72658a27-788b-5bda-a3f2-0b29015de199 with identifier: 1986587
2026-03-27 13:30:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 72658a27-788b-5bda-a3f2-0b29015de199 with identifier: 1986587
2026-03-27 13:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 72658a27-788b-5bda-a3f2-0b29015de199 with identifier: 1986587 to the API
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/040/6fa2c863370b46aab23c6ef164e3f7a3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '72658a27-788b-5bda-a3f2-0b29015de199',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 66976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72658a27-788b-5bda-a3f2-0b29015de199/72658a27-788b-5bda-a3f2-0b29015de199_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/040/6fa2c863370b46aab23c6ef164e3f7a3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986587%27 HTTP/1.1" 200 None
2026-03-27 13:30:44 [ayvens.es] INFO: Saving data for 1986587: {'created_time': 1774618244.491931, 'last_price_update_time': 1774618244.491971, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986587') HTTP/1.1" 204 0
2026-03-27 13:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with identifier: 1986584
2026-03-27 13:30:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with identifier: 1986584
2026-03-27 13:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2bb5b85f-38c5-58eb-acec-4dcbdcd865d6 with identifier: 1986584 to the API
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/241/966019de4c904788973146efe9dcffa0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2bb5b85f-38c5-58eb-acec-4dcbdcd865d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'CEED',
 'odometer': 174913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb5b85f-38c5-58eb-acec-4dcbdcd865d6/2bb5b85f-38c5-58eb-acec-4dcbdcd865d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/241/966019de4c904788973146efe9dcffa0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA CEED Tourer 1.6 MHEV iMT 100kW Drive',
 'transmission': 'manual',
 'trim': 'Tourer 1.6 MHEV iMT 100kW Drive',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986584%27 HTTP/1.1" 200 None
2026-03-27 13:30:44 [ayvens.es] INFO: Saving data for 1986584: {'created_time': 1774618244.836745, 'last_price_update_time': 1774618244.836759, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986584') HTTP/1.1" 204 0
2026-03-27 13:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/8da340b75f14407da25da84f5680c19e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:44 [ayvens.es] INFO: Found listing with ID: 1986597
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986597%27 HTTP/1.1" 200 None
2026-03-27 13:30:44 [ayvens.es] INFO: Scrape type for 1986597: 1
2026-03-27 13:30:44 [ayvens.es] INFO: Extracting data for car ID: 1986597
2026-03-27 13:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9849e4ed-7d3d-5312-b37b-6e8071493b2b with identifier: 1986597
2026-03-27 13:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b with scrape type 1
2026-03-27 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F105%252Fcd416e0862d1469f8742508f80552e68%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/105/cd416e0862d1469f8742508f80552e68/images/large/1.jpg not downloaded yet
2026-03-27 13:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295780950>
2026-03-27 13:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5cbaba9-c55a-5323-819d-42b04c75a02c/e5cbaba9-c55a-5323-819d-42b04c75a02c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252F7e26d5d4904146f09f005e796b8e36a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/7e26d5d4904146f09f005e796b8e36a9/images/large/1.jpg saved to cache
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5cbaba9-c55a-5323-819d-42b04c75a02c
2026-03-27 13:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5cbaba9-c55a-5323-819d-42b04c75a02c, skipping ID generation
2026-03-27 13:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5cbaba9-c55a-5323-819d-42b04c75a02c with scrape type 1
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5cbaba9-c55a-5323-819d-42b04c75a02c sending to next pipeline
2026-03-27 13:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e5cbaba9-c55a-5323-819d-42b04c75a02c, identifier: 1986589
2026-03-27 13:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f73d90>
2026-03-27 13:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6be2cd2-8738-541e-aeb9-9916c574b8e3/a6be2cd2-8738-541e-aeb9-9916c574b8e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F305b0d39137a4e8f9911097b3f29b9b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/305b0d39137a4e8f9911097b3f29b9b3/images/large/1.jpg saved to cache
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6be2cd2-8738-541e-aeb9-9916c574b8e3
2026-03-27 13:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6be2cd2-8738-541e-aeb9-9916c574b8e3, skipping ID generation
2026-03-27 13:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6be2cd2-8738-541e-aeb9-9916c574b8e3 with scrape type 1
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6be2cd2-8738-541e-aeb9-9916c574b8e3 sending to next pipeline
2026-03-27 13:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a6be2cd2-8738-541e-aeb9-9916c574b8e3, identifier: 1986588
2026-03-27 13:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295744d10>
2026-03-27 13:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_379e40c5-32d3-5c8e-bd40-5caf86c2734a/379e40c5-32d3-5c8e-bd40-5caf86c2734a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F9fbf252f0c314154af42f76399cba1e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/9fbf252f0c314154af42f76399cba1e4/images/large/1.jpg saved to cache
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a
2026-03-27 13:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 379e40c5-32d3-5c8e-bd40-5caf86c2734a, skipping ID generation
2026-03-27 13:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a with scrape type 1
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 379e40c5-32d3-5c8e-bd40-5caf86c2734a sending to next pipeline
2026-03-27 13:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 379e40c5-32d3-5c8e-bd40-5caf86c2734a, identifier: 1986590
2026-03-27 13:30:45 [ayvens.es] INFO: Found listing with ID: 1986598
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986598%27 HTTP/1.1" 200 None
2026-03-27 13:30:45 [ayvens.es] INFO: Scrape type for 1986598: 1
2026-03-27 13:30:45 [ayvens.es] INFO: Extracting data for car ID: 1986598
2026-03-27 13:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1fc496f-bbc2-5723-99d5-50e07acb5704 with identifier: 1986598
2026-03-27 13:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1fc496f-bbc2-5723-99d5-50e07acb5704 with scrape type 1
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1fc496f-bbc2-5723-99d5-50e07acb5704
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F847%252F6202073aaeb74290bd1b266baa9942bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/847/6202073aaeb74290bd1b266baa9942bf/images/large/1.jpg not downloaded yet
2026-03-27 13:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e5cbaba9-c55a-5323-819d-42b04c75a02c with identifier: 1986589
2026-03-27 13:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e5cbaba9-c55a-5323-819d-42b04c75a02c with identifier: 1986589
2026-03-27 13:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e5cbaba9-c55a-5323-819d-42b04c75a02c with identifier: 1986589 to the API
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/596/7e26d5d4904146f09f005e796b8e36a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e5cbaba9-c55a-5323-819d-42b04c75a02c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 109424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5cbaba9-c55a-5323-819d-42b04c75a02c/e5cbaba9-c55a-5323-819d-42b04c75a02c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/596/7e26d5d4904146f09f005e796b8e36a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S GT EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S GT EAT8',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986589%27 HTTP/1.1" 200 None
2026-03-27 13:30:45 [ayvens.es] INFO: Saving data for 1986589: {'created_time': 1774618245.776874, 'last_price_update_time': 1774618245.776884, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986589') HTTP/1.1" 204 0
2026-03-27 13:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a6be2cd2-8738-541e-aeb9-9916c574b8e3 with identifier: 1986588
2026-03-27 13:30:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a6be2cd2-8738-541e-aeb9-9916c574b8e3 with identifier: 1986588
2026-03-27 13:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a6be2cd2-8738-541e-aeb9-9916c574b8e3 with identifier: 1986588 to the API
2026-03-27 13:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/415/305b0d39137a4e8f9911097b3f29b9b3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a6be2cd2-8738-541e-aeb9-9916c574b8e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 47436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6be2cd2-8738-541e-aeb9-9916c574b8e3/a6be2cd2-8738-541e-aeb9-9916c574b8e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/415/305b0d39137a4e8f9911097b3f29b9b3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2020}
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986588%27 HTTP/1.1" 200 None
2026-03-27 13:30:46 [ayvens.es] INFO: Saving data for 1986588: {'created_time': 1774618246.123594, 'last_price_update_time': 1774618246.123608, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986588') HTTP/1.1" 204 0
2026-03-27 13:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 379e40c5-32d3-5c8e-bd40-5caf86c2734a with identifier: 1986590
2026-03-27 13:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 379e40c5-32d3-5c8e-bd40-5caf86c2734a with identifier: 1986590
2026-03-27 13:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 379e40c5-32d3-5c8e-bd40-5caf86c2734a with identifier: 1986590 to the API
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/9fbf252f0c314154af42f76399cba1e4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'gas',
 'id': '379e40c5-32d3-5c8e-bd40-5caf86c2734a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 69751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_379e40c5-32d3-5c8e-bd40-5caf86c2734a/379e40c5-32d3-5c8e-bd40-5caf86c2734a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/9fbf252f0c314154af42f76399cba1e4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO Comfort 74kW (100CV) ECO-G',
 'transmission': 'manual',
 'trim': 'Comfort 74kW (100CV) ECO-G',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986590%27 HTTP/1.1" 200 None
2026-03-27 13:30:46 [ayvens.es] INFO: Saving data for 1986590: {'created_time': 1774618246.476881, 'last_price_update_time': 1774618246.476891, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986590') HTTP/1.1" 204 0
2026-03-27 13:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f226d0>
2026-03-27 13:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c52bc9a-0541-56ee-8134-d5c97437b7b2/5c52bc9a-0541-56ee-8134-d5c97437b7b2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F8da340b75f14407da25da84f5680c19e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/8da340b75f14407da25da84f5680c19e/images/large/1.jpg saved to cache
2026-03-27 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2
2026-03-27 13:30:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c52bc9a-0541-56ee-8134-d5c97437b7b2, skipping ID generation
2026-03-27 13:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with scrape type 1
2026-03-27 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2 sending to next pipeline
2026-03-27 13:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5c52bc9a-0541-56ee-8134-d5c97437b7b2, identifier: 1986591
2026-03-27 13:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/175/b619f19a89bd42caa8d28d699ee90e35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:46 [ayvens.es] INFO: Found listing with ID: 1986599
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986599%27 HTTP/1.1" 200 None
2026-03-27 13:30:46 [ayvens.es] INFO: Scrape type for 1986599: 1
2026-03-27 13:30:46 [ayvens.es] INFO: Extracting data for car ID: 1986599
2026-03-27 13:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 652e8fb7-1346-50d3-9895-f121f51893b8 with identifier: 1986599
2026-03-27 13:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 652e8fb7-1346-50d3-9895-f121f51893b8 with scrape type 1
2026-03-27 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 652e8fb7-1346-50d3-9895-f121f51893b8
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252F25c1473de35c462fbac4e424eaf5dfc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/25c1473de35c462fbac4e424eaf5dfc9/images/large/1.jpg not downloaded yet
2026-03-27 13:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with identifier: 1986591
2026-03-27 13:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with identifier: 1986591
2026-03-27 13:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with identifier: 1986591 to the API
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/8da340b75f14407da25da84f5680c19e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5c52bc9a-0541-56ee-8134-d5c97437b7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 103538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52bc9a-0541-56ee-8134-d5c97437b7b2/5c52bc9a-0541-56ee-8134-d5c97437b7b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/8da340b75f14407da25da84f5680c19e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 435 L4H2 BlueHDi 120KW (160CV)',
 'transmission': 'manual',
 'trim': '435 L4H2 BlueHDi 120KW (160CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986591%27 HTTP/1.1" 200 None
2026-03-27 13:30:47 [ayvens.es] INFO: Saving data for 1986591: {'created_time': 1774618247.08867, 'last_price_update_time': 1774618247.088681, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986591') HTTP/1.1" 204 0
2026-03-27 13:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/812/8cd5640c93b34a289c436be6874e4bd6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:47 [ayvens.es] INFO: Found listing with ID: 1986600
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986600%27 HTTP/1.1" 200 None
2026-03-27 13:30:47 [ayvens.es] INFO: Scrape type for 1986600: 1
2026-03-27 13:30:47 [ayvens.es] INFO: Extracting data for car ID: 1986600
2026-03-27 13:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with identifier: 1986600
2026-03-27 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with scrape type 1
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F202%252Ff8448496afdf4e1b95abbcf077b77b95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/202/f8448496afdf4e1b95abbcf077b77b95/images/large/1.jpg not downloaded yet
2026-03-27 13:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ef4690>
2026-03-27 13:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9bd754-998e-5371-a92f-7e226e40e82a/bb9bd754-998e-5371-a92f-7e226e40e82a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F175%252Fb619f19a89bd42caa8d28d699ee90e35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/175/b619f19a89bd42caa8d28d699ee90e35/images/large/1.jpg saved to cache
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb9bd754-998e-5371-a92f-7e226e40e82a
2026-03-27 13:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb9bd754-998e-5371-a92f-7e226e40e82a, skipping ID generation
2026-03-27 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb9bd754-998e-5371-a92f-7e226e40e82a with scrape type 1
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb9bd754-998e-5371-a92f-7e226e40e82a sending to next pipeline
2026-03-27 13:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bb9bd754-998e-5371-a92f-7e226e40e82a, identifier: 1986592
2026-03-27 13:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/492/d48b5258521f4d39b1b6cb5adfc4200c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:47 [ayvens.es] INFO: Found listing with ID: 1986601
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986601%27 HTTP/1.1" 200 None
2026-03-27 13:30:47 [ayvens.es] INFO: Scrape type for 1986601: 1
2026-03-27 13:30:47 [ayvens.es] INFO: Extracting data for car ID: 1986601
2026-03-27 13:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b093631a-ef8f-5ba9-bc7f-012893408b30 with identifier: 1986601
2026-03-27 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b093631a-ef8f-5ba9-bc7f-012893408b30 with scrape type 1
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b093631a-ef8f-5ba9-bc7f-012893408b30
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252F714fef5de9e44703b3ea8415cf8b963c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/714fef5de9e44703b3ea8415cf8b963c/images/large/1.jpg not downloaded yet
2026-03-27 13:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bb9bd754-998e-5371-a92f-7e226e40e82a with identifier: 1986592
2026-03-27 13:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bb9bd754-998e-5371-a92f-7e226e40e82a with identifier: 1986592
2026-03-27 13:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bb9bd754-998e-5371-a92f-7e226e40e82a with identifier: 1986592 to the API
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/175/b619f19a89bd42caa8d28d699ee90e35/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bb9bd754-998e-5371-a92f-7e226e40e82a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 150884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb9bd754-998e-5371-a92f-7e226e40e82a/bb9bd754-998e-5371-a92f-7e226e40e82a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/175/b619f19a89bd42caa8d28d699ee90e35/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2023}
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986592%27 HTTP/1.1" 200 None
2026-03-27 13:30:47 [ayvens.es] INFO: Saving data for 1986592: {'created_time': 1774618247.774624, 'last_price_update_time': 1774618247.774635, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986592') HTTP/1.1" 204 0
2026-03-27 13:30:47 [ayvens.es] INFO: Found listing with ID: 1986602
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986602%27 HTTP/1.1" 200 None
2026-03-27 13:30:47 [ayvens.es] INFO: Scrape type for 1986602: 1
2026-03-27 13:30:47 [ayvens.es] INFO: Extracting data for car ID: 1986602
2026-03-27 13:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837d9b29-a71d-576b-b7dc-026ce5729a37 with identifier: 1986602
2026-03-27 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837d9b29-a71d-576b-b7dc-026ce5729a37 with scrape type 1
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 837d9b29-a71d-576b-b7dc-026ce5729a37
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252Fbb9cfb693b194265a766ad8b1e8b5a64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/bb9cfb693b194265a766ad8b1e8b5a64/images/large/1.jpg not downloaded yet
2026-03-27 13:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963f7c10>
2026-03-27 13:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcb3982a-809d-5652-ad48-76c7175fa9a8/dcb3982a-809d-5652-ad48-76c7175fa9a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F812%252F8cd5640c93b34a289c436be6874e4bd6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/812/8cd5640c93b34a289c436be6874e4bd6/images/large/1.jpg saved to cache
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcb3982a-809d-5652-ad48-76c7175fa9a8
2026-03-27 13:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcb3982a-809d-5652-ad48-76c7175fa9a8, skipping ID generation
2026-03-27 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb3982a-809d-5652-ad48-76c7175fa9a8 with scrape type 1
2026-03-27 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcb3982a-809d-5652-ad48-76c7175fa9a8 sending to next pipeline
2026-03-27 13:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dcb3982a-809d-5652-ad48-76c7175fa9a8, identifier: 1986593
2026-03-27 13:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bd4c50>
2026-03-27 13:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e54ab3-e3b9-53f6-b800-02bb33bfec22/09e54ab3-e3b9-53f6-b800-02bb33bfec22_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F492%252Fd48b5258521f4d39b1b6cb5adfc4200c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/492/d48b5258521f4d39b1b6cb5adfc4200c/images/large/1.jpg saved to cache
2026-03-27 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22
2026-03-27 13:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09e54ab3-e3b9-53f6-b800-02bb33bfec22, skipping ID generation
2026-03-27 13:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with scrape type 1
2026-03-27 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22 sending to next pipeline
2026-03-27 13:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 09e54ab3-e3b9-53f6-b800-02bb33bfec22, identifier: 1986594
2026-03-27 13:30:48 [ayvens.es] INFO: Found listing with ID: 1986603
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986603%27 HTTP/1.1" 200 None
2026-03-27 13:30:48 [ayvens.es] INFO: Scrape type for 1986603: 1
2026-03-27 13:30:48 [ayvens.es] INFO: Extracting data for car ID: 1986603
2026-03-27 13:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2330bc70-d639-5317-b4fc-f1d497ca14c3 with identifier: 1986603
2026-03-27 13:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2330bc70-d639-5317-b4fc-f1d497ca14c3 with scrape type 1
2026-03-27 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2330bc70-d639-5317-b4fc-f1d497ca14c3
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252Fa4bc080ee3c04e4ba0bca38a906dd501%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/a4bc080ee3c04e4ba0bca38a906dd501/images/large/1.jpg not downloaded yet
2026-03-27 13:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dcb3982a-809d-5652-ad48-76c7175fa9a8 with identifier: 1986593
2026-03-27 13:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dcb3982a-809d-5652-ad48-76c7175fa9a8 with identifier: 1986593
2026-03-27 13:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dcb3982a-809d-5652-ad48-76c7175fa9a8 with identifier: 1986593 to the API
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/812/8cd5640c93b34a289c436be6874e4bd6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dcb3982a-809d-5652-ad48-76c7175fa9a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 163783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb3982a-809d-5652-ad48-76c7175fa9a8/dcb3982a-809d-5652-ad48-76c7175fa9a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/812/8cd5640c93b34a289c436be6874e4bd6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 280 L1 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 280 L1 Trend',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986593%27 HTTP/1.1" 200 None
2026-03-27 13:30:48 [ayvens.es] INFO: Saving data for 1986593: {'created_time': 1774618248.705807, 'last_price_update_time': 1774618248.705818, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986593') HTTP/1.1" 204 0
2026-03-27 13:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with identifier: 1986594
2026-03-27 13:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with identifier: 1986594
2026-03-27 13:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with identifier: 1986594 to the API
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/492/d48b5258521f4d39b1b6cb5adfc4200c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '09e54ab3-e3b9-53f6-b800-02bb33bfec22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV400',
 'odometer': 123649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e54ab3-e3b9-53f6-b800-02bb33bfec22/09e54ab3-e3b9-53f6-b800-02bb33bfec22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/492/d48b5258521f4d39b1b6cb5adfc4200c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV400 L3H2 3,5T 2.3dCi 99kW FWD Comfort',
 'transmission': 'manual',
 'trim': 'L3H2 3,5T 2.3dCi 99kW FWD Comfort',
 'vin': None,
 'year': 2020}
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986594%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [ayvens.es] INFO: Saving data for 1986594: {'created_time': 1774618249.032458, 'last_price_update_time': 1774618249.032469, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986594') HTTP/1.1" 204 0
2026-03-27 13:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/771/8f080b37d3394bbc9ffa54ac3c3b22a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/105/cd416e0862d1469f8742508f80552e68/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/622/df91fd1a08bd4ba19cd047fabb65011d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/847/6202073aaeb74290bd1b266baa9942bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:49 [ayvens.es] INFO: Found listing with ID: 1986604
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986604%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [ayvens.es] INFO: Scrape type for 1986604: 1
2026-03-27 13:30:49 [ayvens.es] INFO: Extracting data for car ID: 1986604
2026-03-27 13:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 499510cd-370c-594f-aac2-a356193afb70 with identifier: 1986604
2026-03-27 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499510cd-370c-594f-aac2-a356193afb70 with scrape type 1
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 499510cd-370c-594f-aac2-a356193afb70
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F269%252F0c9af926a28248bab2d9065a8c8c3621%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/269/0c9af926a28248bab2d9065a8c8c3621/images/large/1.jpg not downloaded yet
2026-03-27 13:30:49 [ayvens.es] INFO: Found listing with ID: 1986605
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986605%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [ayvens.es] INFO: Scrape type for 1986605: 1
2026-03-27 13:30:49 [ayvens.es] INFO: Extracting data for car ID: 1986605
2026-03-27 13:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aaa366d-6018-51ca-8a0c-131028ccd16f with identifier: 1986605
2026-03-27 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aaa366d-6018-51ca-8a0c-131028ccd16f with scrape type 1
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9aaa366d-6018-51ca-8a0c-131028ccd16f
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F675%252Fb992541030384d49b711a8e4ccf5f94a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/675/b992541030384d49b711a8e4ccf5f94a/images/large/1.jpg not downloaded yet
2026-03-27 13:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/449/25c1473de35c462fbac4e424eaf5dfc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/202/f8448496afdf4e1b95abbcf077b77b95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:49 [ayvens.es] INFO: Found listing with ID: 1986606
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986606%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [ayvens.es] INFO: Scrape type for 1986606: 1
2026-03-27 13:30:49 [ayvens.es] INFO: Extracting data for car ID: 1986606
2026-03-27 13:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 100b87c0-2dd8-5052-895b-f7e864cf4f15 with identifier: 1986606
2026-03-27 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100b87c0-2dd8-5052-895b-f7e864cf4f15 with scrape type 1
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 100b87c0-2dd8-5052-895b-f7e864cf4f15
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F898%252F9d08787f7d354162a111cd36a4a77262%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/898/9d08787f7d354162a111cd36a4a77262/images/large/1.jpg not downloaded yet
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296011c50>
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f505b8e7-694b-506d-ab57-fd65b6303041/f505b8e7-694b-506d-ab57-fd65b6303041_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F771%252F8f080b37d3394bbc9ffa54ac3c3b22a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/771/8f080b37d3394bbc9ffa54ac3c3b22a6/images/large/1.jpg saved to cache
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f505b8e7-694b-506d-ab57-fd65b6303041
2026-03-27 13:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f505b8e7-694b-506d-ab57-fd65b6303041, skipping ID generation
2026-03-27 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f505b8e7-694b-506d-ab57-fd65b6303041 with scrape type 1
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f505b8e7-694b-506d-ab57-fd65b6303041 sending to next pipeline
2026-03-27 13:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f505b8e7-694b-506d-ab57-fd65b6303041, identifier: 1986595
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f23090>
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9849e4ed-7d3d-5312-b37b-6e8071493b2b/9849e4ed-7d3d-5312-b37b-6e8071493b2b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F105%252Fcd416e0862d1469f8742508f80552e68%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/105/cd416e0862d1469f8742508f80552e68/images/large/1.jpg saved to cache
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b
2026-03-27 13:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9849e4ed-7d3d-5312-b37b-6e8071493b2b, skipping ID generation
2026-03-27 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b with scrape type 1
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b sending to next pipeline
2026-03-27 13:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9849e4ed-7d3d-5312-b37b-6e8071493b2b, identifier: 1986597
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963f4710>
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3723815-fb0a-51ad-9544-bd6f97a71365/b3723815-fb0a-51ad-9544-bd6f97a71365_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F622%252Fdf91fd1a08bd4ba19cd047fabb65011d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/622/df91fd1a08bd4ba19cd047fabb65011d/images/large/1.jpg saved to cache
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3723815-fb0a-51ad-9544-bd6f97a71365
2026-03-27 13:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3723815-fb0a-51ad-9544-bd6f97a71365, skipping ID generation
2026-03-27 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3723815-fb0a-51ad-9544-bd6f97a71365 with scrape type 1
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3723815-fb0a-51ad-9544-bd6f97a71365 sending to next pipeline
2026-03-27 13:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b3723815-fb0a-51ad-9544-bd6f97a71365, identifier: 1986596
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296309710>
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1fc496f-bbc2-5723-99d5-50e07acb5704/b1fc496f-bbc2-5723-99d5-50e07acb5704_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F847%252F6202073aaeb74290bd1b266baa9942bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/847/6202073aaeb74290bd1b266baa9942bf/images/large/1.jpg saved to cache
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1fc496f-bbc2-5723-99d5-50e07acb5704
2026-03-27 13:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1fc496f-bbc2-5723-99d5-50e07acb5704, skipping ID generation
2026-03-27 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1fc496f-bbc2-5723-99d5-50e07acb5704 with scrape type 1
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1fc496f-bbc2-5723-99d5-50e07acb5704 sending to next pipeline
2026-03-27 13:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1fc496f-bbc2-5723-99d5-50e07acb5704, identifier: 1986598
2026-03-27 13:30:49 [ayvens.es] INFO: Found listing with ID: 1986607
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986607%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [ayvens.es] INFO: Scrape type for 1986607: 1
2026-03-27 13:30:49 [ayvens.es] INFO: Extracting data for car ID: 1986607
2026-03-27 13:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0167e490-d763-5612-a079-053a5d178e08 with identifier: 1986607
2026-03-27 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0167e490-d763-5612-a079-053a5d178e08 with scrape type 1
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0167e490-d763-5612-a079-053a5d178e08
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252F76428173865340b8891c4d2a0831866d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/76428173865340b8891c4d2a0831866d/images/large/1.jpg not downloaded yet
2026-03-27 13:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f505b8e7-694b-506d-ab57-fd65b6303041 with identifier: 1986595
2026-03-27 13:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f505b8e7-694b-506d-ab57-fd65b6303041 with identifier: 1986595
2026-03-27 13:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f505b8e7-694b-506d-ab57-fd65b6303041 with identifier: 1986595 to the API
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/771/8f080b37d3394bbc9ffa54ac3c3b22a6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f505b8e7-694b-506d-ab57-fd65b6303041',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 132899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f505b8e7-694b-506d-ab57-fd65b6303041/f505b8e7-694b-506d-ab57-fd65b6303041_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/771/8f080b37d3394bbc9ffa54ac3c3b22a6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 S line 40 TDI 150kW quattro S tronic',
 'transmission': 'manual',
 'trim': 'S line 40 TDI 150kW quattro S tronic',
 'vin': None,
 'year': 2023}
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986595%27 HTTP/1.1" 200 None
2026-03-27 13:30:50 [ayvens.es] INFO: Saving data for 1986595: {'created_time': 1774618250.268687, 'last_price_update_time': 1774618250.268698, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986595') HTTP/1.1" 204 0
2026-03-27 13:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9849e4ed-7d3d-5312-b37b-6e8071493b2b with identifier: 1986597
2026-03-27 13:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9849e4ed-7d3d-5312-b37b-6e8071493b2b with identifier: 1986597
2026-03-27 13:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9849e4ed-7d3d-5312-b37b-6e8071493b2b with identifier: 1986597 to the API
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/105/cd416e0862d1469f8742508f80552e68/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9849e4ed-7d3d-5312-b37b-6e8071493b2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 177833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9849e4ed-7d3d-5312-b37b-6e8071493b2b/9849e4ed-7d3d-5312-b37b-6e8071493b2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/105/cd416e0862d1469f8742508f80552e68/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.6 TDI 85kW St&Sp Reference Plus',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW St&Sp Reference Plus',
 'vin': None,
 'year': 2017}
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986597%27 HTTP/1.1" 200 None
2026-03-27 13:30:50 [ayvens.es] INFO: Saving data for 1986597: {'created_time': 1774618250.629374, 'last_price_update_time': 1774618250.629384, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986597') HTTP/1.1" 204 0
2026-03-27 13:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b3723815-fb0a-51ad-9544-bd6f97a71365 with identifier: 1986596
2026-03-27 13:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b3723815-fb0a-51ad-9544-bd6f97a71365 with identifier: 1986596
2026-03-27 13:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b3723815-fb0a-51ad-9544-bd6f97a71365 with identifier: 1986596 to the API
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/622/df91fd1a08bd4ba19cd047fabb65011d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3723815-fb0a-51ad-9544-bd6f97a71365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 159673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3723815-fb0a-51ad-9544-bd6f97a71365/b3723815-fb0a-51ad-9544-bd6f97a71365_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/622/df91fd1a08bd4ba19cd047fabb65011d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986596%27 HTTP/1.1" 200 None
2026-03-27 13:30:50 [ayvens.es] INFO: Saving data for 1986596: {'created_time': 1774618250.95, 'last_price_update_time': 1774618250.950009, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986596') HTTP/1.1" 204 0
2026-03-27 13:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1fc496f-bbc2-5723-99d5-50e07acb5704 with identifier: 1986598
2026-03-27 13:30:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1fc496f-bbc2-5723-99d5-50e07acb5704 with identifier: 1986598
2026-03-27 13:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1fc496f-bbc2-5723-99d5-50e07acb5704 with identifier: 1986598 to the API
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/847/6202073aaeb74290bd1b266baa9942bf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b1fc496f-bbc2-5723-99d5-50e07acb5704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 76052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1fc496f-bbc2-5723-99d5-50e07acb5704/b1fc496f-bbc2-5723-99d5-50e07acb5704_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/847/6202073aaeb74290bd1b266baa9942bf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986598%27 HTTP/1.1" 200 None
2026-03-27 13:30:51 [ayvens.es] INFO: Saving data for 1986598: {'created_time': 1774618251.296565, 'last_price_update_time': 1774618251.296583, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986598') HTTP/1.1" 204 0
2026-03-27 13:30:51 [ayvens.es] INFO: Found listing with ID: 1986608
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986608%27 HTTP/1.1" 200 None
2026-03-27 13:30:51 [ayvens.es] INFO: Scrape type for 1986608: 1
2026-03-27 13:30:51 [ayvens.es] INFO: Extracting data for car ID: 1986608
2026-03-27 13:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0991cd93-117d-52a3-8e8d-1211eb28962f with identifier: 1986608
2026-03-27 13:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0991cd93-117d-52a3-8e8d-1211eb28962f with scrape type 1
2026-03-27 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0991cd93-117d-52a3-8e8d-1211eb28962f
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F966%252F8761bb8708f34c24b5df1a9029d4137b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/966/8761bb8708f34c24b5df1a9029d4137b/images/large/1.jpg not downloaded yet
2026-03-27 13:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f23990>
2026-03-27 13:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652e8fb7-1346-50d3-9895-f121f51893b8/652e8fb7-1346-50d3-9895-f121f51893b8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252F25c1473de35c462fbac4e424eaf5dfc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/25c1473de35c462fbac4e424eaf5dfc9/images/large/1.jpg saved to cache
2026-03-27 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 652e8fb7-1346-50d3-9895-f121f51893b8
2026-03-27 13:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 652e8fb7-1346-50d3-9895-f121f51893b8, skipping ID generation
2026-03-27 13:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 652e8fb7-1346-50d3-9895-f121f51893b8 with scrape type 1
2026-03-27 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 652e8fb7-1346-50d3-9895-f121f51893b8 sending to next pipeline
2026-03-27 13:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 652e8fb7-1346-50d3-9895-f121f51893b8, identifier: 1986599
2026-03-27 13:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295766150>
2026-03-27 13:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5/cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F202%252Ff8448496afdf4e1b95abbcf077b77b95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/202/f8448496afdf4e1b95abbcf077b77b95/images/large/1.jpg saved to cache
2026-03-27 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5
2026-03-27 13:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5, skipping ID generation
2026-03-27 13:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with scrape type 1
2026-03-27 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 sending to next pipeline
2026-03-27 13:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5, identifier: 1986600
2026-03-27 13:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 652e8fb7-1346-50d3-9895-f121f51893b8 with identifier: 1986599
2026-03-27 13:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 652e8fb7-1346-50d3-9895-f121f51893b8 with identifier: 1986599
2026-03-27 13:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 652e8fb7-1346-50d3-9895-f121f51893b8 with identifier: 1986599 to the API
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/449/25c1473de35c462fbac4e424eaf5dfc9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '652e8fb7-1346-50d3-9895-f121f51893b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 58774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652e8fb7-1346-50d3-9895-f121f51893b8/652e8fb7-1346-50d3-9895-f121f51893b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/449/25c1473de35c462fbac4e424eaf5dfc9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986599%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [ayvens.es] INFO: Saving data for 1986599: {'created_time': 1774618252.040623, 'last_price_update_time': 1774618252.040634, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986599') HTTP/1.1" 204 0
2026-03-27 13:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with identifier: 1986600
2026-03-27 13:30:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with identifier: 1986600
2026-03-27 13:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with identifier: 1986600 to the API
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/202/f8448496afdf4e1b95abbcf077b77b95/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 225,
 'color': 'Grand',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SSANGYONG',
 'model': 'MUSSO',
 'odometer': 57551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5/cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/202/f8448496afdf4e1b95abbcf077b77b95/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SSANGYONG MUSSO (E) D22DTR 4x4 Pro',
 'transmission': 'manual',
 'trim': '(E) D22DTR 4x4 Pro',
 'vin': None,
 'year': 2023}
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986600%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [ayvens.es] INFO: Saving data for 1986600: {'created_time': 1774618252.372865, 'last_price_update_time': 1774618252.372876, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986600') HTTP/1.1" 204 0
2026-03-27 13:30:52 [ayvens.es] INFO: Found listing with ID: 1986609
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986609%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [ayvens.es] INFO: Scrape type for 1986609: 1
2026-03-27 13:30:52 [ayvens.es] INFO: Extracting data for car ID: 1986609
2026-03-27 13:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with identifier: 1986609
2026-03-27 13:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with scrape type 1
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F905%252Fa0876df06205423fa199a213895879a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/905/a0876df06205423fa199a213895879a5/images/large/1.jpg not downloaded yet
2026-03-27 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/875/bb9cfb693b194265a766ad8b1e8b5a64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/376/714fef5de9e44703b3ea8415cf8b963c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/269/0c9af926a28248bab2d9065a8c8c3621/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/774/a4bc080ee3c04e4ba0bca38a906dd501/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:52 [ayvens.es] INFO: Found listing with ID: 1986610
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986610%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [ayvens.es] INFO: Scrape type for 1986610: 1
2026-03-27 13:30:52 [ayvens.es] INFO: Extracting data for car ID: 1986610
2026-03-27 13:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e6a504-dd90-5409-9225-60fdd1e09db0 with identifier: 1986610
2026-03-27 13:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e6a504-dd90-5409-9225-60fdd1e09db0 with scrape type 1
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9e6a504-dd90-5409-9225-60fdd1e09db0
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F314%252Ffb435de8ae664a018de0672799e40005%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/314/fb435de8ae664a018de0672799e40005/images/large/1.jpg not downloaded yet
2026-03-27 13:30:52 [ayvens.es] INFO: Found listing with ID: 1986611
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986611%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [ayvens.es] INFO: Scrape type for 1986611: 1
2026-03-27 13:30:52 [ayvens.es] INFO: Extracting data for car ID: 1986611
2026-03-27 13:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with identifier: 1986611
2026-03-27 13:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with scrape type 1
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252F008f97c7526b495380b08beadf9fb098%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/008f97c7526b495380b08beadf9fb098/images/large/1.jpg not downloaded yet
2026-03-27 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/675/b992541030384d49b711a8e4ccf5f94a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/898/9d08787f7d354162a111cd36a4a77262/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:52 [ayvens.es] INFO: Found listing with ID: 1986612
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986612%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [ayvens.es] INFO: Scrape type for 1986612: 1
2026-03-27 13:30:52 [ayvens.es] INFO: Extracting data for car ID: 1986612
2026-03-27 13:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06646d94-ca2e-55f7-baf6-70a534a262cd with identifier: 1986612
2026-03-27 13:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06646d94-ca2e-55f7-baf6-70a534a262cd with scrape type 1
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 06646d94-ca2e-55f7-baf6-70a534a262cd
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F576%252F33cb02bb03974787aea355a86d853762%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/576/33cb02bb03974787aea355a86d853762/images/large/1.jpg not downloaded yet
2026-03-27 13:30:52 [ayvens.es] INFO: Found listing with ID: 1986613
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986613%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [ayvens.es] INFO: Scrape type for 1986613: 1
2026-03-27 13:30:52 [ayvens.es] INFO: Extracting data for car ID: 1986613
2026-03-27 13:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with identifier: 1986613
2026-03-27 13:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with scrape type 1
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252Fe47f1cc9b39740b9b964fedfac159efa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/e47f1cc9b39740b9b964fedfac159efa/images/large/1.jpg not downloaded yet
2026-03-27 13:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f8fd50>
2026-03-27 13:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_837d9b29-a71d-576b-b7dc-026ce5729a37/837d9b29-a71d-576b-b7dc-026ce5729a37_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252Fbb9cfb693b194265a766ad8b1e8b5a64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/bb9cfb693b194265a766ad8b1e8b5a64/images/large/1.jpg saved to cache
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 837d9b29-a71d-576b-b7dc-026ce5729a37
2026-03-27 13:30:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 837d9b29-a71d-576b-b7dc-026ce5729a37, skipping ID generation
2026-03-27 13:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837d9b29-a71d-576b-b7dc-026ce5729a37 with scrape type 1
2026-03-27 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 837d9b29-a71d-576b-b7dc-026ce5729a37 sending to next pipeline
2026-03-27 13:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 837d9b29-a71d-576b-b7dc-026ce5729a37, identifier: 1986602
2026-03-27 13:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529570c2d0>
2026-03-27 13:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b093631a-ef8f-5ba9-bc7f-012893408b30/b093631a-ef8f-5ba9-bc7f-012893408b30_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252F714fef5de9e44703b3ea8415cf8b963c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/714fef5de9e44703b3ea8415cf8b963c/images/large/1.jpg saved to cache
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b093631a-ef8f-5ba9-bc7f-012893408b30
2026-03-27 13:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b093631a-ef8f-5ba9-bc7f-012893408b30, skipping ID generation
2026-03-27 13:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b093631a-ef8f-5ba9-bc7f-012893408b30 with scrape type 1
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b093631a-ef8f-5ba9-bc7f-012893408b30 sending to next pipeline
2026-03-27 13:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b093631a-ef8f-5ba9-bc7f-012893408b30, identifier: 1986601
2026-03-27 13:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295707e50>
2026-03-27 13:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_499510cd-370c-594f-aac2-a356193afb70/499510cd-370c-594f-aac2-a356193afb70_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F269%252F0c9af926a28248bab2d9065a8c8c3621%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/269/0c9af926a28248bab2d9065a8c8c3621/images/large/1.jpg saved to cache
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 499510cd-370c-594f-aac2-a356193afb70
2026-03-27 13:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 499510cd-370c-594f-aac2-a356193afb70, skipping ID generation
2026-03-27 13:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499510cd-370c-594f-aac2-a356193afb70 with scrape type 1
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 499510cd-370c-594f-aac2-a356193afb70 sending to next pipeline
2026-03-27 13:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 499510cd-370c-594f-aac2-a356193afb70, identifier: 1986604
2026-03-27 13:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f7a810>
2026-03-27 13:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2330bc70-d639-5317-b4fc-f1d497ca14c3/2330bc70-d639-5317-b4fc-f1d497ca14c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252Fa4bc080ee3c04e4ba0bca38a906dd501%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/a4bc080ee3c04e4ba0bca38a906dd501/images/large/1.jpg saved to cache
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2330bc70-d639-5317-b4fc-f1d497ca14c3
2026-03-27 13:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2330bc70-d639-5317-b4fc-f1d497ca14c3, skipping ID generation
2026-03-27 13:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2330bc70-d639-5317-b4fc-f1d497ca14c3 with scrape type 1
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2330bc70-d639-5317-b4fc-f1d497ca14c3 sending to next pipeline
2026-03-27 13:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2330bc70-d639-5317-b4fc-f1d497ca14c3, identifier: 1986603
2026-03-27 13:30:53 [ayvens.es] INFO: Found listing with ID: 1986614
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986614%27 HTTP/1.1" 200 None
2026-03-27 13:30:53 [ayvens.es] INFO: Scrape type for 1986614: 1
2026-03-27 13:30:53 [ayvens.es] INFO: Extracting data for car ID: 1986614
2026-03-27 13:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5a06b69-5c86-5d81-8a55-a97375cb482b with identifier: 1986614
2026-03-27 13:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a06b69-5c86-5d81-8a55-a97375cb482b with scrape type 1
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5a06b69-5c86-5d81-8a55-a97375cb482b
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F970%252F7a2c08fe951a455aad12f2a22eb1e85a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/970/7a2c08fe951a455aad12f2a22eb1e85a/images/large/1.jpg not downloaded yet
2026-03-27 13:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 837d9b29-a71d-576b-b7dc-026ce5729a37 with identifier: 1986602
2026-03-27 13:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 837d9b29-a71d-576b-b7dc-026ce5729a37 with identifier: 1986602
2026-03-27 13:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 837d9b29-a71d-576b-b7dc-026ce5729a37 with identifier: 1986602 to the API
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/875/bb9cfb693b194265a766ad8b1e8b5a64/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '837d9b29-a71d-576b-b7dc-026ce5729a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV250',
 'odometer': 130568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837d9b29-a71d-576b-b7dc-026ce5729a37/837d9b29-a71d-576b-b7dc-026ce5729a37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/875/bb9cfb693b194265a766ad8b1e8b5a64/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'NISSAN NV250 2pl 1.5dCi 70 kW (95CV) L1H1 OPTIMA',
 'transmission': 'manual',
 'trim': '2pl 1.5dCi 70 kW (95CV) L1H1 OPTIMA',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986602%27 HTTP/1.1" 200 None
2026-03-27 13:30:53 [ayvens.es] INFO: Saving data for 1986602: {'created_time': 1774618253.828973, 'last_price_update_time': 1774618253.828982, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986602') HTTP/1.1" 204 0
2026-03-27 13:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b093631a-ef8f-5ba9-bc7f-012893408b30 with identifier: 1986601
2026-03-27 13:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b093631a-ef8f-5ba9-bc7f-012893408b30 with identifier: 1986601
2026-03-27 13:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b093631a-ef8f-5ba9-bc7f-012893408b30 with identifier: 1986601 to the API
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/376/714fef5de9e44703b3ea8415cf8b963c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b093631a-ef8f-5ba9-bc7f-012893408b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY',
 'odometer': 170874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b093631a-ef8f-5ba9-bc7f-012893408b30/b093631a-ef8f-5ba9-bc7f-012893408b30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/376/714fef5de9e44703b3ea8415cf8b963c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY 1.5D 75kW (100CV) VX L1',
 'transmission': 'manual',
 'trim': '1.5D 75kW (100CV) VX L1',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986601%27 HTTP/1.1" 200 None
2026-03-27 13:30:54 [ayvens.es] INFO: Saving data for 1986601: {'created_time': 1774618254.233013, 'last_price_update_time': 1774618254.233026, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986601') HTTP/1.1" 204 0
2026-03-27 13:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 499510cd-370c-594f-aac2-a356193afb70 with identifier: 1986604
2026-03-27 13:30:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 499510cd-370c-594f-aac2-a356193afb70 with identifier: 1986604
2026-03-27 13:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 499510cd-370c-594f-aac2-a356193afb70 with identifier: 1986604 to the API
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/269/0c9af926a28248bab2d9065a8c8c3621/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Cristal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '499510cd-370c-594f-aac2-a356193afb70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 87333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499510cd-370c-594f-aac2-a356193afb70/499510cd-370c-594f-aac2-a356193afb70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/269/0c9af926a28248bab2d9065a8c8c3621/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 Auto Bastille +',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 Auto Bastille +',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986604%27 HTTP/1.1" 200 None
2026-03-27 13:30:54 [ayvens.es] INFO: Saving data for 1986604: {'created_time': 1774618254.734248, 'last_price_update_time': 1774618254.734258, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986604') HTTP/1.1" 204 0
2026-03-27 13:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2330bc70-d639-5317-b4fc-f1d497ca14c3 with identifier: 1986603
2026-03-27 13:30:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2330bc70-d639-5317-b4fc-f1d497ca14c3 with identifier: 1986603
2026-03-27 13:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2330bc70-d639-5317-b4fc-f1d497ca14c3 with identifier: 1986603 to the API
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/774/a4bc080ee3c04e4ba0bca38a906dd501/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2330bc70-d639-5317-b4fc-f1d497ca14c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 91489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2330bc70-d639-5317-b4fc-f1d497ca14c3/2330bc70-d639-5317-b4fc-f1d497ca14c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/774/a4bc080ee3c04e4ba0bca38a906dd501/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986603%27 HTTP/1.1" 200 None
2026-03-27 13:30:55 [ayvens.es] INFO: Saving data for 1986603: {'created_time': 1774618255.093585, 'last_price_update_time': 1774618255.093595, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986603') HTTP/1.1" 204 0
2026-03-27 13:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f29050>
2026-03-27 13:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaa366d-6018-51ca-8a0c-131028ccd16f/9aaa366d-6018-51ca-8a0c-131028ccd16f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F675%252Fb992541030384d49b711a8e4ccf5f94a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/675/b992541030384d49b711a8e4ccf5f94a/images/large/1.jpg saved to cache
2026-03-27 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9aaa366d-6018-51ca-8a0c-131028ccd16f
2026-03-27 13:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9aaa366d-6018-51ca-8a0c-131028ccd16f, skipping ID generation
2026-03-27 13:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aaa366d-6018-51ca-8a0c-131028ccd16f with scrape type 1
2026-03-27 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9aaa366d-6018-51ca-8a0c-131028ccd16f sending to next pipeline
2026-03-27 13:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9aaa366d-6018-51ca-8a0c-131028ccd16f, identifier: 1986605
2026-03-27 13:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529615ce10>
2026-03-27 13:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_100b87c0-2dd8-5052-895b-f7e864cf4f15/100b87c0-2dd8-5052-895b-f7e864cf4f15_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F898%252F9d08787f7d354162a111cd36a4a77262%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/898/9d08787f7d354162a111cd36a4a77262/images/large/1.jpg saved to cache
2026-03-27 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 100b87c0-2dd8-5052-895b-f7e864cf4f15
2026-03-27 13:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 100b87c0-2dd8-5052-895b-f7e864cf4f15, skipping ID generation
2026-03-27 13:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100b87c0-2dd8-5052-895b-f7e864cf4f15 with scrape type 1
2026-03-27 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 100b87c0-2dd8-5052-895b-f7e864cf4f15 sending to next pipeline
2026-03-27 13:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 100b87c0-2dd8-5052-895b-f7e864cf4f15, identifier: 1986606
2026-03-27 13:30:55 [ayvens.es] INFO: Found listing with ID: 1986615
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986615%27 HTTP/1.1" 200 None
2026-03-27 13:30:55 [ayvens.es] INFO: Scrape type for 1986615: 1
2026-03-27 13:30:55 [ayvens.es] INFO: Extracting data for car ID: 1986615
2026-03-27 13:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c950cba2-66dd-562e-96f2-51f81b3bf6ef with identifier: 1986615
2026-03-27 13:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c950cba2-66dd-562e-96f2-51f81b3bf6ef with scrape type 1
2026-03-27 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c950cba2-66dd-562e-96f2-51f81b3bf6ef
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F780%252F80f49d0e86a844429f90dbd6d2b60557%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/780/80f49d0e86a844429f90dbd6d2b60557/images/large/1.jpg not downloaded yet
2026-03-27 13:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9aaa366d-6018-51ca-8a0c-131028ccd16f with identifier: 1986605
2026-03-27 13:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9aaa366d-6018-51ca-8a0c-131028ccd16f with identifier: 1986605
2026-03-27 13:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9aaa366d-6018-51ca-8a0c-131028ccd16f with identifier: 1986605 to the API
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/675/b992541030384d49b711a8e4ccf5f94a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '9aaa366d-6018-51ca-8a0c-131028ccd16f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4',
 'odometer': 30981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa366d-6018-51ca-8a0c-131028ccd16f/9aaa366d-6018-51ca-8a0c-131028ccd16f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/675/b992541030384d49b711a8e4ccf5f94a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 PureTech 100 S&S 6v Live Pack',
 'transmission': 'manual',
 'trim': 'PureTech 100 S&S 6v Live Pack',
 'vin': None,
 'year': 2023}
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986605%27 HTTP/1.1" 200 None
2026-03-27 13:30:55 [ayvens.es] INFO: Saving data for 1986605: {'created_time': 1774618255.896948, 'last_price_update_time': 1774618255.89696, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986605') HTTP/1.1" 204 0
2026-03-27 13:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 100b87c0-2dd8-5052-895b-f7e864cf4f15 with identifier: 1986606
2026-03-27 13:30:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 100b87c0-2dd8-5052-895b-f7e864cf4f15 with identifier: 1986606
2026-03-27 13:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 100b87c0-2dd8-5052-895b-f7e864cf4f15 with identifier: 1986606 to the API
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/898/9d08787f7d354162a111cd36a4a77262/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Micron',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '100b87c0-2dd8-5052-895b-f7e864cf4f15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 188617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100b87c0-2dd8-5052-895b-f7e864cf4f15/100b87c0-2dd8-5052-895b-f7e864cf4f15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/898/9d08787f7d354162a111cd36a4a77262/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.7CRDi 115cv BlueDr. 25 Aniversario 4x2',
 'transmission': 'manual',
 'trim': '1.7CRDi 115cv BlueDr. 25 Aniversario 4x2',
 'vin': None,
 'year': 2017}
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986606%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [ayvens.es] INFO: Saving data for 1986606: {'created_time': 1774618256.250807, 'last_price_update_time': 1774618256.250817, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986606') HTTP/1.1" 204 0
2026-03-27 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/766/76428173865340b8891c4d2a0831866d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:56 [ayvens.es] INFO: Found listing with ID: 1986616
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986616%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [ayvens.es] INFO: Scrape type for 1986616: 1
2026-03-27 13:30:56 [ayvens.es] INFO: Extracting data for car ID: 1986616
2026-03-27 13:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99aed2e1-9cff-5d29-98c6-306339f8830c with identifier: 1986616
2026-03-27 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99aed2e1-9cff-5d29-98c6-306339f8830c with scrape type 1
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99aed2e1-9cff-5d29-98c6-306339f8830c
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fce19a877b34748cda88ed6fa9e01001e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/ce19a877b34748cda88ed6fa9e01001e/images/large/1.jpg not downloaded yet
2026-03-27 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/314/fb435de8ae664a018de0672799e40005/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/905/a0876df06205423fa199a213895879a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/491/008f97c7526b495380b08beadf9fb098/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:56 [ayvens.es] INFO: Found listing with ID: 1986617
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986617%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [ayvens.es] INFO: Scrape type for 1986617: 1
2026-03-27 13:30:56 [ayvens.es] INFO: Extracting data for car ID: 1986617
2026-03-27 13:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d3ae65a-680c-5f31-b096-ba535136ca65 with identifier: 1986617
2026-03-27 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3ae65a-680c-5f31-b096-ba535136ca65 with scrape type 1
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8d3ae65a-680c-5f31-b096-ba535136ca65
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252F17261e2af3144df784157d4bbac527a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/17261e2af3144df784157d4bbac527a3/images/large/1.jpg not downloaded yet
2026-03-27 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/966/8761bb8708f34c24b5df1a9029d4137b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/576/33cb02bb03974787aea355a86d853762/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:30:56 [ayvens.es] INFO: Found listing with ID: 1986618
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986618%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [ayvens.es] INFO: Scrape type for 1986618: 1
2026-03-27 13:30:56 [ayvens.es] INFO: Extracting data for car ID: 1986618
2026-03-27 13:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde96a48-5eb6-50dd-8973-5a2fbf183fdf with identifier: 1986618
2026-03-27 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde96a48-5eb6-50dd-8973-5a2fbf183fdf with scrape type 1
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cde96a48-5eb6-50dd-8973-5a2fbf183fdf
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F011%252Fbd46b51d35a4419aabbd69bb96fc41c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/011/bd46b51d35a4419aabbd69bb96fc41c7/images/large/1.jpg not downloaded yet
2026-03-27 13:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ee5e10>
2026-03-27 13:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0167e490-d763-5612-a079-053a5d178e08/0167e490-d763-5612-a079-053a5d178e08_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252F76428173865340b8891c4d2a0831866d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/76428173865340b8891c4d2a0831866d/images/large/1.jpg saved to cache
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0167e490-d763-5612-a079-053a5d178e08
2026-03-27 13:30:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0167e490-d763-5612-a079-053a5d178e08, skipping ID generation
2026-03-27 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0167e490-d763-5612-a079-053a5d178e08 with scrape type 1
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0167e490-d763-5612-a079-053a5d178e08 sending to next pipeline
2026-03-27 13:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0167e490-d763-5612-a079-053a5d178e08, identifier: 1986607
2026-03-27 13:30:56 [ayvens.es] INFO: Found listing with ID: 1986619
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986619%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [ayvens.es] INFO: Scrape type for 1986619: 1
2026-03-27 13:30:56 [ayvens.es] INFO: Extracting data for car ID: 1986619
2026-03-27 13:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36235dbc-07c5-561f-9e33-64e7ed886e91 with identifier: 1986619
2026-03-27 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36235dbc-07c5-561f-9e33-64e7ed886e91 with scrape type 1
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36235dbc-07c5-561f-9e33-64e7ed886e91
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F304%252Fdf780d9eaca142909986c660a389e5ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/304/df780d9eaca142909986c660a389e5ad/images/large/1.jpg not downloaded yet
2026-03-27 13:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0167e490-d763-5612-a079-053a5d178e08 with identifier: 1986607
2026-03-27 13:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0167e490-d763-5612-a079-053a5d178e08 with identifier: 1986607
2026-03-27 13:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0167e490-d763-5612-a079-053a5d178e08 with identifier: 1986607 to the API
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/766/76428173865340b8891c4d2a0831866d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0167e490-d763-5612-a079-053a5d178e08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 40921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0167e490-d763-5612-a079-053a5d178e08/0167e490-d763-5612-a079-053a5d178e08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/766/76428173865340b8891c4d2a0831866d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT (O) 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '(O) 350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2024}
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986607%27 HTTP/1.1" 200 None
2026-03-27 13:30:56 [ayvens.es] INFO: Saving data for 1986607: {'created_time': 1774618256.954498, 'last_price_update_time': 1774618256.954507, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986607') HTTP/1.1" 204 0
2026-03-27 13:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f23890>
2026-03-27 13:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e6a504-dd90-5409-9225-60fdd1e09db0/c9e6a504-dd90-5409-9225-60fdd1e09db0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F314%252Ffb435de8ae664a018de0672799e40005%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/314/fb435de8ae664a018de0672799e40005/images/large/1.jpg saved to cache
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9e6a504-dd90-5409-9225-60fdd1e09db0
2026-03-27 13:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9e6a504-dd90-5409-9225-60fdd1e09db0, skipping ID generation
2026-03-27 13:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e6a504-dd90-5409-9225-60fdd1e09db0 with scrape type 1
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9e6a504-dd90-5409-9225-60fdd1e09db0 sending to next pipeline
2026-03-27 13:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c9e6a504-dd90-5409-9225-60fdd1e09db0, identifier: 1986610
2026-03-27 13:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960bd250>
2026-03-27 13:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c7a8db9-0574-5c8f-95af-f419d7aec4e3/1c7a8db9-0574-5c8f-95af-f419d7aec4e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F905%252Fa0876df06205423fa199a213895879a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/905/a0876df06205423fa199a213895879a5/images/large/1.jpg saved to cache
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3
2026-03-27 13:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3, skipping ID generation
2026-03-27 13:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with scrape type 1
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 sending to next pipeline
2026-03-27 13:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3, identifier: 1986609
2026-03-27 13:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ff2a50>
2026-03-27 13:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0988a8-6681-5ab5-a077-e4f7ba3b6555/ab0988a8-6681-5ab5-a077-e4f7ba3b6555_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252F008f97c7526b495380b08beadf9fb098%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/008f97c7526b495380b08beadf9fb098/images/large/1.jpg saved to cache
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555
2026-03-27 13:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab0988a8-6681-5ab5-a077-e4f7ba3b6555, skipping ID generation
2026-03-27 13:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with scrape type 1
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab0988a8-6681-5ab5-a077-e4f7ba3b6555 sending to next pipeline
2026-03-27 13:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab0988a8-6681-5ab5-a077-e4f7ba3b6555, identifier: 1986611
2026-03-27 13:30:57 [ayvens.es] INFO: Found listing with ID: 1986620
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986620%27 HTTP/1.1" 200 None
2026-03-27 13:30:57 [ayvens.es] INFO: Scrape type for 1986620: 1
2026-03-27 13:30:57 [ayvens.es] INFO: Extracting data for car ID: 1986620
2026-03-27 13:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a14685-3e89-5a53-be67-a8176f3787f6 with identifier: 1986620
2026-03-27 13:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a14685-3e89-5a53-be67-a8176f3787f6 with scrape type 1
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8a14685-3e89-5a53-be67-a8176f3787f6
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252F326b5e7428b24b419337143a85bae6f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/326b5e7428b24b419337143a85bae6f3/images/large/1.jpg not downloaded yet
2026-03-27 13:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c9e6a504-dd90-5409-9225-60fdd1e09db0 with identifier: 1986610
2026-03-27 13:30:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c9e6a504-dd90-5409-9225-60fdd1e09db0 with identifier: 1986610
2026-03-27 13:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c9e6a504-dd90-5409-9225-60fdd1e09db0 with identifier: 1986610 to the API
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/314/fb435de8ae664a018de0672799e40005/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Eiger',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c9e6a504-dd90-5409-9225-60fdd1e09db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 53668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e6a504-dd90-5409-9225-60fdd1e09db0/c9e6a504-dd90-5409-9225-60fdd1e09db0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/314/fb435de8ae664a018de0672799e40005/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986610%27 HTTP/1.1" 200 None
2026-03-27 13:30:57 [ayvens.es] INFO: Saving data for 1986610: {'created_time': 1774618257.908052, 'last_price_update_time': 1774618257.908064, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986610') HTTP/1.1" 204 0
2026-03-27 13:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with identifier: 1986609
2026-03-27 13:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with identifier: 1986609
2026-03-27 13:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with identifier: 1986609 to the API
2026-03-27 13:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/905/a0876df06205423fa199a213895879a5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '1c7a8db9-0574-5c8f-95af-f419d7aec4e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 142577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c7a8db9-0574-5c8f-95af-f419d7aec4e3/1c7a8db9-0574-5c8f-95af-f419d7aec4e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/905/a0876df06205423fa199a213895879a5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 250 4MATIC',
 'transmission': 'manual',
 'trim': 'CLA 250 4MATIC',
 'vin': None,
 'year': 2022}
2026-03-27 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986609%27 HTTP/1.1" 200 None
2026-03-27 13:30:58 [ayvens.es] INFO: Saving data for 1986609: {'created_time': 1774618258.264936, 'last_price_update_time': 1774618258.264947, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986609') HTTP/1.1" 204 0
2026-03-27 13:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with identifier: 1986611
2026-03-27 13:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with identifier: 1986611
2026-03-27 13:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab0988a8-6681-5ab5-a077-e4f7ba3b6555 with identifier: 1986611 to the API
2026-03-27 13:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/491/008f97c7526b495380b08beadf9fb098/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab0988a8-6681-5ab5-a077-e4f7ba3b6555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 179393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0988a8-6681-5ab5-a077-e4f7ba3b6555/ab0988a8-6681-5ab5-a077-e4f7ba3b6555_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/491/008f97c7526b495380b08beadf9fb098/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW (150CV) Titanium',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW (150CV) Titanium',
 'vin': None,
 'year': 2020}
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986611%27 HTTP/1.1" 200 None
2026-03-27 13:30:59 [ayvens.es] INFO: Saving data for 1986611: {'created_time': 1774618259.247216, 'last_price_update_time': 1774618259.247227, 'auction_closing_time': 1774868400.0}
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986611') HTTP/1.1" 204 0
2026-03-27 13:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295744710>
2026-03-27 13:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0991cd93-117d-52a3-8e8d-1211eb28962f/0991cd93-117d-52a3-8e8d-1211eb28962f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F966%252F8761bb8708f34c24b5df1a9029d4137b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/966/8761bb8708f34c24b5df1a9029d4137b/images/large/1.jpg saved to cache
2026-03-27 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0991cd93-117d-52a3-8e8d-1211eb28962f
2026-03-27 13:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0991cd93-117d-52a3-8e8d-1211eb28962f, skipping ID generation
2026-03-27 13:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0991cd93-117d-52a3-8e8d-1211eb28962f with scrape type 1
2026-03-27 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0991cd93-117d-52a3-8e8d-1211eb28962f sending to next pipeline
2026-03-27 13:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0991cd93-117d-52a3-8e8d-1211eb28962f, identifier: 1986608
2026-03-27 13:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529600b2d0>
2026-03-27 13:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06646d94-ca2e-55f7-baf6-70a534a262cd/06646d94-ca2e-55f7-baf6-70a534a262cd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F576%252F33cb02bb03974787aea355a86d853762%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/576/33cb02bb03974787aea355a86d853762/images/large/1.jpg saved to cache
2026-03-27 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06646d94-ca2e-55f7-baf6-70a534a262cd
2026-03-27 13:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06646d94-ca2e-55f7-baf6-70a534a262cd, skipping ID generation
2026-03-27 13:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06646d94-ca2e-55f7-baf6-70a534a262cd with scrape type 1
2026-03-27 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06646d94-ca2e-55f7-baf6-70a534a262cd sending to next pipeline
2026-03-27 13:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 06646d94-ca2e-55f7-baf6-70a534a262cd, identifier: 1986612
2026-03-27 13:30:59 [ayvens.es] INFO: Found listing with ID: 1986621
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986621%27 HTTP/1.1" 200 None
2026-03-27 13:30:59 [ayvens.es] INFO: Scrape type for 1986621: 1
2026-03-27 13:30:59 [ayvens.es] INFO: Extracting data for car ID: 1986621
2026-03-27 13:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45b5e429-91b6-5aa0-a500-dfdb5263b791 with identifier: 1986621
2026-03-27 13:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b5e429-91b6-5aa0-a500-dfdb5263b791 with scrape type 1
2026-03-27 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45b5e429-91b6-5aa0-a500-dfdb5263b791
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F387%252Fc0e9445670a54121bb4e9d8e811ee213%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/387/c0e9445670a54121bb4e9d8e811ee213/images/large/1.jpg not downloaded yet
2026-03-27 13:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0991cd93-117d-52a3-8e8d-1211eb28962f with identifier: 1986608
2026-03-27 13:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0991cd93-117d-52a3-8e8d-1211eb28962f with identifier: 1986608
2026-03-27 13:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0991cd93-117d-52a3-8e8d-1211eb28962f with identifier: 1986608 to the API
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/966/8761bb8708f34c24b5df1a9029d4137b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0991cd93-117d-52a3-8e8d-1211eb28962f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 99101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0991cd93-117d-52a3-8e8d-1211eb28962f/0991cd93-117d-52a3-8e8d-1211eb28962f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/966/8761bb8708f34c24b5df1a9029d4137b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW Titanium HEV AT SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW Titanium HEV AT SB',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986608%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [ayvens.es] INFO: Saving data for 1986608: {'created_time': 1774618260.10928, 'last_price_update_time': 1774618260.10929, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986608') HTTP/1.1" 204 0
2026-03-27 13:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 06646d94-ca2e-55f7-baf6-70a534a262cd with identifier: 1986612
2026-03-27 13:31:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 06646d94-ca2e-55f7-baf6-70a534a262cd with identifier: 1986612
2026-03-27 13:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 06646d94-ca2e-55f7-baf6-70a534a262cd with identifier: 1986612 to the API
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/576/33cb02bb03974787aea355a86d853762/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '06646d94-ca2e-55f7-baf6-70a534a262cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 164919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06646d94-ca2e-55f7-baf6-70a534a262cd/06646d94-ca2e-55f7-baf6-70a534a262cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/576/33cb02bb03974787aea355a86d853762/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec PHEV 165kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec PHEV 165kW Auto',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986612%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [ayvens.es] INFO: Saving data for 1986612: {'created_time': 1774618260.429183, 'last_price_update_time': 1774618260.429193, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986612') HTTP/1.1" 204 0
2026-03-27 13:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/620/e47f1cc9b39740b9b964fedfac159efa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/780/80f49d0e86a844429f90dbd6d2b60557/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:00 [ayvens.es] INFO: Found listing with ID: 1986622
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986622%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [ayvens.es] INFO: Scrape type for 1986622: 1
2026-03-27 13:31:00 [ayvens.es] INFO: Extracting data for car ID: 1986622
2026-03-27 13:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c188c0b4-c281-5471-955f-81153c0ccfcb with identifier: 1986622
2026-03-27 13:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c188c0b4-c281-5471-955f-81153c0ccfcb with scrape type 1
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c188c0b4-c281-5471-955f-81153c0ccfcb
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F923%252F3005610a41c3477db8b4860b0ceb5264%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/923/3005610a41c3477db8b4860b0ceb5264/images/large/1.jpg not downloaded yet
2026-03-27 13:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/970/7a2c08fe951a455aad12f2a22eb1e85a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/068/17261e2af3144df784157d4bbac527a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:00 [ayvens.es] INFO: Found listing with ID: 1986623
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986623%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [ayvens.es] INFO: Scrape type for 1986623: 1
2026-03-27 13:31:00 [ayvens.es] INFO: Extracting data for car ID: 1986623
2026-03-27 13:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4 with identifier: 1986623
2026-03-27 13:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4 with scrape type 1
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F36b77aa4b5df45d58870ece173dfea23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/36b77aa4b5df45d58870ece173dfea23/images/large/1.jpg not downloaded yet
2026-03-27 13:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/056/ce19a877b34748cda88ed6fa9e01001e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/011/bd46b51d35a4419aabbd69bb96fc41c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:00 [ayvens.es] INFO: Found listing with ID: 1986624
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986624%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [ayvens.es] INFO: Scrape type for 1986624: 1
2026-03-27 13:31:00 [ayvens.es] INFO: Extracting data for car ID: 1986624
2026-03-27 13:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408d3b26-1fc6-55f6-a24d-709479f27426 with identifier: 1986624
2026-03-27 13:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408d3b26-1fc6-55f6-a24d-709479f27426 with scrape type 1
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 408d3b26-1fc6-55f6-a24d-709479f27426
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F497%252Fe0c5eb7043e44097ab1d2dbd1b7784f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/497/e0c5eb7043e44097ab1d2dbd1b7784f3/images/large/1.jpg not downloaded yet
2026-03-27 13:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/304/df780d9eaca142909986c660a389e5ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945ca4d0>
2026-03-27 13:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd9a2ccb-c26b-53d1-8985-a82109cfa4d2/fd9a2ccb-c26b-53d1-8985-a82109cfa4d2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252Fe47f1cc9b39740b9b964fedfac159efa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/e47f1cc9b39740b9b964fedfac159efa/images/large/1.jpg saved to cache
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2
2026-03-27 13:31:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2, skipping ID generation
2026-03-27 13:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with scrape type 1
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 sending to next pipeline
2026-03-27 13:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2, identifier: 1986613
2026-03-27 13:31:00 [ayvens.es] INFO: Found listing with ID: 1986625
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986625%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [ayvens.es] INFO: Scrape type for 1986625: 1
2026-03-27 13:31:00 [ayvens.es] INFO: Extracting data for car ID: 1986625
2026-03-27 13:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with identifier: 1986625
2026-03-27 13:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with scrape type 1
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252F6d392556642641aab0b2914f84cb370b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/6d392556642641aab0b2914f84cb370b/images/large/1.jpg not downloaded yet
2026-03-27 13:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with identifier: 1986613
2026-03-27 13:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with identifier: 1986613
2026-03-27 13:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fd9a2ccb-c26b-53d1-8985-a82109cfa4d2 with identifier: 1986613 to the API
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/620/e47f1cc9b39740b9b964fedfac159efa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Cristal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'fd9a2ccb-c26b-53d1-8985-a82109cfa4d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 93829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9a2ccb-c26b-53d1-8985-a82109cfa4d2/fd9a2ccb-c26b-53d1-8985-a82109cfa4d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/620/e47f1cc9b39740b9b964fedfac159efa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 Auto Bastille +',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 Auto Bastille +',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986613%27 HTTP/1.1" 200 None
2026-03-27 13:31:01 [ayvens.es] INFO: Saving data for 1986613: {'created_time': 1774618261.2282, 'last_price_update_time': 1774618261.228211, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986613') HTTP/1.1" 204 0
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529602aa10>
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c950cba2-66dd-562e-96f2-51f81b3bf6ef/c950cba2-66dd-562e-96f2-51f81b3bf6ef_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F780%252F80f49d0e86a844429f90dbd6d2b60557%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/780/80f49d0e86a844429f90dbd6d2b60557/images/large/1.jpg saved to cache
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c950cba2-66dd-562e-96f2-51f81b3bf6ef
2026-03-27 13:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c950cba2-66dd-562e-96f2-51f81b3bf6ef, skipping ID generation
2026-03-27 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c950cba2-66dd-562e-96f2-51f81b3bf6ef with scrape type 1
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c950cba2-66dd-562e-96f2-51f81b3bf6ef sending to next pipeline
2026-03-27 13:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c950cba2-66dd-562e-96f2-51f81b3bf6ef, identifier: 1986615
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957525d0>
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a06b69-5c86-5d81-8a55-a97375cb482b/d5a06b69-5c86-5d81-8a55-a97375cb482b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F970%252F7a2c08fe951a455aad12f2a22eb1e85a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/970/7a2c08fe951a455aad12f2a22eb1e85a/images/large/1.jpg saved to cache
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5a06b69-5c86-5d81-8a55-a97375cb482b
2026-03-27 13:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5a06b69-5c86-5d81-8a55-a97375cb482b, skipping ID generation
2026-03-27 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a06b69-5c86-5d81-8a55-a97375cb482b with scrape type 1
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5a06b69-5c86-5d81-8a55-a97375cb482b sending to next pipeline
2026-03-27 13:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d5a06b69-5c86-5d81-8a55-a97375cb482b, identifier: 1986614
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529601a810>
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d3ae65a-680c-5f31-b096-ba535136ca65/8d3ae65a-680c-5f31-b096-ba535136ca65_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252F17261e2af3144df784157d4bbac527a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/17261e2af3144df784157d4bbac527a3/images/large/1.jpg saved to cache
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d3ae65a-680c-5f31-b096-ba535136ca65
2026-03-27 13:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d3ae65a-680c-5f31-b096-ba535136ca65, skipping ID generation
2026-03-27 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3ae65a-680c-5f31-b096-ba535136ca65 with scrape type 1
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d3ae65a-680c-5f31-b096-ba535136ca65 sending to next pipeline
2026-03-27 13:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8d3ae65a-680c-5f31-b096-ba535136ca65, identifier: 1986617
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0de90>
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99aed2e1-9cff-5d29-98c6-306339f8830c/99aed2e1-9cff-5d29-98c6-306339f8830c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fce19a877b34748cda88ed6fa9e01001e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/ce19a877b34748cda88ed6fa9e01001e/images/large/1.jpg saved to cache
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99aed2e1-9cff-5d29-98c6-306339f8830c
2026-03-27 13:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99aed2e1-9cff-5d29-98c6-306339f8830c, skipping ID generation
2026-03-27 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99aed2e1-9cff-5d29-98c6-306339f8830c with scrape type 1
2026-03-27 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99aed2e1-9cff-5d29-98c6-306339f8830c sending to next pipeline
2026-03-27 13:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99aed2e1-9cff-5d29-98c6-306339f8830c, identifier: 1986616
2026-03-27 13:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960cfc90>
2026-03-27 13:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde96a48-5eb6-50dd-8973-5a2fbf183fdf/cde96a48-5eb6-50dd-8973-5a2fbf183fdf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F011%252Fbd46b51d35a4419aabbd69bb96fc41c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/011/bd46b51d35a4419aabbd69bb96fc41c7/images/large/1.jpg saved to cache
2026-03-27 13:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cde96a48-5eb6-50dd-8973-5a2fbf183fdf
2026-03-27 13:31:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cde96a48-5eb6-50dd-8973-5a2fbf183fdf, skipping ID generation
2026-03-27 13:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde96a48-5eb6-50dd-8973-5a2fbf183fdf with scrape type 1
2026-03-27 13:31:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cde96a48-5eb6-50dd-8973-5a2fbf183fdf sending to next pipeline
2026-03-27 13:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cde96a48-5eb6-50dd-8973-5a2fbf183fdf, identifier: 1986618
2026-03-27 13:31:02 [ayvens.es] INFO: Found listing with ID: 1986626
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986626%27 HTTP/1.1" 200 None
2026-03-27 13:31:02 [ayvens.es] INFO: Scrape type for 1986626: 1
2026-03-27 13:31:02 [ayvens.es] INFO: Extracting data for car ID: 1986626
2026-03-27 13:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf64a30e-0d69-5994-9e23-41880ede47c5 with identifier: 1986626
2026-03-27 13:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf64a30e-0d69-5994-9e23-41880ede47c5 with scrape type 1
2026-03-27 13:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf64a30e-0d69-5994-9e23-41880ede47c5
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F517%252F8081345819d34b08b0b7234b48b95688%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/517/8081345819d34b08b0b7234b48b95688/images/large/1.jpg not downloaded yet
2026-03-27 13:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c950cba2-66dd-562e-96f2-51f81b3bf6ef with identifier: 1986615
2026-03-27 13:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c950cba2-66dd-562e-96f2-51f81b3bf6ef with identifier: 1986615
2026-03-27 13:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c950cba2-66dd-562e-96f2-51f81b3bf6ef with identifier: 1986615 to the API
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/780/80f49d0e86a844429f90dbd6d2b60557/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c950cba2-66dd-562e-96f2-51f81b3bf6ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 86266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c950cba2-66dd-562e-96f2-51f81b3bf6ef/c950cba2-66dd-562e-96f2-51f81b3bf6ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/780/80f49d0e86a844429f90dbd6d2b60557/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 (O) BlueHDi 73KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': '(O) BlueHDi 73KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986615%27 HTTP/1.1" 200 None
2026-03-27 13:31:02 [ayvens.es] INFO: Saving data for 1986615: {'created_time': 1774618262.622869, 'last_price_update_time': 1774618262.622881, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986615') HTTP/1.1" 204 0
2026-03-27 13:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d5a06b69-5c86-5d81-8a55-a97375cb482b with identifier: 1986614
2026-03-27 13:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d5a06b69-5c86-5d81-8a55-a97375cb482b with identifier: 1986614
2026-03-27 13:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d5a06b69-5c86-5d81-8a55-a97375cb482b with identifier: 1986614 to the API
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/970/7a2c08fe951a455aad12f2a22eb1e85a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd5a06b69-5c86-5d81-8a55-a97375cb482b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 93142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a06b69-5c86-5d81-8a55-a97375cb482b/d5a06b69-5c86-5d81-8a55-a97375cb482b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/970/7a2c08fe951a455aad12f2a22eb1e85a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (E) Business Energy dCi 75 eco2 Euro 6',
 'transmission': 'manual',
 'trim': '(E) Business Energy dCi 75 eco2 Euro 6',
 'vin': None,
 'year': 2016}
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986614%27 HTTP/1.1" 200 None
2026-03-27 13:31:02 [ayvens.es] INFO: Saving data for 1986614: {'created_time': 1774618262.955455, 'last_price_update_time': 1774618262.955465, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986614') HTTP/1.1" 204 0
2026-03-27 13:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8d3ae65a-680c-5f31-b096-ba535136ca65 with identifier: 1986617
2026-03-27 13:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8d3ae65a-680c-5f31-b096-ba535136ca65 with identifier: 1986617
2026-03-27 13:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8d3ae65a-680c-5f31-b096-ba535136ca65 with identifier: 1986617 to the API
2026-03-27 13:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/068/17261e2af3144df784157d4bbac527a3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d3ae65a-680c-5f31-b096-ba535136ca65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 118245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d3ae65a-680c-5f31-b096-ba535136ca65/8d3ae65a-680c-5f31-b096-ba535136ca65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/068/17261e2af3144df784157d4bbac527a3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986617%27 HTTP/1.1" 200 None
2026-03-27 13:31:03 [ayvens.es] INFO: Saving data for 1986617: {'created_time': 1774618263.351839, 'last_price_update_time': 1774618263.35185, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986617') HTTP/1.1" 204 0
2026-03-27 13:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99aed2e1-9cff-5d29-98c6-306339f8830c with identifier: 1986616
2026-03-27 13:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99aed2e1-9cff-5d29-98c6-306339f8830c with identifier: 1986616
2026-03-27 13:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99aed2e1-9cff-5d29-98c6-306339f8830c with identifier: 1986616 to the API
2026-03-27 13:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/056/ce19a877b34748cda88ed6fa9e01001e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '99aed2e1-9cff-5d29-98c6-306339f8830c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 151563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99aed2e1-9cff-5d29-98c6-306339f8830c/99aed2e1-9cff-5d29-98c6-306339f8830c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/ce19a877b34748cda88ed6fa9e01001e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P BUSINESS LINE 1.6 BlueHDi 55KW (75CV)',
 'transmission': 'manual',
 'trim': '5P BUSINESS LINE 1.6 BlueHDi 55KW (75CV)',
 'vin': None,
 'year': 2017}
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986616%27 HTTP/1.1" 200 None
2026-03-27 13:31:04 [ayvens.es] INFO: Saving data for 1986616: {'created_time': 1774618264.136082, 'last_price_update_time': 1774618264.136091, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986616') HTTP/1.1" 204 0
2026-03-27 13:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cde96a48-5eb6-50dd-8973-5a2fbf183fdf with identifier: 1986618
2026-03-27 13:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cde96a48-5eb6-50dd-8973-5a2fbf183fdf with identifier: 1986618
2026-03-27 13:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cde96a48-5eb6-50dd-8973-5a2fbf183fdf with identifier: 1986618 to the API
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/011/bd46b51d35a4419aabbd69bb96fc41c7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cde96a48-5eb6-50dd-8973-5a2fbf183fdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 91193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde96a48-5eb6-50dd-8973-5a2fbf183fdf/cde96a48-5eb6-50dd-8973-5a2fbf183fdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/011/bd46b51d35a4419aabbd69bb96fc41c7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986618%27 HTTP/1.1" 200 None
2026-03-27 13:31:04 [ayvens.es] INFO: Saving data for 1986618: {'created_time': 1774618264.456675, 'last_price_update_time': 1774618264.456687, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986618') HTTP/1.1" 204 0
2026-03-27 13:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c1850>
2026-03-27 13:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36235dbc-07c5-561f-9e33-64e7ed886e91/36235dbc-07c5-561f-9e33-64e7ed886e91_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F304%252Fdf780d9eaca142909986c660a389e5ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/304/df780d9eaca142909986c660a389e5ad/images/large/1.jpg saved to cache
2026-03-27 13:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36235dbc-07c5-561f-9e33-64e7ed886e91
2026-03-27 13:31:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36235dbc-07c5-561f-9e33-64e7ed886e91, skipping ID generation
2026-03-27 13:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36235dbc-07c5-561f-9e33-64e7ed886e91 with scrape type 1
2026-03-27 13:31:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36235dbc-07c5-561f-9e33-64e7ed886e91 sending to next pipeline
2026-03-27 13:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 36235dbc-07c5-561f-9e33-64e7ed886e91, identifier: 1986619
2026-03-27 13:31:04 [ayvens.es] INFO: Found listing with ID: 1986627
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986627%27 HTTP/1.1" 200 None
2026-03-27 13:31:04 [ayvens.es] INFO: Scrape type for 1986627: 1
2026-03-27 13:31:04 [ayvens.es] INFO: Extracting data for car ID: 1986627
2026-03-27 13:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb72612-c7f1-5919-9496-2bbd25b7fb4d with identifier: 1986627
2026-03-27 13:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb72612-c7f1-5919-9496-2bbd25b7fb4d with scrape type 1
2026-03-27 13:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cdb72612-c7f1-5919-9496-2bbd25b7fb4d
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F762%252F7e9e62bc36cc4a7e9580bf9e425cb5a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/762/7e9e62bc36cc4a7e9580bf9e425cb5a8/images/large/1.jpg not downloaded yet
2026-03-27 13:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 36235dbc-07c5-561f-9e33-64e7ed886e91 with identifier: 1986619
2026-03-27 13:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 36235dbc-07c5-561f-9e33-64e7ed886e91 with identifier: 1986619
2026-03-27 13:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 36235dbc-07c5-561f-9e33-64e7ed886e91 with identifier: 1986619 to the API
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/304/df780d9eaca142909986c660a389e5ad/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '36235dbc-07c5-561f-9e33-64e7ed886e91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 64686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36235dbc-07c5-561f-9e33-64e7ed886e91/36235dbc-07c5-561f-9e33-64e7ed886e91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/304/df780d9eaca142909986c660a389e5ad/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986619%27 HTTP/1.1" 200 None
2026-03-27 13:31:04 [ayvens.es] INFO: Saving data for 1986619: {'created_time': 1774618264.96948, 'last_price_update_time': 1774618264.96949, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986619') HTTP/1.1" 204 0
2026-03-27 13:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/387/c0e9445670a54121bb4e9d8e811ee213/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/899/326b5e7428b24b419337143a85bae6f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:04 [ayvens.es] INFO: Found listing with ID: 1986628
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986628%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [ayvens.es] INFO: Scrape type for 1986628: 1
2026-03-27 13:31:05 [ayvens.es] INFO: Extracting data for car ID: 1986628
2026-03-27 13:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a8985e-2c65-5c30-a218-204f397eaa97 with identifier: 1986628
2026-03-27 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a8985e-2c65-5c30-a218-204f397eaa97 with scrape type 1
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 40a8985e-2c65-5c30-a218-204f397eaa97
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F967%252F90cc018e88ae4da292a01abf5a268100%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/967/90cc018e88ae4da292a01abf5a268100/images/large/1.jpg not downloaded yet
2026-03-27 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/923/3005610a41c3477db8b4860b0ceb5264/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/757/36b77aa4b5df45d58870ece173dfea23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:05 [ayvens.es] INFO: Found listing with ID: 1986629
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986629%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [ayvens.es] INFO: Scrape type for 1986629: 1
2026-03-27 13:31:05 [ayvens.es] INFO: Extracting data for car ID: 1986629
2026-03-27 13:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf488fcc-e2ed-516d-ae16-04de92a869a7 with identifier: 1986629
2026-03-27 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf488fcc-e2ed-516d-ae16-04de92a869a7 with scrape type 1
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf488fcc-e2ed-516d-ae16-04de92a869a7
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F788%252Fe93341f1442142cebeba210b31e60d61%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/788/e93341f1442142cebeba210b31e60d61/images/large/1.jpg not downloaded yet
2026-03-27 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/497/e0c5eb7043e44097ab1d2dbd1b7784f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:05 [ayvens.es] INFO: Found listing with ID: 1986630
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986630%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [ayvens.es] INFO: Scrape type for 1986630: 1
2026-03-27 13:31:05 [ayvens.es] INFO: Extracting data for car ID: 1986630
2026-03-27 13:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f498a3bd-f5f7-5494-8add-e1e318a76046 with identifier: 1986630
2026-03-27 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f498a3bd-f5f7-5494-8add-e1e318a76046 with scrape type 1
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f498a3bd-f5f7-5494-8add-e1e318a76046
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252F59f73ac5e61c46a7a3b1fd87b4f7455b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/59f73ac5e61c46a7a3b1fd87b4f7455b/images/large/1.jpg not downloaded yet
2026-03-27 13:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52981cbb10>
2026-03-27 13:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b5e429-91b6-5aa0-a500-dfdb5263b791/45b5e429-91b6-5aa0-a500-dfdb5263b791_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F387%252Fc0e9445670a54121bb4e9d8e811ee213%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/387/c0e9445670a54121bb4e9d8e811ee213/images/large/1.jpg saved to cache
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45b5e429-91b6-5aa0-a500-dfdb5263b791
2026-03-27 13:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45b5e429-91b6-5aa0-a500-dfdb5263b791, skipping ID generation
2026-03-27 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b5e429-91b6-5aa0-a500-dfdb5263b791 with scrape type 1
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45b5e429-91b6-5aa0-a500-dfdb5263b791 sending to next pipeline
2026-03-27 13:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45b5e429-91b6-5aa0-a500-dfdb5263b791, identifier: 1986621
2026-03-27 13:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529577e010>
2026-03-27 13:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8a14685-3e89-5a53-be67-a8176f3787f6/c8a14685-3e89-5a53-be67-a8176f3787f6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252F326b5e7428b24b419337143a85bae6f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/326b5e7428b24b419337143a85bae6f3/images/large/1.jpg saved to cache
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8a14685-3e89-5a53-be67-a8176f3787f6
2026-03-27 13:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8a14685-3e89-5a53-be67-a8176f3787f6, skipping ID generation
2026-03-27 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a14685-3e89-5a53-be67-a8176f3787f6 with scrape type 1
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8a14685-3e89-5a53-be67-a8176f3787f6 sending to next pipeline
2026-03-27 13:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c8a14685-3e89-5a53-be67-a8176f3787f6, identifier: 1986620
2026-03-27 13:31:05 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 5 pages/min), scraped 56 items (at 56 items/min)
2026-03-27 13:31:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 174MiB
2026-03-27 13:31:05 [ayvens.es] INFO: Found listing with ID: 1986631
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986631%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [ayvens.es] INFO: Scrape type for 1986631: 1
2026-03-27 13:31:05 [ayvens.es] INFO: Extracting data for car ID: 1986631
2026-03-27 13:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with identifier: 1986631
2026-03-27 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with scrape type 1
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F764%252Ff5df1d6a02194b0588f8a2a074e1da34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/764/f5df1d6a02194b0588f8a2a074e1da34/images/large/1.jpg not downloaded yet
2026-03-27 13:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45b5e429-91b6-5aa0-a500-dfdb5263b791 with identifier: 1986621
2026-03-27 13:31:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45b5e429-91b6-5aa0-a500-dfdb5263b791 with identifier: 1986621
2026-03-27 13:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45b5e429-91b6-5aa0-a500-dfdb5263b791 with identifier: 1986621 to the API
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/387/c0e9445670a54121bb4e9d8e811ee213/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Firenze',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '45b5e429-91b6-5aa0-a500-dfdb5263b791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 68619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b5e429-91b6-5aa0-a500-dfdb5263b791/45b5e429-91b6-5aa0-a500-dfdb5263b791_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/387/c0e9445670a54121bb4e9d8e811ee213/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986621%27 HTTP/1.1" 200 None
2026-03-27 13:31:05 [ayvens.es] INFO: Saving data for 1986621: {'created_time': 1774618265.852557, 'last_price_update_time': 1774618265.852569, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986621') HTTP/1.1" 204 0
2026-03-27 13:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c8a14685-3e89-5a53-be67-a8176f3787f6 with identifier: 1986620
2026-03-27 13:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c8a14685-3e89-5a53-be67-a8176f3787f6 with identifier: 1986620
2026-03-27 13:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c8a14685-3e89-5a53-be67-a8176f3787f6 with identifier: 1986620 to the API
2026-03-27 13:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/899/326b5e7428b24b419337143a85bae6f3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c8a14685-3e89-5a53-be67-a8176f3787f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 99628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a14685-3e89-5a53-be67-a8176f3787f6/c8a14685-3e89-5a53-be67-a8176f3787f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/899/326b5e7428b24b419337143a85bae6f3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986620%27 HTTP/1.1" 200 None
2026-03-27 13:31:06 [ayvens.es] INFO: Saving data for 1986620: {'created_time': 1774618266.178053, 'last_price_update_time': 1774618266.178063, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986620') HTTP/1.1" 204 0
2026-03-27 13:31:06 [ayvens.es] INFO: Found listing with ID: 1986632
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986632%27 HTTP/1.1" 200 None
2026-03-27 13:31:06 [ayvens.es] INFO: Scrape type for 1986632: 1
2026-03-27 13:31:06 [ayvens.es] INFO: Extracting data for car ID: 1986632
2026-03-27 13:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with identifier: 1986632
2026-03-27 13:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with scrape type 1
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F8722c78de37c497cbf9e0262206de099%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/8722c78de37c497cbf9e0262206de099/images/large/1.jpg not downloaded yet
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297943290>
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c188c0b4-c281-5471-955f-81153c0ccfcb/c188c0b4-c281-5471-955f-81153c0ccfcb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F923%252F3005610a41c3477db8b4860b0ceb5264%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/923/3005610a41c3477db8b4860b0ceb5264/images/large/1.jpg saved to cache
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c188c0b4-c281-5471-955f-81153c0ccfcb
2026-03-27 13:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c188c0b4-c281-5471-955f-81153c0ccfcb, skipping ID generation
2026-03-27 13:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c188c0b4-c281-5471-955f-81153c0ccfcb with scrape type 1
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c188c0b4-c281-5471-955f-81153c0ccfcb sending to next pipeline
2026-03-27 13:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c188c0b4-c281-5471-955f-81153c0ccfcb, identifier: 1986622
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960a0610>
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a093bd9-b57a-5a84-a9f6-7df968c5fcb4/7a093bd9-b57a-5a84-a9f6-7df968c5fcb4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F36b77aa4b5df45d58870ece173dfea23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/36b77aa4b5df45d58870ece173dfea23/images/large/1.jpg saved to cache
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4
2026-03-27 13:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4, skipping ID generation
2026-03-27 13:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4 with scrape type 1
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4 sending to next pipeline
2026-03-27 13:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4, identifier: 1986623
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bde350>
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408d3b26-1fc6-55f6-a24d-709479f27426/408d3b26-1fc6-55f6-a24d-709479f27426_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F497%252Fe0c5eb7043e44097ab1d2dbd1b7784f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/497/e0c5eb7043e44097ab1d2dbd1b7784f3/images/large/1.jpg saved to cache
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 408d3b26-1fc6-55f6-a24d-709479f27426
2026-03-27 13:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 408d3b26-1fc6-55f6-a24d-709479f27426, skipping ID generation
2026-03-27 13:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408d3b26-1fc6-55f6-a24d-709479f27426 with scrape type 1
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 408d3b26-1fc6-55f6-a24d-709479f27426 sending to next pipeline
2026-03-27 13:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 408d3b26-1fc6-55f6-a24d-709479f27426, identifier: 1986624
2026-03-27 13:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/803/6d392556642641aab0b2914f84cb370b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:06 [ayvens.es] INFO: Found listing with ID: 1986633
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986633%27 HTTP/1.1" 200 None
2026-03-27 13:31:06 [ayvens.es] INFO: Scrape type for 1986633: 1
2026-03-27 13:31:06 [ayvens.es] INFO: Extracting data for car ID: 1986633
2026-03-27 13:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bf23cb-9e65-5a55-9197-e8a828180e6c with identifier: 1986633
2026-03-27 13:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bf23cb-9e65-5a55-9197-e8a828180e6c with scrape type 1
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 01bf23cb-9e65-5a55-9197-e8a828180e6c
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F138%252Fe87714a3c0484f63bfe3de8bd120947f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/138/e87714a3c0484f63bfe3de8bd120947f/images/large/1.jpg not downloaded yet
2026-03-27 13:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c188c0b4-c281-5471-955f-81153c0ccfcb with identifier: 1986622
2026-03-27 13:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c188c0b4-c281-5471-955f-81153c0ccfcb with identifier: 1986622
2026-03-27 13:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c188c0b4-c281-5471-955f-81153c0ccfcb with identifier: 1986622 to the API
2026-03-27 13:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/923/3005610a41c3477db8b4860b0ceb5264/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c188c0b4-c281-5471-955f-81153c0ccfcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 90014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c188c0b4-c281-5471-955f-81153c0ccfcb/c188c0b4-c281-5471-955f-81153c0ccfcb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/923/3005610a41c3477db8b4860b0ceb5264/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'SW Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986622%27 HTTP/1.1" 200 None
2026-03-27 13:31:07 [ayvens.es] INFO: Saving data for 1986622: {'created_time': 1774618267.176518, 'last_price_update_time': 1774618267.176528, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986622') HTTP/1.1" 204 0
2026-03-27 13:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4 with identifier: 1986623
2026-03-27 13:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4 with identifier: 1986623
2026-03-27 13:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7a093bd9-b57a-5a84-a9f6-7df968c5fcb4 with identifier: 1986623 to the API
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/757/36b77aa4b5df45d58870ece173dfea23/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7a093bd9-b57a-5a84-a9f6-7df968c5fcb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 103735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a093bd9-b57a-5a84-a9f6-7df968c5fcb4/7a093bd9-b57a-5a84-a9f6-7df968c5fcb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/757/36b77aa4b5df45d58870ece173dfea23/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Kombi 1.5 TDCi 55kW Ambiente 220 L1 (N1)',
 'transmission': 'manual',
 'trim': 'Kombi 1.5 TDCi 55kW Ambiente 220 L1 (N1)',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986623%27 HTTP/1.1" 200 None
2026-03-27 13:31:07 [ayvens.es] INFO: Saving data for 1986623: {'created_time': 1774618267.955015, 'last_price_update_time': 1774618267.955026, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986623') HTTP/1.1" 204 0
2026-03-27 13:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 408d3b26-1fc6-55f6-a24d-709479f27426 with identifier: 1986624
2026-03-27 13:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 408d3b26-1fc6-55f6-a24d-709479f27426 with identifier: 1986624
2026-03-27 13:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 408d3b26-1fc6-55f6-a24d-709479f27426 with identifier: 1986624 to the API
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/497/e0c5eb7043e44097ab1d2dbd1b7784f3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '408d3b26-1fc6-55f6-a24d-709479f27426',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 89893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408d3b26-1fc6-55f6-a24d-709479f27426/408d3b26-1fc6-55f6-a24d-709479f27426_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/497/e0c5eb7043e44097ab1d2dbd1b7784f3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Comfort Bl. dCi 85kW(115CV) 4X2',
 'transmission': 'manual',
 'trim': 'Comfort Bl. dCi 85kW(115CV) 4X2',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986624%27 HTTP/1.1" 200 None
2026-03-27 13:31:08 [ayvens.es] INFO: Saving data for 1986624: {'created_time': 1774618268.332349, 'last_price_update_time': 1774618268.332363, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986624') HTTP/1.1" 204 0
2026-03-27 13:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/517/8081345819d34b08b0b7234b48b95688/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/762/7e9e62bc36cc4a7e9580bf9e425cb5a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/967/90cc018e88ae4da292a01abf5a268100/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:08 [ayvens.es] INFO: Found listing with ID: 1986634
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986634%27 HTTP/1.1" 200 None
2026-03-27 13:31:08 [ayvens.es] INFO: Scrape type for 1986634: 1
2026-03-27 13:31:08 [ayvens.es] INFO: Extracting data for car ID: 1986634
2026-03-27 13:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with identifier: 1986634
2026-03-27 13:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with scrape type 1
2026-03-27 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Feca989b77f1b46639edda6b52107a0c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/eca989b77f1b46639edda6b52107a0c2/images/large/1.jpg not downloaded yet
2026-03-27 13:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ed7f90>
2026-03-27 13:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8d31e8b-d6e7-5ef5-9266-6698f58b02ea/f8d31e8b-d6e7-5ef5-9266-6698f58b02ea_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252F6d392556642641aab0b2914f84cb370b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/6d392556642641aab0b2914f84cb370b/images/large/1.jpg saved to cache
2026-03-27 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea
2026-03-27 13:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea, skipping ID generation
2026-03-27 13:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with scrape type 1
2026-03-27 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8d31e8b-d6e7-5ef5-9266-6698f58b02ea sending to next pipeline
2026-03-27 13:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea, identifier: 1986625
2026-03-27 13:31:08 [ayvens.es] INFO: Found listing with ID: 1986635
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986635%27 HTTP/1.1" 200 None
2026-03-27 13:31:08 [ayvens.es] INFO: Scrape type for 1986635: 1
2026-03-27 13:31:08 [ayvens.es] INFO: Extracting data for car ID: 1986635
2026-03-27 13:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab807c69-ed34-54f3-b7d2-7914be56a415 with identifier: 1986635
2026-03-27 13:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab807c69-ed34-54f3-b7d2-7914be56a415 with scrape type 1
2026-03-27 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab807c69-ed34-54f3-b7d2-7914be56a415
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252Fa649010f9fcd47f6b01c79db8e4652dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/a649010f9fcd47f6b01c79db8e4652dd/images/large/1.jpg not downloaded yet
2026-03-27 13:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with identifier: 1986625
2026-03-27 13:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with identifier: 1986625
2026-03-27 13:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f8d31e8b-d6e7-5ef5-9266-6698f58b02ea with identifier: 1986625 to the API
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/803/6d392556642641aab0b2914f84cb370b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f8d31e8b-d6e7-5ef5-9266-6698f58b02ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 133368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8d31e8b-d6e7-5ef5-9266-6698f58b02ea/f8d31e8b-d6e7-5ef5-9266-6698f58b02ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/803/6d392556642641aab0b2914f84cb370b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 75KW (100CV) S&S Live Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 75KW (100CV) S&S Live Pack',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986625%27 HTTP/1.1" 200 None
2026-03-27 13:31:08 [ayvens.es] INFO: Saving data for 1986625: {'created_time': 1774618268.98042, 'last_price_update_time': 1774618268.980432, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986625') HTTP/1.1" 204 0
2026-03-27 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/384/59f73ac5e61c46a7a3b1fd87b4f7455b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/788/e93341f1442142cebeba210b31e60d61/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:09 [ayvens.es] INFO: Found listing with ID: 1986636
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986636%27 HTTP/1.1" 200 None
2026-03-27 13:31:09 [ayvens.es] INFO: Scrape type for 1986636: 1
2026-03-27 13:31:09 [ayvens.es] INFO: Extracting data for car ID: 1986636
2026-03-27 13:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with identifier: 1986636
2026-03-27 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with scrape type 1
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252F4175b0aadaaf46debf924b8ac8e95ff9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/4175b0aadaaf46debf924b8ac8e95ff9/images/large/1.jpg not downloaded yet
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fb3850>
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf64a30e-0d69-5994-9e23-41880ede47c5/bf64a30e-0d69-5994-9e23-41880ede47c5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F517%252F8081345819d34b08b0b7234b48b95688%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/517/8081345819d34b08b0b7234b48b95688/images/large/1.jpg saved to cache
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf64a30e-0d69-5994-9e23-41880ede47c5
2026-03-27 13:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf64a30e-0d69-5994-9e23-41880ede47c5, skipping ID generation
2026-03-27 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf64a30e-0d69-5994-9e23-41880ede47c5 with scrape type 1
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf64a30e-0d69-5994-9e23-41880ede47c5 sending to next pipeline
2026-03-27 13:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf64a30e-0d69-5994-9e23-41880ede47c5, identifier: 1986626
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960111d0>
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb72612-c7f1-5919-9496-2bbd25b7fb4d/cdb72612-c7f1-5919-9496-2bbd25b7fb4d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F762%252F7e9e62bc36cc4a7e9580bf9e425cb5a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/762/7e9e62bc36cc4a7e9580bf9e425cb5a8/images/large/1.jpg saved to cache
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdb72612-c7f1-5919-9496-2bbd25b7fb4d
2026-03-27 13:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdb72612-c7f1-5919-9496-2bbd25b7fb4d, skipping ID generation
2026-03-27 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb72612-c7f1-5919-9496-2bbd25b7fb4d with scrape type 1
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdb72612-c7f1-5919-9496-2bbd25b7fb4d sending to next pipeline
2026-03-27 13:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cdb72612-c7f1-5919-9496-2bbd25b7fb4d, identifier: 1986627
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f71510>
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a8985e-2c65-5c30-a218-204f397eaa97/40a8985e-2c65-5c30-a218-204f397eaa97_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F967%252F90cc018e88ae4da292a01abf5a268100%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/967/90cc018e88ae4da292a01abf5a268100/images/large/1.jpg saved to cache
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40a8985e-2c65-5c30-a218-204f397eaa97
2026-03-27 13:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40a8985e-2c65-5c30-a218-204f397eaa97, skipping ID generation
2026-03-27 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a8985e-2c65-5c30-a218-204f397eaa97 with scrape type 1
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40a8985e-2c65-5c30-a218-204f397eaa97 sending to next pipeline
2026-03-27 13:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 40a8985e-2c65-5c30-a218-204f397eaa97, identifier: 1986628
2026-03-27 13:31:09 [ayvens.es] INFO: Found listing with ID: 1986637
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986637%27 HTTP/1.1" 200 None
2026-03-27 13:31:09 [ayvens.es] INFO: Scrape type for 1986637: 1
2026-03-27 13:31:09 [ayvens.es] INFO: Extracting data for car ID: 1986637
2026-03-27 13:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37231ca2-b1c8-5ed9-b159-6e9270285542 with identifier: 1986637
2026-03-27 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37231ca2-b1c8-5ed9-b159-6e9270285542 with scrape type 1
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 37231ca2-b1c8-5ed9-b159-6e9270285542
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252F286d8787f228468792c5287eb87af45d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/286d8787f228468792c5287eb87af45d/images/large/1.jpg not downloaded yet
2026-03-27 13:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf64a30e-0d69-5994-9e23-41880ede47c5 with identifier: 1986626
2026-03-27 13:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf64a30e-0d69-5994-9e23-41880ede47c5 with identifier: 1986626
2026-03-27 13:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf64a30e-0d69-5994-9e23-41880ede47c5 with identifier: 1986626 to the API
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/517/8081345819d34b08b0b7234b48b95688/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf64a30e-0d69-5994-9e23-41880ede47c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 137851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf64a30e-0d69-5994-9e23-41880ede47c5/bf64a30e-0d69-5994-9e23-41880ede47c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/517/8081345819d34b08b0b7234b48b95688/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986626%27 HTTP/1.1" 200 None
2026-03-27 13:31:09 [ayvens.es] INFO: Saving data for 1986626: {'created_time': 1774618269.891972, 'last_price_update_time': 1774618269.891983, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986626') HTTP/1.1" 204 0
2026-03-27 13:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cdb72612-c7f1-5919-9496-2bbd25b7fb4d with identifier: 1986627
2026-03-27 13:31:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cdb72612-c7f1-5919-9496-2bbd25b7fb4d with identifier: 1986627
2026-03-27 13:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cdb72612-c7f1-5919-9496-2bbd25b7fb4d with identifier: 1986627 to the API
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/762/7e9e62bc36cc4a7e9580bf9e425cb5a8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Stonic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cdb72612-c7f1-5919-9496-2bbd25b7fb4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 89097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb72612-c7f1-5919-9496-2bbd25b7fb4d/cdb72612-c7f1-5919-9496-2bbd25b7fb4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/762/7e9e62bc36cc4a7e9580bf9e425cb5a8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986627%27 HTTP/1.1" 200 None
2026-03-27 13:31:10 [ayvens.es] INFO: Saving data for 1986627: {'created_time': 1774618270.347285, 'last_price_update_time': 1774618270.347296, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986627') HTTP/1.1" 204 0
2026-03-27 13:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 40a8985e-2c65-5c30-a218-204f397eaa97 with identifier: 1986628
2026-03-27 13:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 40a8985e-2c65-5c30-a218-204f397eaa97 with identifier: 1986628
2026-03-27 13:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 40a8985e-2c65-5c30-a218-204f397eaa97 with identifier: 1986628 to the API
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/967/90cc018e88ae4da292a01abf5a268100/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '40a8985e-2c65-5c30-a218-204f397eaa97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 237219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a8985e-2c65-5c30-a218-204f397eaa97/40a8985e-2c65-5c30-a218-204f397eaa97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/967/90cc018e88ae4da292a01abf5a268100/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986628%27 HTTP/1.1" 200 None
2026-03-27 13:31:10 [ayvens.es] INFO: Saving data for 1986628: {'created_time': 1774618270.69073, 'last_price_update_time': 1774618270.69074, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986628') HTTP/1.1" 204 0
2026-03-27 13:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/415/8722c78de37c497cbf9e0262206de099/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/764/f5df1d6a02194b0588f8a2a074e1da34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:10 [ayvens.es] INFO: Found listing with ID: 1986638
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986638%27 HTTP/1.1" 200 None
2026-03-27 13:31:10 [ayvens.es] INFO: Scrape type for 1986638: 1
2026-03-27 13:31:10 [ayvens.es] INFO: Extracting data for car ID: 1986638
2026-03-27 13:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with identifier: 1986638
2026-03-27 13:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with scrape type 1
2026-03-27 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F255%252F72741563935d4752b8371b0dc0117336%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/255/72741563935d4752b8371b0dc0117336/images/large/1.jpg not downloaded yet
2026-03-27 13:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296120cd0>
2026-03-27 13:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f498a3bd-f5f7-5494-8add-e1e318a76046/f498a3bd-f5f7-5494-8add-e1e318a76046_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252F59f73ac5e61c46a7a3b1fd87b4f7455b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/59f73ac5e61c46a7a3b1fd87b4f7455b/images/large/1.jpg saved to cache
2026-03-27 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f498a3bd-f5f7-5494-8add-e1e318a76046
2026-03-27 13:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f498a3bd-f5f7-5494-8add-e1e318a76046, skipping ID generation
2026-03-27 13:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f498a3bd-f5f7-5494-8add-e1e318a76046 with scrape type 1
2026-03-27 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f498a3bd-f5f7-5494-8add-e1e318a76046 sending to next pipeline
2026-03-27 13:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f498a3bd-f5f7-5494-8add-e1e318a76046, identifier: 1986630
2026-03-27 13:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bdd290>
2026-03-27 13:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf488fcc-e2ed-516d-ae16-04de92a869a7/bf488fcc-e2ed-516d-ae16-04de92a869a7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F788%252Fe93341f1442142cebeba210b31e60d61%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/788/e93341f1442142cebeba210b31e60d61/images/large/1.jpg saved to cache
2026-03-27 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf488fcc-e2ed-516d-ae16-04de92a869a7
2026-03-27 13:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf488fcc-e2ed-516d-ae16-04de92a869a7, skipping ID generation
2026-03-27 13:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf488fcc-e2ed-516d-ae16-04de92a869a7 with scrape type 1
2026-03-27 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf488fcc-e2ed-516d-ae16-04de92a869a7 sending to next pipeline
2026-03-27 13:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf488fcc-e2ed-516d-ae16-04de92a869a7, identifier: 1986629
2026-03-27 13:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f498a3bd-f5f7-5494-8add-e1e318a76046 with identifier: 1986630
2026-03-27 13:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f498a3bd-f5f7-5494-8add-e1e318a76046 with identifier: 1986630
2026-03-27 13:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f498a3bd-f5f7-5494-8add-e1e318a76046 with identifier: 1986630 to the API
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/384/59f73ac5e61c46a7a3b1fd87b4f7455b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f498a3bd-f5f7-5494-8add-e1e318a76046',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 39189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f498a3bd-f5f7-5494-8add-e1e318a76046/f498a3bd-f5f7-5494-8add-e1e318a76046_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/384/59f73ac5e61c46a7a3b1fd87b4f7455b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel Pack',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986630%27 HTTP/1.1" 200 None
2026-03-27 13:31:11 [ayvens.es] INFO: Saving data for 1986630: {'created_time': 1774618271.507249, 'last_price_update_time': 1774618271.507259, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986630') HTTP/1.1" 204 0
2026-03-27 13:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf488fcc-e2ed-516d-ae16-04de92a869a7 with identifier: 1986629
2026-03-27 13:31:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf488fcc-e2ed-516d-ae16-04de92a869a7 with identifier: 1986629
2026-03-27 13:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf488fcc-e2ed-516d-ae16-04de92a869a7 with identifier: 1986629 to the API
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/788/e93341f1442142cebeba210b31e60d61/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Sophistograu',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf488fcc-e2ed-516d-ae16-04de92a869a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 126269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf488fcc-e2ed-516d-ae16-04de92a869a7/bf488fcc-e2ed-516d-ae16-04de92a869a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/788/e93341f1442142cebeba210b31e60d61/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986629%27 HTTP/1.1" 200 None
2026-03-27 13:31:11 [ayvens.es] INFO: Saving data for 1986629: {'created_time': 1774618271.831247, 'last_price_update_time': 1774618271.831257, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986629') HTTP/1.1" 204 0
2026-03-27 13:31:11 [ayvens.es] INFO: Found listing with ID: 1986639
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986639%27 HTTP/1.1" 200 None
2026-03-27 13:31:11 [ayvens.es] INFO: Scrape type for 1986639: 1
2026-03-27 13:31:11 [ayvens.es] INFO: Extracting data for car ID: 1986639
2026-03-27 13:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c656c91b-a438-5516-af1f-75af3ff32c29 with identifier: 1986639
2026-03-27 13:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c656c91b-a438-5516-af1f-75af3ff32c29 with scrape type 1
2026-03-27 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c656c91b-a438-5516-af1f-75af3ff32c29
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F514%252Fc4f6e6b125e24c0589d6e5b46fb4639a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/514/c4f6e6b125e24c0589d6e5b46fb4639a/images/large/1.jpg not downloaded yet
2026-03-27 13:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295764910>
2026-03-27 13:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14/c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F8722c78de37c497cbf9e0262206de099%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/8722c78de37c497cbf9e0262206de099/images/large/1.jpg saved to cache
2026-03-27 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14
2026-03-27 13:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14, skipping ID generation
2026-03-27 13:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with scrape type 1
2026-03-27 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 sending to next pipeline
2026-03-27 13:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14, identifier: 1986632
2026-03-27 13:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960be890>
2026-03-27 13:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8/b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F764%252Ff5df1d6a02194b0588f8a2a074e1da34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/764/f5df1d6a02194b0588f8a2a074e1da34/images/large/1.jpg saved to cache
2026-03-27 13:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8
2026-03-27 13:31:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8, skipping ID generation
2026-03-27 13:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with scrape type 1
2026-03-27 13:31:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 sending to next pipeline
2026-03-27 13:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8, identifier: 1986631
2026-03-27 13:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/567/eca989b77f1b46639edda6b52107a0c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/138/e87714a3c0484f63bfe3de8bd120947f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:12 [ayvens.es] INFO: Found listing with ID: 1986640
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986640%27 HTTP/1.1" 200 None
2026-03-27 13:31:12 [ayvens.es] INFO: Scrape type for 1986640: 1
2026-03-27 13:31:12 [ayvens.es] INFO: Extracting data for car ID: 1986640
2026-03-27 13:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e01d5a2-ac11-502c-82f2-ac41f6c29963 with identifier: 1986640
2026-03-27 13:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e01d5a2-ac11-502c-82f2-ac41f6c29963 with scrape type 1
2026-03-27 13:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1e01d5a2-ac11-502c-82f2-ac41f6c29963
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F383%252Fe94fc608b11b4decac953119228cefb4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/383/e94fc608b11b4decac953119228cefb4/images/large/1.jpg not downloaded yet
2026-03-27 13:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with identifier: 1986632
2026-03-27 13:31:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with identifier: 1986632
2026-03-27 13:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14 with identifier: 1986632 to the API
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/415/8722c78de37c497cbf9e0262206de099/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'A',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 88646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14/c61ba4cb-7e65-5734-99e0-ad5a6c3f2b14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/415/8722c78de37c497cbf9e0262206de099/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986632%27 HTTP/1.1" 200 None
2026-03-27 13:31:12 [ayvens.es] INFO: Saving data for 1986632: {'created_time': 1774618272.629273, 'last_price_update_time': 1774618272.629283, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986632') HTTP/1.1" 204 0
2026-03-27 13:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with identifier: 1986631
2026-03-27 13:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with identifier: 1986631
2026-03-27 13:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8 with identifier: 1986631 to the API
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/764/f5df1d6a02194b0588f8a2a074e1da34/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 137564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8/b9b7a76d-85b1-5cfe-bd9d-71d17d231ee8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/764/f5df1d6a02194b0588f8a2a074e1da34/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986631%27 HTTP/1.1" 200 None
2026-03-27 13:31:12 [ayvens.es] INFO: Saving data for 1986631: {'created_time': 1774618272.951151, 'last_price_update_time': 1774618272.951161, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986631') HTTP/1.1" 204 0
2026-03-27 13:31:12 [ayvens.es] INFO: Found listing with ID: 1986641
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986641%27 HTTP/1.1" 200 None
2026-03-27 13:31:13 [ayvens.es] INFO: Scrape type for 1986641: 1
2026-03-27 13:31:13 [ayvens.es] INFO: Extracting data for car ID: 1986641
2026-03-27 13:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d670554c-c093-5478-b9c4-e6ccb391a4fd with identifier: 1986641
2026-03-27 13:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d670554c-c093-5478-b9c4-e6ccb391a4fd with scrape type 1
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d670554c-c093-5478-b9c4-e6ccb391a4fd
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252F1135f51a0b4c4a1bb890e66edd46d85b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/1135f51a0b4c4a1bb890e66edd46d85b/images/large/1.jpg not downloaded yet
2026-03-27 13:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fa98d0>
2026-03-27 13:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8/e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F567%252Feca989b77f1b46639edda6b52107a0c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/567/eca989b77f1b46639edda6b52107a0c2/images/large/1.jpg saved to cache
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8
2026-03-27 13:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8, skipping ID generation
2026-03-27 13:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with scrape type 1
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 sending to next pipeline
2026-03-27 13:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8, identifier: 1986634
2026-03-27 13:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1be10>
2026-03-27 13:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bf23cb-9e65-5a55-9197-e8a828180e6c/01bf23cb-9e65-5a55-9197-e8a828180e6c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F138%252Fe87714a3c0484f63bfe3de8bd120947f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/138/e87714a3c0484f63bfe3de8bd120947f/images/large/1.jpg saved to cache
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01bf23cb-9e65-5a55-9197-e8a828180e6c
2026-03-27 13:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01bf23cb-9e65-5a55-9197-e8a828180e6c, skipping ID generation
2026-03-27 13:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bf23cb-9e65-5a55-9197-e8a828180e6c with scrape type 1
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01bf23cb-9e65-5a55-9197-e8a828180e6c sending to next pipeline
2026-03-27 13:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 01bf23cb-9e65-5a55-9197-e8a828180e6c, identifier: 1986633
2026-03-27 13:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/937/4175b0aadaaf46debf924b8ac8e95ff9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:13 [ayvens.es] INFO: Found listing with ID: 1986642
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986642%27 HTTP/1.1" 200 None
2026-03-27 13:31:13 [ayvens.es] INFO: Scrape type for 1986642: 1
2026-03-27 13:31:13 [ayvens.es] INFO: Extracting data for car ID: 1986642
2026-03-27 13:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a177e395-86a3-57b1-b7c0-c94d399d393f with identifier: 1986642
2026-03-27 13:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a177e395-86a3-57b1-b7c0-c94d399d393f with scrape type 1
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a177e395-86a3-57b1-b7c0-c94d399d393f
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252Ff24236bf2e4f4ac4af9d9723f0eceae1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/f24236bf2e4f4ac4af9d9723f0eceae1/images/large/1.jpg not downloaded yet
2026-03-27 13:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with identifier: 1986634
2026-03-27 13:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with identifier: 1986634
2026-03-27 13:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8 with identifier: 1986634 to the API
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/567/eca989b77f1b46639edda6b52107a0c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 46872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8/e16c2b1c-4b4b-5d92-a9bd-f1afacb5f5e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/567/eca989b77f1b46639edda6b52107a0c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Tecno DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Tecno DCT',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986634%27 HTTP/1.1" 200 None
2026-03-27 13:31:13 [ayvens.es] INFO: Saving data for 1986634: {'created_time': 1774618273.799055, 'last_price_update_time': 1774618273.799068, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986634') HTTP/1.1" 204 0
2026-03-27 13:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 01bf23cb-9e65-5a55-9197-e8a828180e6c with identifier: 1986633
2026-03-27 13:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 01bf23cb-9e65-5a55-9197-e8a828180e6c with identifier: 1986633
2026-03-27 13:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 01bf23cb-9e65-5a55-9197-e8a828180e6c with identifier: 1986633 to the API
2026-03-27 13:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/138/e87714a3c0484f63bfe3de8bd120947f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '01bf23cb-9e65-5a55-9197-e8a828180e6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 94165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bf23cb-9e65-5a55-9197-e8a828180e6c/01bf23cb-9e65-5a55-9197-e8a828180e6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/138/e87714a3c0484f63bfe3de8bd120947f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D DCT 110KW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986633%27 HTTP/1.1" 200 None
2026-03-27 13:31:14 [ayvens.es] INFO: Saving data for 1986633: {'created_time': 1774618274.112997, 'last_price_update_time': 1774618274.113007, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986633') HTTP/1.1" 204 0
2026-03-27 13:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/336/a649010f9fcd47f6b01c79db8e4652dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/255/72741563935d4752b8371b0dc0117336/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:14 [ayvens.es] INFO: Found listing with ID: 1986643
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986643%27 HTTP/1.1" 200 None
2026-03-27 13:31:14 [ayvens.es] INFO: Scrape type for 1986643: 1
2026-03-27 13:31:14 [ayvens.es] INFO: Extracting data for car ID: 1986643
2026-03-27 13:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ec1aa9-25d0-549f-81c1-9085d90a8570 with identifier: 1986643
2026-03-27 13:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ec1aa9-25d0-549f-81c1-9085d90a8570 with scrape type 1
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 80ec1aa9-25d0-549f-81c1-9085d90a8570
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F428%252Fc632d5abcfec43409f08d815359344af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/428/c632d5abcfec43409f08d815359344af/images/large/1.jpg not downloaded yet
2026-03-27 13:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fa8b10>
2026-03-27 13:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698/8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252F4175b0aadaaf46debf924b8ac8e95ff9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/4175b0aadaaf46debf924b8ac8e95ff9/images/large/1.jpg saved to cache
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698
2026-03-27 13:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698, skipping ID generation
2026-03-27 13:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with scrape type 1
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 sending to next pipeline
2026-03-27 13:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698, identifier: 1986636
2026-03-27 13:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/249/286d8787f228468792c5287eb87af45d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:14 [ayvens.es] INFO: Found listing with ID: 1986644
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986644%27 HTTP/1.1" 200 None
2026-03-27 13:31:14 [ayvens.es] INFO: Scrape type for 1986644: 1
2026-03-27 13:31:14 [ayvens.es] INFO: Extracting data for car ID: 1986644
2026-03-27 13:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aec15226-0b81-5193-abc1-4d6dc66064fe with identifier: 1986644
2026-03-27 13:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec15226-0b81-5193-abc1-4d6dc66064fe with scrape type 1
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aec15226-0b81-5193-abc1-4d6dc66064fe
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252Fb29988a3b33f4fa4aaf396582c1cede1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/b29988a3b33f4fa4aaf396582c1cede1/images/large/1.jpg not downloaded yet
2026-03-27 13:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with identifier: 1986636
2026-03-27 13:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with identifier: 1986636
2026-03-27 13:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698 with identifier: 1986636 to the API
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/937/4175b0aadaaf46debf924b8ac8e95ff9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 90122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698/8b13908e-8dd1-5e3f-b5e1-b3d7d4ef9698_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/937/4175b0aadaaf46debf924b8ac8e95ff9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986636%27 HTTP/1.1" 200 None
2026-03-27 13:31:14 [ayvens.es] INFO: Saving data for 1986636: {'created_time': 1774618274.709136, 'last_price_update_time': 1774618274.709146, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986636') HTTP/1.1" 204 0
2026-03-27 13:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/514/c4f6e6b125e24c0589d6e5b46fb4639a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/383/e94fc608b11b4decac953119228cefb4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:14 [ayvens.es] INFO: Found listing with ID: 1986645
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986645%27 HTTP/1.1" 200 None
2026-03-27 13:31:14 [ayvens.es] INFO: Scrape type for 1986645: 1
2026-03-27 13:31:14 [ayvens.es] INFO: Extracting data for car ID: 1986645
2026-03-27 13:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d89d30b9-b104-5c61-935e-9b0ee8d502de with identifier: 1986645
2026-03-27 13:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d89d30b9-b104-5c61-935e-9b0ee8d502de with scrape type 1
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d89d30b9-b104-5c61-935e-9b0ee8d502de
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252F2ca051dd58b34a3ca2baaeddbc584060%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/2ca051dd58b34a3ca2baaeddbc584060/images/large/1.jpg not downloaded yet
2026-03-27 13:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295757ed0>
2026-03-27 13:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab807c69-ed34-54f3-b7d2-7914be56a415/ab807c69-ed34-54f3-b7d2-7914be56a415_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252Fa649010f9fcd47f6b01c79db8e4652dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/a649010f9fcd47f6b01c79db8e4652dd/images/large/1.jpg saved to cache
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab807c69-ed34-54f3-b7d2-7914be56a415
2026-03-27 13:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab807c69-ed34-54f3-b7d2-7914be56a415, skipping ID generation
2026-03-27 13:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab807c69-ed34-54f3-b7d2-7914be56a415 with scrape type 1
2026-03-27 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab807c69-ed34-54f3-b7d2-7914be56a415 sending to next pipeline
2026-03-27 13:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab807c69-ed34-54f3-b7d2-7914be56a415, identifier: 1986635
2026-03-27 13:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295eb1790>
2026-03-27 13:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_720b7807-d2a2-5991-ab3c-59ad1cdb2250/720b7807-d2a2-5991-ab3c-59ad1cdb2250_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F255%252F72741563935d4752b8371b0dc0117336%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/255/72741563935d4752b8371b0dc0117336/images/large/1.jpg saved to cache
2026-03-27 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250
2026-03-27 13:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 720b7807-d2a2-5991-ab3c-59ad1cdb2250, skipping ID generation
2026-03-27 13:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with scrape type 1
2026-03-27 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 720b7807-d2a2-5991-ab3c-59ad1cdb2250 sending to next pipeline
2026-03-27 13:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 720b7807-d2a2-5991-ab3c-59ad1cdb2250, identifier: 1986638
2026-03-27 13:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c8250>
2026-03-27 13:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37231ca2-b1c8-5ed9-b159-6e9270285542/37231ca2-b1c8-5ed9-b159-6e9270285542_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252F286d8787f228468792c5287eb87af45d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/286d8787f228468792c5287eb87af45d/images/large/1.jpg saved to cache
2026-03-27 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37231ca2-b1c8-5ed9-b159-6e9270285542
2026-03-27 13:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37231ca2-b1c8-5ed9-b159-6e9270285542, skipping ID generation
2026-03-27 13:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37231ca2-b1c8-5ed9-b159-6e9270285542 with scrape type 1
2026-03-27 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37231ca2-b1c8-5ed9-b159-6e9270285542 sending to next pipeline
2026-03-27 13:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 37231ca2-b1c8-5ed9-b159-6e9270285542, identifier: 1986637
2026-03-27 13:31:15 [ayvens.es] INFO: Found listing with ID: 1986646
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986646%27 HTTP/1.1" 200 None
2026-03-27 13:31:15 [ayvens.es] INFO: Scrape type for 1986646: 1
2026-03-27 13:31:15 [ayvens.es] INFO: Extracting data for car ID: 1986646
2026-03-27 13:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c53525-664b-5daa-a979-ff3a6aea6eaf with identifier: 1986646
2026-03-27 13:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c53525-664b-5daa-a979-ff3a6aea6eaf with scrape type 1
2026-03-27 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 56c53525-664b-5daa-a979-ff3a6aea6eaf
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fe4c291da64644cfb8fd53e72d50a0d2c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/e4c291da64644cfb8fd53e72d50a0d2c/images/large/1.jpg not downloaded yet
2026-03-27 13:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab807c69-ed34-54f3-b7d2-7914be56a415 with identifier: 1986635
2026-03-27 13:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab807c69-ed34-54f3-b7d2-7914be56a415 with identifier: 1986635
2026-03-27 13:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab807c69-ed34-54f3-b7d2-7914be56a415 with identifier: 1986635 to the API
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/336/a649010f9fcd47f6b01c79db8e4652dd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab807c69-ed34-54f3-b7d2-7914be56a415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 77681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab807c69-ed34-54f3-b7d2-7914be56a415/ab807c69-ed34-54f3-b7d2-7914be56a415_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/a649010f9fcd47f6b01c79db8e4652dd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986635%27 HTTP/1.1" 200 None
2026-03-27 13:31:15 [ayvens.es] INFO: Saving data for 1986635: {'created_time': 1774618275.840617, 'last_price_update_time': 1774618275.840628, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986635') HTTP/1.1" 204 0
2026-03-27 13:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with identifier: 1986638
2026-03-27 13:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with identifier: 1986638
2026-03-27 13:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 720b7807-d2a2-5991-ab3c-59ad1cdb2250 with identifier: 1986638 to the API
2026-03-27 13:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/255/72741563935d4752b8371b0dc0117336/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '720b7807-d2a2-5991-ab3c-59ad1cdb2250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 162969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_720b7807-d2a2-5991-ab3c-59ad1cdb2250/720b7807-d2a2-5991-ab3c-59ad1cdb2250_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/255/72741563935d4752b8371b0dc0117336/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': '(O) Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986638%27 HTTP/1.1" 200 None
2026-03-27 13:31:16 [ayvens.es] INFO: Saving data for 1986638: {'created_time': 1774618276.196329, 'last_price_update_time': 1774618276.19634, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986638') HTTP/1.1" 204 0
2026-03-27 13:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 37231ca2-b1c8-5ed9-b159-6e9270285542 with identifier: 1986637
2026-03-27 13:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 37231ca2-b1c8-5ed9-b159-6e9270285542 with identifier: 1986637
2026-03-27 13:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 37231ca2-b1c8-5ed9-b159-6e9270285542 with identifier: 1986637 to the API
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/249/286d8787f228468792c5287eb87af45d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '37231ca2-b1c8-5ed9-b159-6e9270285542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 37317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37231ca2-b1c8-5ed9-b159-6e9270285542/37231ca2-b1c8-5ed9-b159-6e9270285542_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/249/286d8787f228468792c5287eb87af45d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986637%27 HTTP/1.1" 200 None
2026-03-27 13:31:16 [ayvens.es] INFO: Saving data for 1986637: {'created_time': 1774618276.512655, 'last_price_update_time': 1774618276.512664, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986637') HTTP/1.1" 204 0
2026-03-27 13:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/259/1135f51a0b4c4a1bb890e66edd46d85b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:16 [ayvens.es] INFO: Found listing with ID: 1986647
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986647%27 HTTP/1.1" 200 None
2026-03-27 13:31:16 [ayvens.es] INFO: Scrape type for 1986647: 1
2026-03-27 13:31:16 [ayvens.es] INFO: Extracting data for car ID: 1986647
2026-03-27 13:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3b88696-0eb4-5f41-ab65-cecc256acfa4 with identifier: 1986647
2026-03-27 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3b88696-0eb4-5f41-ab65-cecc256acfa4 with scrape type 1
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3b88696-0eb4-5f41-ab65-cecc256acfa4
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F676%252Faef325f8314640b099eb71420a207037%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/676/aef325f8314640b099eb71420a207037/images/large/1.jpg not downloaded yet
2026-03-27 13:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52a561be90>
2026-03-27 13:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c656c91b-a438-5516-af1f-75af3ff32c29/c656c91b-a438-5516-af1f-75af3ff32c29_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F514%252Fc4f6e6b125e24c0589d6e5b46fb4639a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/514/c4f6e6b125e24c0589d6e5b46fb4639a/images/large/1.jpg saved to cache
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c656c91b-a438-5516-af1f-75af3ff32c29
2026-03-27 13:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c656c91b-a438-5516-af1f-75af3ff32c29, skipping ID generation
2026-03-27 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c656c91b-a438-5516-af1f-75af3ff32c29 with scrape type 1
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c656c91b-a438-5516-af1f-75af3ff32c29 sending to next pipeline
2026-03-27 13:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c656c91b-a438-5516-af1f-75af3ff32c29, identifier: 1986639
2026-03-27 13:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297d40810>
2026-03-27 13:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e01d5a2-ac11-502c-82f2-ac41f6c29963/1e01d5a2-ac11-502c-82f2-ac41f6c29963_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F383%252Fe94fc608b11b4decac953119228cefb4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/383/e94fc608b11b4decac953119228cefb4/images/large/1.jpg saved to cache
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e01d5a2-ac11-502c-82f2-ac41f6c29963
2026-03-27 13:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e01d5a2-ac11-502c-82f2-ac41f6c29963, skipping ID generation
2026-03-27 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e01d5a2-ac11-502c-82f2-ac41f6c29963 with scrape type 1
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e01d5a2-ac11-502c-82f2-ac41f6c29963 sending to next pipeline
2026-03-27 13:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1e01d5a2-ac11-502c-82f2-ac41f6c29963, identifier: 1986640
2026-03-27 13:31:16 [ayvens.es] INFO: Found listing with ID: 1986648
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986648%27 HTTP/1.1" 200 None
2026-03-27 13:31:16 [ayvens.es] INFO: Scrape type for 1986648: 1
2026-03-27 13:31:16 [ayvens.es] INFO: Extracting data for car ID: 1986648
2026-03-27 13:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d5f805e-e58f-540d-a28b-ecc243d5733c with identifier: 1986648
2026-03-27 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5f805e-e58f-540d-a28b-ecc243d5733c with scrape type 1
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2d5f805e-e58f-540d-a28b-ecc243d5733c
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F109%252F371dec32070c43c589f287dceb4fe273%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/109/371dec32070c43c589f287dceb4fe273/images/large/1.jpg not downloaded yet
2026-03-27 13:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c656c91b-a438-5516-af1f-75af3ff32c29 with identifier: 1986639
2026-03-27 13:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c656c91b-a438-5516-af1f-75af3ff32c29 with identifier: 1986639
2026-03-27 13:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c656c91b-a438-5516-af1f-75af3ff32c29 with identifier: 1986639 to the API
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/514/c4f6e6b125e24c0589d6e5b46fb4639a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c656c91b-a438-5516-af1f-75af3ff32c29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 95513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c656c91b-a438-5516-af1f-75af3ff32c29/c656c91b-a438-5516-af1f-75af3ff32c29_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/514/c4f6e6b125e24c0589d6e5b46fb4639a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW XL Business Edition N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW XL Business Edition N1',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986639%27 HTTP/1.1" 200 None
2026-03-27 13:31:17 [ayvens.es] INFO: Saving data for 1986639: {'created_time': 1774618277.305667, 'last_price_update_time': 1774618277.305676, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986639') HTTP/1.1" 204 0
2026-03-27 13:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1e01d5a2-ac11-502c-82f2-ac41f6c29963 with identifier: 1986640
2026-03-27 13:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1e01d5a2-ac11-502c-82f2-ac41f6c29963 with identifier: 1986640
2026-03-27 13:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1e01d5a2-ac11-502c-82f2-ac41f6c29963 with identifier: 1986640 to the API
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/383/e94fc608b11b4decac953119228cefb4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 279,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '1e01d5a2-ac11-502c-82f2-ac41f6c29963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 49812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e01d5a2-ac11-502c-82f2-ac41f6c29963/1e01d5a2-ac11-502c-82f2-ac41f6c29963_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/383/e94fc608b11b4decac953119228cefb4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 125kW L3 Trend RWD HD',
 'transmission': 'manual',
 'trim': '350 125kW L3 Trend RWD HD',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986640%27 HTTP/1.1" 200 None
2026-03-27 13:31:17 [ayvens.es] INFO: Saving data for 1986640: {'created_time': 1774618277.710531, 'last_price_update_time': 1774618277.710542, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986640') HTTP/1.1" 204 0
2026-03-27 13:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/100/f24236bf2e4f4ac4af9d9723f0eceae1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/428/c632d5abcfec43409f08d815359344af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:17 [ayvens.es] INFO: Found listing with ID: 1986649
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986649%27 HTTP/1.1" 200 None
2026-03-27 13:31:17 [ayvens.es] INFO: Scrape type for 1986649: 1
2026-03-27 13:31:17 [ayvens.es] INFO: Extracting data for car ID: 1986649
2026-03-27 13:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with identifier: 1986649
2026-03-27 13:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with scrape type 1
2026-03-27 13:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F758eb21461514918b36141d5d151d9a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/758eb21461514918b36141d5d151d9a9/images/large/1.jpg not downloaded yet
2026-03-27 13:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297943510>
2026-03-27 13:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d670554c-c093-5478-b9c4-e6ccb391a4fd/d670554c-c093-5478-b9c4-e6ccb391a4fd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252F1135f51a0b4c4a1bb890e66edd46d85b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/1135f51a0b4c4a1bb890e66edd46d85b/images/large/1.jpg saved to cache
2026-03-27 13:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d670554c-c093-5478-b9c4-e6ccb391a4fd
2026-03-27 13:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d670554c-c093-5478-b9c4-e6ccb391a4fd, skipping ID generation
2026-03-27 13:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d670554c-c093-5478-b9c4-e6ccb391a4fd with scrape type 1
2026-03-27 13:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d670554c-c093-5478-b9c4-e6ccb391a4fd sending to next pipeline
2026-03-27 13:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d670554c-c093-5478-b9c4-e6ccb391a4fd, identifier: 1986641
2026-03-27 13:31:17 [ayvens.es] INFO: Found listing with ID: 1986650
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986650%27 HTTP/1.1" 200 None
2026-03-27 13:31:17 [ayvens.es] INFO: Scrape type for 1986650: 1
2026-03-27 13:31:17 [ayvens.es] INFO: Extracting data for car ID: 1986650
2026-03-27 13:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88c78644-2660-54c7-a03c-0d87e7522056 with identifier: 1986650
2026-03-27 13:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88c78644-2660-54c7-a03c-0d87e7522056 with scrape type 1
2026-03-27 13:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88c78644-2660-54c7-a03c-0d87e7522056
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F319%252F4a4f634b6a1341c291a9c2552c288995%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/319/4a4f634b6a1341c291a9c2552c288995/images/large/1.jpg not downloaded yet
2026-03-27 13:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d670554c-c093-5478-b9c4-e6ccb391a4fd with identifier: 1986641
2026-03-27 13:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d670554c-c093-5478-b9c4-e6ccb391a4fd with identifier: 1986641
2026-03-27 13:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d670554c-c093-5478-b9c4-e6ccb391a4fd with identifier: 1986641 to the API
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/259/1135f51a0b4c4a1bb890e66edd46d85b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd670554c-c093-5478-b9c4-e6ccb391a4fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 88718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d670554c-c093-5478-b9c4-e6ccb391a4fd/d670554c-c093-5478-b9c4-e6ccb391a4fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/259/1135f51a0b4c4a1bb890e66edd46d85b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 96kW CLUB DANGEL 4x4',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 96kW CLUB DANGEL 4x4',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986641%27 HTTP/1.1" 200 None
2026-03-27 13:31:18 [ayvens.es] INFO: Saving data for 1986641: {'created_time': 1774618278.303968, 'last_price_update_time': 1774618278.303979, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986641') HTTP/1.1" 204 0
2026-03-27 13:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/402/2ca051dd58b34a3ca2baaeddbc584060/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:18 [ayvens.es] INFO: Found listing with ID: 1986651
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986651%27 HTTP/1.1" 200 None
2026-03-27 13:31:18 [ayvens.es] INFO: Scrape type for 1986651: 1
2026-03-27 13:31:18 [ayvens.es] INFO: Extracting data for car ID: 1986651
2026-03-27 13:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e17fe0-75c2-550e-be79-2d22dc08d37f with identifier: 1986651
2026-03-27 13:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e17fe0-75c2-550e-be79-2d22dc08d37f with scrape type 1
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45e17fe0-75c2-550e-be79-2d22dc08d37f
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F574%252F07eb66c2d30a4ab39f248d68950acd1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/574/07eb66c2d30a4ab39f248d68950acd1a/images/large/1.jpg not downloaded yet
2026-03-27 13:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0d950>
2026-03-27 13:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a177e395-86a3-57b1-b7c0-c94d399d393f/a177e395-86a3-57b1-b7c0-c94d399d393f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252Ff24236bf2e4f4ac4af9d9723f0eceae1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/f24236bf2e4f4ac4af9d9723f0eceae1/images/large/1.jpg saved to cache
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a177e395-86a3-57b1-b7c0-c94d399d393f
2026-03-27 13:31:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a177e395-86a3-57b1-b7c0-c94d399d393f, skipping ID generation
2026-03-27 13:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a177e395-86a3-57b1-b7c0-c94d399d393f with scrape type 1
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a177e395-86a3-57b1-b7c0-c94d399d393f sending to next pipeline
2026-03-27 13:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a177e395-86a3-57b1-b7c0-c94d399d393f, identifier: 1986642
2026-03-27 13:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957142d0>
2026-03-27 13:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80ec1aa9-25d0-549f-81c1-9085d90a8570/80ec1aa9-25d0-549f-81c1-9085d90a8570_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F428%252Fc632d5abcfec43409f08d815359344af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/428/c632d5abcfec43409f08d815359344af/images/large/1.jpg saved to cache
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80ec1aa9-25d0-549f-81c1-9085d90a8570
2026-03-27 13:31:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80ec1aa9-25d0-549f-81c1-9085d90a8570, skipping ID generation
2026-03-27 13:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ec1aa9-25d0-549f-81c1-9085d90a8570 with scrape type 1
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80ec1aa9-25d0-549f-81c1-9085d90a8570 sending to next pipeline
2026-03-27 13:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 80ec1aa9-25d0-549f-81c1-9085d90a8570, identifier: 1986643
2026-03-27 13:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/511/b29988a3b33f4fa4aaf396582c1cede1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:18 [ayvens.es] INFO: Found listing with ID: 1986652
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986652%27 HTTP/1.1" 200 None
2026-03-27 13:31:18 [ayvens.es] INFO: Scrape type for 1986652: 1
2026-03-27 13:31:18 [ayvens.es] INFO: Extracting data for car ID: 1986652
2026-03-27 13:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7c0ede-ed73-50ca-a6b5-401a35391cd3 with identifier: 1986652
2026-03-27 13:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7c0ede-ed73-50ca-a6b5-401a35391cd3 with scrape type 1
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc7c0ede-ed73-50ca-a6b5-401a35391cd3
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F912%252Fd50819fc6e5743b885899d6c6836f980%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/912/d50819fc6e5743b885899d6c6836f980/images/large/1.jpg not downloaded yet
2026-03-27 13:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a177e395-86a3-57b1-b7c0-c94d399d393f with identifier: 1986642
2026-03-27 13:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a177e395-86a3-57b1-b7c0-c94d399d393f with identifier: 1986642
2026-03-27 13:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a177e395-86a3-57b1-b7c0-c94d399d393f with identifier: 1986642 to the API
2026-03-27 13:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/100/f24236bf2e4f4ac4af9d9723f0eceae1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a177e395-86a3-57b1-b7c0-c94d399d393f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 132216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a177e395-86a3-57b1-b7c0-c94d399d393f/a177e395-86a3-57b1-b7c0-c94d399d393f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/100/f24236bf2e4f4ac4af9d9723f0eceae1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Kombi 1.5 TDCi 71kW Trend',
 'transmission': 'manual',
 'trim': 'Kombi 1.5 TDCi 71kW Trend',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986642%27 HTTP/1.1" 200 None
2026-03-27 13:31:19 [ayvens.es] INFO: Saving data for 1986642: {'created_time': 1774618279.644908, 'last_price_update_time': 1774618279.64492, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986642') HTTP/1.1" 204 0
2026-03-27 13:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 80ec1aa9-25d0-549f-81c1-9085d90a8570 with identifier: 1986643
2026-03-27 13:31:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 80ec1aa9-25d0-549f-81c1-9085d90a8570 with identifier: 1986643
2026-03-27 13:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 80ec1aa9-25d0-549f-81c1-9085d90a8570 with identifier: 1986643 to the API
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/428/c632d5abcfec43409f08d815359344af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Arktis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '80ec1aa9-25d0-549f-81c1-9085d90a8570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 44250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80ec1aa9-25d0-549f-81c1-9085d90a8570/80ec1aa9-25d0-549f-81c1-9085d90a8570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/428/c632d5abcfec43409f08d815359344af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA 1.2 T 100kW (136 CV) GS',
 'transmission': 'manual',
 'trim': '1.2 T 100kW (136 CV) GS',
 'vin': None,
 'year': 2024}
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986643%27 HTTP/1.1" 200 None
2026-03-27 13:31:19 [ayvens.es] INFO: Saving data for 1986643: {'created_time': 1774618279.994747, 'last_price_update_time': 1774618279.994758, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986643') HTTP/1.1" 204 0
2026-03-27 13:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/425/e4c291da64644cfb8fd53e72d50a0d2c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/676/aef325f8314640b099eb71420a207037/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:20 [ayvens.es] INFO: Found listing with ID: 1986653
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986653%27 HTTP/1.1" 200 None
2026-03-27 13:31:20 [ayvens.es] INFO: Scrape type for 1986653: 1
2026-03-27 13:31:20 [ayvens.es] INFO: Extracting data for car ID: 1986653
2026-03-27 13:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc63f20-9c5c-5c87-8c2a-c10631564033 with identifier: 1986653
2026-03-27 13:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc63f20-9c5c-5c87-8c2a-c10631564033 with scrape type 1
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item abc63f20-9c5c-5c87-8c2a-c10631564033
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252Fc1c57826978d4aac8e66afdde8687821%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/c1c57826978d4aac8e66afdde8687821/images/large/1.jpg not downloaded yet
2026-03-27 13:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297943510>
2026-03-27 13:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d89d30b9-b104-5c61-935e-9b0ee8d502de/d89d30b9-b104-5c61-935e-9b0ee8d502de_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252F2ca051dd58b34a3ca2baaeddbc584060%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/2ca051dd58b34a3ca2baaeddbc584060/images/large/1.jpg saved to cache
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d89d30b9-b104-5c61-935e-9b0ee8d502de
2026-03-27 13:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d89d30b9-b104-5c61-935e-9b0ee8d502de, skipping ID generation
2026-03-27 13:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d89d30b9-b104-5c61-935e-9b0ee8d502de with scrape type 1
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d89d30b9-b104-5c61-935e-9b0ee8d502de sending to next pipeline
2026-03-27 13:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d89d30b9-b104-5c61-935e-9b0ee8d502de, identifier: 1986645
2026-03-27 13:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bd5350>
2026-03-27 13:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec15226-0b81-5193-abc1-4d6dc66064fe/aec15226-0b81-5193-abc1-4d6dc66064fe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252Fb29988a3b33f4fa4aaf396582c1cede1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/b29988a3b33f4fa4aaf396582c1cede1/images/large/1.jpg saved to cache
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aec15226-0b81-5193-abc1-4d6dc66064fe
2026-03-27 13:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aec15226-0b81-5193-abc1-4d6dc66064fe, skipping ID generation
2026-03-27 13:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec15226-0b81-5193-abc1-4d6dc66064fe with scrape type 1
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aec15226-0b81-5193-abc1-4d6dc66064fe sending to next pipeline
2026-03-27 13:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aec15226-0b81-5193-abc1-4d6dc66064fe, identifier: 1986644
2026-03-27 13:31:20 [ayvens.es] INFO: Found listing with ID: 1986654
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986654%27 HTTP/1.1" 200 None
2026-03-27 13:31:20 [ayvens.es] INFO: Scrape type for 1986654: 1
2026-03-27 13:31:20 [ayvens.es] INFO: Extracting data for car ID: 1986654
2026-03-27 13:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 582ff400-364d-5655-815d-2900c71a2a5d with identifier: 1986654
2026-03-27 13:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 582ff400-364d-5655-815d-2900c71a2a5d with scrape type 1
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 582ff400-364d-5655-815d-2900c71a2a5d
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F5ce5f8f1757143a29a419eaf32f20d97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/5ce5f8f1757143a29a419eaf32f20d97/images/large/1.jpg not downloaded yet
2026-03-27 13:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d89d30b9-b104-5c61-935e-9b0ee8d502de with identifier: 1986645
2026-03-27 13:31:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d89d30b9-b104-5c61-935e-9b0ee8d502de with identifier: 1986645
2026-03-27 13:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d89d30b9-b104-5c61-935e-9b0ee8d502de with identifier: 1986645 to the API
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/402/2ca051dd58b34a3ca2baaeddbc584060/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd89d30b9-b104-5c61-935e-9b0ee8d502de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 106779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d89d30b9-b104-5c61-935e-9b0ee8d502de/d89d30b9-b104-5c61-935e-9b0ee8d502de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/402/2ca051dd58b34a3ca2baaeddbc584060/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Tecno Sky DCT',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Tecno Sky DCT',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986645%27 HTTP/1.1" 200 None
2026-03-27 13:31:20 [ayvens.es] INFO: Saving data for 1986645: {'created_time': 1774618280.878212, 'last_price_update_time': 1774618280.878223, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986645') HTTP/1.1" 204 0
2026-03-27 13:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aec15226-0b81-5193-abc1-4d6dc66064fe with identifier: 1986644
2026-03-27 13:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aec15226-0b81-5193-abc1-4d6dc66064fe with identifier: 1986644
2026-03-27 13:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aec15226-0b81-5193-abc1-4d6dc66064fe with identifier: 1986644 to the API
2026-03-27 13:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/511/b29988a3b33f4fa4aaf396582c1cede1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aec15226-0b81-5193-abc1-4d6dc66064fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 34624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec15226-0b81-5193-abc1-4d6dc66064fe/aec15226-0b81-5193-abc1-4d6dc66064fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/511/b29988a3b33f4fa4aaf396582c1cede1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA 1.5 D Business Elegance',
 'transmission': 'manual',
 'trim': '1.5 D Business Elegance',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986644%27 HTTP/1.1" 200 None
2026-03-27 13:31:21 [ayvens.es] INFO: Saving data for 1986644: {'created_time': 1774618281.201151, 'last_price_update_time': 1774618281.20116, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986644') HTTP/1.1" 204 0
2026-03-27 13:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/109/371dec32070c43c589f287dceb4fe273/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/933/758eb21461514918b36141d5d151d9a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:21 [ayvens.es] INFO: Found listing with ID: 1986655
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986655%27 HTTP/1.1" 200 None
2026-03-27 13:31:21 [ayvens.es] INFO: Scrape type for 1986655: 1
2026-03-27 13:31:21 [ayvens.es] INFO: Extracting data for car ID: 1986655
2026-03-27 13:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with identifier: 1986655
2026-03-27 13:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with scrape type 1
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F467%252F94f8e774479a440698cfcb8497e672e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/467/94f8e774479a440698cfcb8497e672e2/images/large/1.jpg not downloaded yet
2026-03-27 13:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945ead10>
2026-03-27 13:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c53525-664b-5daa-a979-ff3a6aea6eaf/56c53525-664b-5daa-a979-ff3a6aea6eaf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fe4c291da64644cfb8fd53e72d50a0d2c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/e4c291da64644cfb8fd53e72d50a0d2c/images/large/1.jpg saved to cache
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56c53525-664b-5daa-a979-ff3a6aea6eaf
2026-03-27 13:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56c53525-664b-5daa-a979-ff3a6aea6eaf, skipping ID generation
2026-03-27 13:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c53525-664b-5daa-a979-ff3a6aea6eaf with scrape type 1
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56c53525-664b-5daa-a979-ff3a6aea6eaf sending to next pipeline
2026-03-27 13:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 56c53525-664b-5daa-a979-ff3a6aea6eaf, identifier: 1986646
2026-03-27 13:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296084850>
2026-03-27 13:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3b88696-0eb4-5f41-ab65-cecc256acfa4/e3b88696-0eb4-5f41-ab65-cecc256acfa4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F676%252Faef325f8314640b099eb71420a207037%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/676/aef325f8314640b099eb71420a207037/images/large/1.jpg saved to cache
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3b88696-0eb4-5f41-ab65-cecc256acfa4
2026-03-27 13:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3b88696-0eb4-5f41-ab65-cecc256acfa4, skipping ID generation
2026-03-27 13:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3b88696-0eb4-5f41-ab65-cecc256acfa4 with scrape type 1
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3b88696-0eb4-5f41-ab65-cecc256acfa4 sending to next pipeline
2026-03-27 13:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e3b88696-0eb4-5f41-ab65-cecc256acfa4, identifier: 1986647
2026-03-27 13:31:21 [ayvens.es] INFO: Found listing with ID: 1986656
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986656%27 HTTP/1.1" 200 None
2026-03-27 13:31:21 [ayvens.es] INFO: Scrape type for 1986656: 1
2026-03-27 13:31:21 [ayvens.es] INFO: Extracting data for car ID: 1986656
2026-03-27 13:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with identifier: 1986656
2026-03-27 13:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with scrape type 1
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252Fbcdc14060ae540ceb506a6e26f7dab57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/bcdc14060ae540ceb506a6e26f7dab57/images/large/1.jpg not downloaded yet
2026-03-27 13:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 56c53525-664b-5daa-a979-ff3a6aea6eaf with identifier: 1986646
2026-03-27 13:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 56c53525-664b-5daa-a979-ff3a6aea6eaf with identifier: 1986646
2026-03-27 13:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 56c53525-664b-5daa-a979-ff3a6aea6eaf with identifier: 1986646 to the API
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/425/e4c291da64644cfb8fd53e72d50a0d2c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '56c53525-664b-5daa-a979-ff3a6aea6eaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 80006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c53525-664b-5daa-a979-ff3a6aea6eaf/56c53525-664b-5daa-a979-ff3a6aea6eaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/425/e4c291da64644cfb8fd53e72d50a0d2c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 125cv ST-Line X MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125cv ST-Line X MHEV',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986646%27 HTTP/1.1" 200 None
2026-03-27 13:31:21 [ayvens.es] INFO: Saving data for 1986646: {'created_time': 1774618281.944536, 'last_price_update_time': 1774618281.944546, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986646') HTTP/1.1" 204 0
2026-03-27 13:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e3b88696-0eb4-5f41-ab65-cecc256acfa4 with identifier: 1986647
2026-03-27 13:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e3b88696-0eb4-5f41-ab65-cecc256acfa4 with identifier: 1986647
2026-03-27 13:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e3b88696-0eb4-5f41-ab65-cecc256acfa4 with identifier: 1986647 to the API
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/676/aef325f8314640b099eb71420a207037/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e3b88696-0eb4-5f41-ab65-cecc256acfa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 134962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3b88696-0eb4-5f41-ab65-cecc256acfa4/e3b88696-0eb4-5f41-ab65-cecc256acfa4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/676/aef325f8314640b099eb71420a207037/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Prestige Bl. dCi 85kW(115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Prestige Bl. dCi 85kW(115CV) 4X4',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986647%27 HTTP/1.1" 200 None
2026-03-27 13:31:22 [ayvens.es] INFO: Saving data for 1986647: {'created_time': 1774618282.264835, 'last_price_update_time': 1774618282.264845, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986647') HTTP/1.1" 204 0
2026-03-27 13:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/574/07eb66c2d30a4ab39f248d68950acd1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/319/4a4f634b6a1341c291a9c2552c288995/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:22 [ayvens.es] INFO: Found listing with ID: 1986657
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986657%27 HTTP/1.1" 200 None
2026-03-27 13:31:22 [ayvens.es] INFO: Scrape type for 1986657: 1
2026-03-27 13:31:22 [ayvens.es] INFO: Extracting data for car ID: 1986657
2026-03-27 13:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with identifier: 1986657
2026-03-27 13:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with scrape type 1
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252Fa22975311d734beb930164560e610c7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/a22975311d734beb930164560e610c7b/images/large/1.jpg not downloaded yet
2026-03-27 13:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297d3c1d0>
2026-03-27 13:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d5f805e-e58f-540d-a28b-ecc243d5733c/2d5f805e-e58f-540d-a28b-ecc243d5733c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F109%252F371dec32070c43c589f287dceb4fe273%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/109/371dec32070c43c589f287dceb4fe273/images/large/1.jpg saved to cache
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d5f805e-e58f-540d-a28b-ecc243d5733c
2026-03-27 13:31:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d5f805e-e58f-540d-a28b-ecc243d5733c, skipping ID generation
2026-03-27 13:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5f805e-e58f-540d-a28b-ecc243d5733c with scrape type 1
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d5f805e-e58f-540d-a28b-ecc243d5733c sending to next pipeline
2026-03-27 13:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2d5f805e-e58f-540d-a28b-ecc243d5733c, identifier: 1986648
2026-03-27 13:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960bc950>
2026-03-27 13:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6/ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F758eb21461514918b36141d5d151d9a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/758eb21461514918b36141d5d151d9a9/images/large/1.jpg saved to cache
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6
2026-03-27 13:31:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6, skipping ID generation
2026-03-27 13:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with scrape type 1
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 sending to next pipeline
2026-03-27 13:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6, identifier: 1986649
2026-03-27 13:31:22 [ayvens.es] INFO: Found listing with ID: 1986658
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986658%27 HTTP/1.1" 200 None
2026-03-27 13:31:22 [ayvens.es] INFO: Scrape type for 1986658: 1
2026-03-27 13:31:22 [ayvens.es] INFO: Extracting data for car ID: 1986658
2026-03-27 13:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e306351-8f70-541a-b415-64fb8fedc558 with identifier: 1986658
2026-03-27 13:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e306351-8f70-541a-b415-64fb8fedc558 with scrape type 1
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e306351-8f70-541a-b415-64fb8fedc558
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252Fcb188acc6131412e9f434c5cdf32ad7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/cb188acc6131412e9f434c5cdf32ad7b/images/large/1.jpg not downloaded yet
2026-03-27 13:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2d5f805e-e58f-540d-a28b-ecc243d5733c with identifier: 1986648
2026-03-27 13:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2d5f805e-e58f-540d-a28b-ecc243d5733c with identifier: 1986648
2026-03-27 13:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2d5f805e-e58f-540d-a28b-ecc243d5733c with identifier: 1986648 to the API
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/109/371dec32070c43c589f287dceb4fe273/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2d5f805e-e58f-540d-a28b-ecc243d5733c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 84856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d5f805e-e58f-540d-a28b-ecc243d5733c/2d5f805e-e58f-540d-a28b-ecc243d5733c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/109/371dec32070c43c589f287dceb4fe273/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986648%27 HTTP/1.1" 200 None
2026-03-27 13:31:23 [ayvens.es] INFO: Saving data for 1986648: {'created_time': 1774618283.049757, 'last_price_update_time': 1774618283.049767, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986648') HTTP/1.1" 204 0
2026-03-27 13:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with identifier: 1986649
2026-03-27 13:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with identifier: 1986649
2026-03-27 13:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6 with identifier: 1986649 to the API
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/933/758eb21461514918b36141d5d151d9a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 68731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6/ddcaea6c-e4a7-562f-9e4d-9e3c77bbcdc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/933/758eb21461514918b36141d5d151d9a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 92kW (125cv) Titanium MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 92kW (125cv) Titanium MHEV',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986649%27 HTTP/1.1" 200 None
2026-03-27 13:31:23 [ayvens.es] INFO: Saving data for 1986649: {'created_time': 1774618283.362377, 'last_price_update_time': 1774618283.362387, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986649') HTTP/1.1" 204 0
2026-03-27 13:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/533/c1c57826978d4aac8e66afdde8687821/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/912/d50819fc6e5743b885899d6c6836f980/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:23 [ayvens.es] INFO: Found listing with ID: 1986659
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986659%27 HTTP/1.1" 200 None
2026-03-27 13:31:23 [ayvens.es] INFO: Scrape type for 1986659: 1
2026-03-27 13:31:23 [ayvens.es] INFO: Extracting data for car ID: 1986659
2026-03-27 13:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with identifier: 1986659
2026-03-27 13:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with scrape type 1
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252F8880ff5f56194fb78617e15a8b7ba815%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/8880ff5f56194fb78617e15a8b7ba815/images/large/1.jpg not downloaded yet
2026-03-27 13:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960a3150>
2026-03-27 13:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e17fe0-75c2-550e-be79-2d22dc08d37f/45e17fe0-75c2-550e-be79-2d22dc08d37f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F574%252F07eb66c2d30a4ab39f248d68950acd1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/574/07eb66c2d30a4ab39f248d68950acd1a/images/large/1.jpg saved to cache
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45e17fe0-75c2-550e-be79-2d22dc08d37f
2026-03-27 13:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45e17fe0-75c2-550e-be79-2d22dc08d37f, skipping ID generation
2026-03-27 13:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e17fe0-75c2-550e-be79-2d22dc08d37f with scrape type 1
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45e17fe0-75c2-550e-be79-2d22dc08d37f sending to next pipeline
2026-03-27 13:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45e17fe0-75c2-550e-be79-2d22dc08d37f, identifier: 1986651
2026-03-27 13:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295faa610>
2026-03-27 13:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88c78644-2660-54c7-a03c-0d87e7522056/88c78644-2660-54c7-a03c-0d87e7522056_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F319%252F4a4f634b6a1341c291a9c2552c288995%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/319/4a4f634b6a1341c291a9c2552c288995/images/large/1.jpg saved to cache
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88c78644-2660-54c7-a03c-0d87e7522056
2026-03-27 13:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88c78644-2660-54c7-a03c-0d87e7522056, skipping ID generation
2026-03-27 13:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88c78644-2660-54c7-a03c-0d87e7522056 with scrape type 1
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88c78644-2660-54c7-a03c-0d87e7522056 sending to next pipeline
2026-03-27 13:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 88c78644-2660-54c7-a03c-0d87e7522056, identifier: 1986650
2026-03-27 13:31:23 [ayvens.es] INFO: Found listing with ID: 1986660
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986660%27 HTTP/1.1" 200 None
2026-03-27 13:31:23 [ayvens.es] INFO: Scrape type for 1986660: 1
2026-03-27 13:31:23 [ayvens.es] INFO: Extracting data for car ID: 1986660
2026-03-27 13:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with identifier: 1986660
2026-03-27 13:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with scrape type 1
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F758%252Fa7d838f53f8b4b969a93cda6f17ffd50%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/758/a7d838f53f8b4b969a93cda6f17ffd50/images/large/1.jpg not downloaded yet
2026-03-27 13:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45e17fe0-75c2-550e-be79-2d22dc08d37f with identifier: 1986651
2026-03-27 13:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45e17fe0-75c2-550e-be79-2d22dc08d37f with identifier: 1986651
2026-03-27 13:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45e17fe0-75c2-550e-be79-2d22dc08d37f with identifier: 1986651 to the API
2026-03-27 13:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/574/07eb66c2d30a4ab39f248d68950acd1a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '45e17fe0-75c2-550e-be79-2d22dc08d37f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 152588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e17fe0-75c2-550e-be79-2d22dc08d37f/45e17fe0-75c2-550e-be79-2d22dc08d37f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/574/07eb66c2d30a4ab39f248d68950acd1a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) M Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) M Std Express',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986651%27 HTTP/1.1" 200 None
2026-03-27 13:31:24 [ayvens.es] INFO: Saving data for 1986651: {'created_time': 1774618284.141917, 'last_price_update_time': 1774618284.141928, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986651') HTTP/1.1" 204 0
2026-03-27 13:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 88c78644-2660-54c7-a03c-0d87e7522056 with identifier: 1986650
2026-03-27 13:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 88c78644-2660-54c7-a03c-0d87e7522056 with identifier: 1986650
2026-03-27 13:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 88c78644-2660-54c7-a03c-0d87e7522056 with identifier: 1986650 to the API
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/319/4a4f634b6a1341c291a9c2552c288995/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '88c78644-2660-54c7-a03c-0d87e7522056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 77826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88c78644-2660-54c7-a03c-0d87e7522056/88c78644-2660-54c7-a03c-0d87e7522056_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/319/4a4f634b6a1341c291a9c2552c288995/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D DCT 110KW (150CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986650%27 HTTP/1.1" 200 None
2026-03-27 13:31:24 [ayvens.es] INFO: Saving data for 1986650: {'created_time': 1774618284.575069, 'last_price_update_time': 1774618284.57508, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986650') HTTP/1.1" 204 0
2026-03-27 13:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/467/94f8e774479a440698cfcb8497e672e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:24 [ayvens.es] INFO: Found listing with ID: 1986661
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986661%27 HTTP/1.1" 200 None
2026-03-27 13:31:24 [ayvens.es] INFO: Scrape type for 1986661: 1
2026-03-27 13:31:24 [ayvens.es] INFO: Extracting data for car ID: 1986661
2026-03-27 13:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e with identifier: 1986661
2026-03-27 13:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e with scrape type 1
2026-03-27 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F213%252Fb29bec01856840ac86ea88d6713a250e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/213/b29bec01856840ac86ea88d6713a250e/images/large/1.jpg not downloaded yet
2026-03-27 13:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960c1090>
2026-03-27 13:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abc63f20-9c5c-5c87-8c2a-c10631564033/abc63f20-9c5c-5c87-8c2a-c10631564033_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252Fc1c57826978d4aac8e66afdde8687821%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/c1c57826978d4aac8e66afdde8687821/images/large/1.jpg saved to cache
2026-03-27 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abc63f20-9c5c-5c87-8c2a-c10631564033
2026-03-27 13:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abc63f20-9c5c-5c87-8c2a-c10631564033, skipping ID generation
2026-03-27 13:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc63f20-9c5c-5c87-8c2a-c10631564033 with scrape type 1
2026-03-27 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abc63f20-9c5c-5c87-8c2a-c10631564033 sending to next pipeline
2026-03-27 13:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: abc63f20-9c5c-5c87-8c2a-c10631564033, identifier: 1986653
2026-03-27 13:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960c0350>
2026-03-27 13:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7c0ede-ed73-50ca-a6b5-401a35391cd3/cc7c0ede-ed73-50ca-a6b5-401a35391cd3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F912%252Fd50819fc6e5743b885899d6c6836f980%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/912/d50819fc6e5743b885899d6c6836f980/images/large/1.jpg saved to cache
2026-03-27 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc7c0ede-ed73-50ca-a6b5-401a35391cd3
2026-03-27 13:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc7c0ede-ed73-50ca-a6b5-401a35391cd3, skipping ID generation
2026-03-27 13:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7c0ede-ed73-50ca-a6b5-401a35391cd3 with scrape type 1
2026-03-27 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc7c0ede-ed73-50ca-a6b5-401a35391cd3 sending to next pipeline
2026-03-27 13:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cc7c0ede-ed73-50ca-a6b5-401a35391cd3, identifier: 1986652
2026-03-27 13:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/5ce5f8f1757143a29a419eaf32f20d97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:25 [ayvens.es] INFO: Found listing with ID: 1986662
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986662%27 HTTP/1.1" 200 None
2026-03-27 13:31:25 [ayvens.es] INFO: Scrape type for 1986662: 1
2026-03-27 13:31:25 [ayvens.es] INFO: Extracting data for car ID: 1986662
2026-03-27 13:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bed7c214-aa33-5a8c-a303-8a8d74651d20 with identifier: 1986662
2026-03-27 13:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed7c214-aa33-5a8c-a303-8a8d74651d20 with scrape type 1
2026-03-27 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bed7c214-aa33-5a8c-a303-8a8d74651d20
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F905%252F1659c05349424fdcacb507a9b41732b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/905/1659c05349424fdcacb507a9b41732b8/images/large/1.jpg not downloaded yet
2026-03-27 13:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: abc63f20-9c5c-5c87-8c2a-c10631564033 with identifier: 1986653
2026-03-27 13:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: abc63f20-9c5c-5c87-8c2a-c10631564033 with identifier: 1986653
2026-03-27 13:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: abc63f20-9c5c-5c87-8c2a-c10631564033 with identifier: 1986653 to the API
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/533/c1c57826978d4aac8e66afdde8687821/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'abc63f20-9c5c-5c87-8c2a-c10631564033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 76538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abc63f20-9c5c-5c87-8c2a-c10631564033/abc63f20-9c5c-5c87-8c2a-c10631564033_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/533/c1c57826978d4aac8e66afdde8687821/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986653%27 HTTP/1.1" 200 None
2026-03-27 13:31:25 [ayvens.es] INFO: Saving data for 1986653: {'created_time': 1774618285.468093, 'last_price_update_time': 1774618285.468103, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986653') HTTP/1.1" 204 0
2026-03-27 13:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cc7c0ede-ed73-50ca-a6b5-401a35391cd3 with identifier: 1986652
2026-03-27 13:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cc7c0ede-ed73-50ca-a6b5-401a35391cd3 with identifier: 1986652
2026-03-27 13:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cc7c0ede-ed73-50ca-a6b5-401a35391cd3 with identifier: 1986652 to the API
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/912/d50819fc6e5743b885899d6c6836f980/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cc7c0ede-ed73-50ca-a6b5-401a35391cd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 82226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7c0ede-ed73-50ca-a6b5-401a35391cd3/cc7c0ede-ed73-50ca-a6b5-401a35391cd3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/912/d50819fc6e5743b885899d6c6836f980/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986652%27 HTTP/1.1" 200 None
2026-03-27 13:31:25 [ayvens.es] INFO: Saving data for 1986652: {'created_time': 1774618285.882546, 'last_price_update_time': 1774618285.882557, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986652') HTTP/1.1" 204 0
2026-03-27 13:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/048/a22975311d734beb930164560e610c7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:25 [ayvens.es] INFO: Found listing with ID: 1986663
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986663%27 HTTP/1.1" 200 None
2026-03-27 13:31:25 [ayvens.es] INFO: Scrape type for 1986663: 1
2026-03-27 13:31:25 [ayvens.es] INFO: Extracting data for car ID: 1986663
2026-03-27 13:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cad5195a-f59c-5f8a-9325-c8421d84377a with identifier: 1986663
2026-03-27 13:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad5195a-f59c-5f8a-9325-c8421d84377a with scrape type 1
2026-03-27 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cad5195a-f59c-5f8a-9325-c8421d84377a
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F601%252Ff6058d52cd9242f8861dbe4759d12757%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/601/f6058d52cd9242f8861dbe4759d12757/images/large/1.jpg not downloaded yet
2026-03-27 13:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bc3350>
2026-03-27 13:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bf36b0-b098-59ae-a631-3b2bf040d8c6/81bf36b0-b098-59ae-a631-3b2bf040d8c6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F467%252F94f8e774479a440698cfcb8497e672e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/467/94f8e774479a440698cfcb8497e672e2/images/large/1.jpg saved to cache
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6
2026-03-27 13:31:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81bf36b0-b098-59ae-a631-3b2bf040d8c6, skipping ID generation
2026-03-27 13:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with scrape type 1
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81bf36b0-b098-59ae-a631-3b2bf040d8c6 sending to next pipeline
2026-03-27 13:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 81bf36b0-b098-59ae-a631-3b2bf040d8c6, identifier: 1986655
2026-03-27 13:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with identifier: 1986655
2026-03-27 13:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with identifier: 1986655
2026-03-27 13:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 81bf36b0-b098-59ae-a631-3b2bf040d8c6 with identifier: 1986655 to the API
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/467/94f8e774479a440698cfcb8497e672e2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '81bf36b0-b098-59ae-a631-3b2bf040d8c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 66763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bf36b0-b098-59ae-a631-3b2bf040d8c6/81bf36b0-b098-59ae-a631-3b2bf040d8c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/467/94f8e774479a440698cfcb8497e672e2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE GLC 300 de 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 de 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986655%27 HTTP/1.1" 200 None
2026-03-27 13:31:26 [ayvens.es] INFO: Saving data for 1986655: {'created_time': 1774618286.438961, 'last_price_update_time': 1774618286.438973, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986655') HTTP/1.1" 204 0
2026-03-27 13:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295be4990>
2026-03-27 13:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_582ff400-364d-5655-815d-2900c71a2a5d/582ff400-364d-5655-815d-2900c71a2a5d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F5ce5f8f1757143a29a419eaf32f20d97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/5ce5f8f1757143a29a419eaf32f20d97/images/large/1.jpg saved to cache
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 582ff400-364d-5655-815d-2900c71a2a5d
2026-03-27 13:31:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 582ff400-364d-5655-815d-2900c71a2a5d, skipping ID generation
2026-03-27 13:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 582ff400-364d-5655-815d-2900c71a2a5d with scrape type 1
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 582ff400-364d-5655-815d-2900c71a2a5d sending to next pipeline
2026-03-27 13:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 582ff400-364d-5655-815d-2900c71a2a5d, identifier: 1986654
2026-03-27 13:31:26 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-27 13:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 582ff400-364d-5655-815d-2900c71a2a5d with identifier: 1986654
2026-03-27 13:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 582ff400-364d-5655-815d-2900c71a2a5d with identifier: 1986654
2026-03-27 13:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 582ff400-364d-5655-815d-2900c71a2a5d with identifier: 1986654 to the API
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/5ce5f8f1757143a29a419eaf32f20d97/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '582ff400-364d-5655-815d-2900c71a2a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 32078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_582ff400-364d-5655-815d-2900c71a2a5d/582ff400-364d-5655-815d-2900c71a2a5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/5ce5f8f1757143a29a419eaf32f20d97/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 9,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) M Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) M Std Express',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986654%27 HTTP/1.1" 200 None
2026-03-27 13:31:26 [ayvens.es] INFO: Saving data for 1986654: {'created_time': 1774618286.908696, 'last_price_update_time': 1774618286.908708, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986654') HTTP/1.1" 204 0
2026-03-27 13:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/482/bcdc14060ae540ceb506a6e26f7dab57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296618e10>
2026-03-27 13:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6/e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252Fa22975311d734beb930164560e610c7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/a22975311d734beb930164560e610c7b/images/large/1.jpg saved to cache
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6
2026-03-27 13:31:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6, skipping ID generation
2026-03-27 13:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with scrape type 1
2026-03-27 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 sending to next pipeline
2026-03-27 13:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6, identifier: 1986657
2026-03-27 13:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with identifier: 1986657
2026-03-27 13:31:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with identifier: 1986657
2026-03-27 13:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6 with identifier: 1986657 to the API
2026-03-27 13:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/048/a22975311d734beb930164560e610c7b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 73720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6/e53d7f0d-ce46-5fa3-bb50-e5b3d5ea39d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/048/a22975311d734beb930164560e610c7b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986657%27 HTTP/1.1" 200 None
2026-03-27 13:31:27 [ayvens.es] INFO: Saving data for 1986657: {'created_time': 1774618287.841577, 'last_price_update_time': 1774618287.841588, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986657') HTTP/1.1" 204 0
2026-03-27 13:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/303/cb188acc6131412e9f434c5cdf32ad7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 13:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/100/8880ff5f56194fb78617e15a8b7ba815/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/213/b29bec01856840ac86ea88d6713a250e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fb0ad0>
2026-03-27 13:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fbe28ff-d0d1-56e8-9199-ac0cd7375b39/7fbe28ff-d0d1-56e8-9199-ac0cd7375b39_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252Fbcdc14060ae540ceb506a6e26f7dab57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/bcdc14060ae540ceb506a6e26f7dab57/images/large/1.jpg saved to cache
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39
2026-03-27 13:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39, skipping ID generation
2026-03-27 13:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with scrape type 1
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 sending to next pipeline
2026-03-27 13:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39, identifier: 1986656
2026-03-27 13:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/758/a7d838f53f8b4b969a93cda6f17ffd50/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with identifier: 1986656
2026-03-27 13:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with identifier: 1986656
2026-03-27 13:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7fbe28ff-d0d1-56e8-9199-ac0cd7375b39 with identifier: 1986656 to the API
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/482/bcdc14060ae540ceb506a6e26f7dab57/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7fbe28ff-d0d1-56e8-9199-ac0cd7375b39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 178555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbe28ff-d0d1-56e8-9199-ac0cd7375b39/7fbe28ff-d0d1-56e8-9199-ac0cd7375b39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/482/bcdc14060ae540ceb506a6e26f7dab57/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986656%27 HTTP/1.1" 200 None
2026-03-27 13:31:28 [ayvens.es] INFO: Saving data for 1986656: {'created_time': 1774618288.456719, 'last_price_update_time': 1774618288.45673, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986656') HTTP/1.1" 204 0
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956f9350>
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e306351-8f70-541a-b415-64fb8fedc558/2e306351-8f70-541a-b415-64fb8fedc558_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252Fcb188acc6131412e9f434c5cdf32ad7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/cb188acc6131412e9f434c5cdf32ad7b/images/large/1.jpg saved to cache
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e306351-8f70-541a-b415-64fb8fedc558
2026-03-27 13:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e306351-8f70-541a-b415-64fb8fedc558, skipping ID generation
2026-03-27 13:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e306351-8f70-541a-b415-64fb8fedc558 with scrape type 1
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e306351-8f70-541a-b415-64fb8fedc558 sending to next pipeline
2026-03-27 13:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2e306351-8f70-541a-b415-64fb8fedc558, identifier: 1986658
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297b34690>
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878/62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252F8880ff5f56194fb78617e15a8b7ba815%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/8880ff5f56194fb78617e15a8b7ba815/images/large/1.jpg saved to cache
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878
2026-03-27 13:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878, skipping ID generation
2026-03-27 13:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with scrape type 1
2026-03-27 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 sending to next pipeline
2026-03-27 13:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878, identifier: 1986659
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296084cd0>
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e/b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F213%252Fb29bec01856840ac86ea88d6713a250e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/213/b29bec01856840ac86ea88d6713a250e/images/large/1.jpg saved to cache
2026-03-27 13:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e
2026-03-27 13:31:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e, skipping ID generation
2026-03-27 13:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e with scrape type 1
2026-03-27 13:31:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e sending to next pipeline
2026-03-27 13:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e, identifier: 1986661
2026-03-27 13:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2e306351-8f70-541a-b415-64fb8fedc558 with identifier: 1986658
2026-03-27 13:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2e306351-8f70-541a-b415-64fb8fedc558 with identifier: 1986658
2026-03-27 13:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2e306351-8f70-541a-b415-64fb8fedc558 with identifier: 1986658 to the API
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/303/cb188acc6131412e9f434c5cdf32ad7b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '2e306351-8f70-541a-b415-64fb8fedc558',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'I20',
 'odometer': 55882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e306351-8f70-541a-b415-64fb8fedc558/2e306351-8f70-541a-b415-64fb8fedc558_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/303/cb188acc6131412e9f434c5cdf32ad7b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI I20 1.0 TGDI 74kW (100CV) 48V Essence',
 'transmission': 'manual',
 'trim': '1.0 TGDI 74kW (100CV) 48V Essence',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986658%27 HTTP/1.1" 200 None
2026-03-27 13:31:29 [ayvens.es] INFO: Saving data for 1986658: {'created_time': 1774618289.475623, 'last_price_update_time': 1774618289.475633, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986658') HTTP/1.1" 204 0
2026-03-27 13:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with identifier: 1986659
2026-03-27 13:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with identifier: 1986659
2026-03-27 13:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878 with identifier: 1986659 to the API
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/100/8880ff5f56194fb78617e15a8b7ba815/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 60736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878/62fa4f2d-b4ba-5a3a-b9b7-6e480bc10878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/100/8880ff5f56194fb78617e15a8b7ba815/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986659%27 HTTP/1.1" 200 None
2026-03-27 13:31:29 [ayvens.es] INFO: Saving data for 1986659: {'created_time': 1774618289.84743, 'last_price_update_time': 1774618289.84744, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986659') HTTP/1.1" 204 0
2026-03-27 13:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e with identifier: 1986661
2026-03-27 13:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e with identifier: 1986661
2026-03-27 13:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e with identifier: 1986661 to the API
2026-03-27 13:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/213/b29bec01856840ac86ea88d6713a250e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 61899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e/b5b98dee-e4b8-5e1d-b15c-830e38dd7e0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/213/b29bec01856840ac86ea88d6713a250e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Advanced 45 TFSI 195kW quattro S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 45 TFSI 195kW quattro S tronic',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986661%27 HTTP/1.1" 200 None
2026-03-27 13:31:30 [ayvens.es] INFO: Saving data for 1986661: {'created_time': 1774618290.55334, 'last_price_update_time': 1774618290.55335, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986661') HTTP/1.1" 204 0
2026-03-27 13:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/905/1659c05349424fdcacb507a9b41732b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fb00d0>
2026-03-27 13:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503/f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F758%252Fa7d838f53f8b4b969a93cda6f17ffd50%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/758/a7d838f53f8b4b969a93cda6f17ffd50/images/large/1.jpg saved to cache
2026-03-27 13:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503
2026-03-27 13:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503, skipping ID generation
2026-03-27 13:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with scrape type 1
2026-03-27 13:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 sending to next pipeline
2026-03-27 13:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503, identifier: 1986660
2026-03-27 13:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with identifier: 1986660
2026-03-27 13:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with identifier: 1986660
2026-03-27 13:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503 with identifier: 1986660 to the API
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/758/a7d838f53f8b4b969a93cda6f17ffd50/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 39041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503/f6ec7b1a-df01-5b02-8f5d-a9ae6ad6c503_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/758/a7d838f53f8b4b969a93cda6f17ffd50/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA (O) ST-Line 1.5 EcoBlue 88kW (120CV)',
 'transmission': 'manual',
 'trim': '(O) ST-Line 1.5 EcoBlue 88kW (120CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986660%27 HTTP/1.1" 200 None
2026-03-27 13:31:31 [ayvens.es] INFO: Saving data for 1986660: {'created_time': 1774618291.168236, 'last_price_update_time': 1774618291.168246, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986660') HTTP/1.1" 204 0
2026-03-27 13:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/601/f6058d52cd9242f8861dbe4759d12757/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297944990>
2026-03-27 13:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed7c214-aa33-5a8c-a303-8a8d74651d20/bed7c214-aa33-5a8c-a303-8a8d74651d20_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F905%252F1659c05349424fdcacb507a9b41732b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/905/1659c05349424fdcacb507a9b41732b8/images/large/1.jpg saved to cache
2026-03-27 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bed7c214-aa33-5a8c-a303-8a8d74651d20
2026-03-27 13:31:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bed7c214-aa33-5a8c-a303-8a8d74651d20, skipping ID generation
2026-03-27 13:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed7c214-aa33-5a8c-a303-8a8d74651d20 with scrape type 1
2026-03-27 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bed7c214-aa33-5a8c-a303-8a8d74651d20 sending to next pipeline
2026-03-27 13:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bed7c214-aa33-5a8c-a303-8a8d74651d20, identifier: 1986662
2026-03-27 13:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bed7c214-aa33-5a8c-a303-8a8d74651d20 with identifier: 1986662
2026-03-27 13:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bed7c214-aa33-5a8c-a303-8a8d74651d20 with identifier: 1986662
2026-03-27 13:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bed7c214-aa33-5a8c-a303-8a8d74651d20 with identifier: 1986662 to the API
2026-03-27 13:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/905/1659c05349424fdcacb507a9b41732b8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bed7c214-aa33-5a8c-a303-8a8d74651d20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 81343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bed7c214-aa33-5a8c-a303-8a8d74651d20/bed7c214-aa33-5a8c-a303-8a8d74651d20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/905/1659c05349424fdcacb507a9b41732b8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986662%27 HTTP/1.1" 200 None
2026-03-27 13:31:32 [ayvens.es] INFO: Saving data for 1986662: {'created_time': 1774618292.207889, 'last_price_update_time': 1774618292.207898, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986662') HTTP/1.1" 204 0
2026-03-27 13:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295e53550>
2026-03-27 13:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cad5195a-f59c-5f8a-9325-c8421d84377a/cad5195a-f59c-5f8a-9325-c8421d84377a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F601%252Ff6058d52cd9242f8861dbe4759d12757%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/601/f6058d52cd9242f8861dbe4759d12757/images/large/1.jpg saved to cache
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cad5195a-f59c-5f8a-9325-c8421d84377a
2026-03-27 13:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cad5195a-f59c-5f8a-9325-c8421d84377a, skipping ID generation
2026-03-27 13:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad5195a-f59c-5f8a-9325-c8421d84377a with scrape type 1
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cad5195a-f59c-5f8a-9325-c8421d84377a sending to next pipeline
2026-03-27 13:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cad5195a-f59c-5f8a-9325-c8421d84377a, identifier: 1986663
2026-03-27 13:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cad5195a-f59c-5f8a-9325-c8421d84377a with identifier: 1986663
2026-03-27 13:31:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cad5195a-f59c-5f8a-9325-c8421d84377a with identifier: 1986663
2026-03-27 13:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cad5195a-f59c-5f8a-9325-c8421d84377a with identifier: 1986663 to the API
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/601/f6058d52cd9242f8861dbe4759d12757/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Thypoon',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'cad5195a-f59c-5f8a-9325-c8421d84377a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 157615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad5195a-f59c-5f8a-9325-c8421d84377a/cad5195a-f59c-5f8a-9325-c8421d84377a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/601/f6058d52cd9242f8861dbe4759d12757/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Tecno DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Tecno DCT',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986663%27 HTTP/1.1" 200 None
2026-03-27 13:31:32 [ayvens.es] INFO: Saving data for 1986663: {'created_time': 1774618292.73884, 'last_price_update_time': 1774618292.738851, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986663') HTTP/1.1" 204 0
2026-03-27 13:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 13:31:32 [ayvens.es] INFO: Found listing with ID: 1986664
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986664%27 HTTP/1.1" 200 None
2026-03-27 13:31:32 [ayvens.es] INFO: Scrape type for 1986664: 1
2026-03-27 13:31:32 [ayvens.es] INFO: Extracting data for car ID: 1986664
2026-03-27 13:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f287dbb4-61c7-540e-a678-b13e6d55a030 with identifier: 1986664
2026-03-27 13:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f287dbb4-61c7-540e-a678-b13e6d55a030 with scrape type 1
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f287dbb4-61c7-540e-a678-b13e6d55a030
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252Fc7410c2b12b2481aa04eeb15fe0516b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/c7410c2b12b2481aa04eeb15fe0516b2/images/large/1.jpg not downloaded yet
2026-03-27 13:31:32 [ayvens.es] INFO: Found listing with ID: 1986665
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986665%27 HTTP/1.1" 200 None
2026-03-27 13:31:32 [ayvens.es] INFO: Scrape type for 1986665: 1
2026-03-27 13:31:32 [ayvens.es] INFO: Extracting data for car ID: 1986665
2026-03-27 13:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbe59ba9-4183-5744-bcca-59f1c8462126 with identifier: 1986665
2026-03-27 13:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe59ba9-4183-5744-bcca-59f1c8462126 with scrape type 1
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dbe59ba9-4183-5744-bcca-59f1c8462126
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F576%252F0057f2369ade40279286764f8a224587%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/576/0057f2369ade40279286764f8a224587/images/large/1.jpg not downloaded yet
2026-03-27 13:31:32 [ayvens.es] INFO: Found listing with ID: 1986666
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986666%27 HTTP/1.1" 200 None
2026-03-27 13:31:32 [ayvens.es] INFO: Scrape type for 1986666: 1
2026-03-27 13:31:32 [ayvens.es] INFO: Extracting data for car ID: 1986666
2026-03-27 13:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd209322-3ad3-512e-8914-fc2f7d30c22b with identifier: 1986666
2026-03-27 13:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd209322-3ad3-512e-8914-fc2f7d30c22b with scrape type 1
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fd209322-3ad3-512e-8914-fc2f7d30c22b
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252Ff314ff2a00614d2d98f58b6ca446a158%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/f314ff2a00614d2d98f58b6ca446a158/images/large/1.jpg not downloaded yet
2026-03-27 13:31:32 [ayvens.es] INFO: Found listing with ID: 1986667
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986667%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986667: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986667
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae with identifier: 1986667
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252Fd6206be0085849fd90b3dc807dd5d91a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/d6206be0085849fd90b3dc807dd5d91a/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986668
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986668%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986668: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986668
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8601ad7-3a34-53e6-943f-3f518fcfaa77 with identifier: 1986668
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8601ad7-3a34-53e6-943f-3f518fcfaa77 with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8601ad7-3a34-53e6-943f-3f518fcfaa77
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252F79afdff3dd5f4de7acdc83a429fd4217%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/79afdff3dd5f4de7acdc83a429fd4217/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986669
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986669%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986669: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986669
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2042b6af-7086-5de9-90e5-e48fd948d57f with identifier: 1986669
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2042b6af-7086-5de9-90e5-e48fd948d57f with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2042b6af-7086-5de9-90e5-e48fd948d57f
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F164%252F7abd9cca9ba246428ef054eef9fc6484%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/164/7abd9cca9ba246428ef054eef9fc6484/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986670
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986670%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986670: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986670
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19811d5a-f341-58bf-a625-1f35d87f7ba8 with identifier: 1986670
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19811d5a-f341-58bf-a625-1f35d87f7ba8 with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 19811d5a-f341-58bf-a625-1f35d87f7ba8
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252F3b0565816a254311bd313de55bbb357c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/3b0565816a254311bd313de55bbb357c/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986671
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986671%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986671: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986671
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab06b5df-22a6-501a-bb3f-83990d1d6957 with identifier: 1986671
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab06b5df-22a6-501a-bb3f-83990d1d6957 with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab06b5df-22a6-501a-bb3f-83990d1d6957
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F133%252F2d6ce993bf3f47268d040c03b28abe6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/133/2d6ce993bf3f47268d040c03b28abe6e/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986672
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986672%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986672: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986672
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e13b18a-3b28-5586-a231-32743ab97511 with identifier: 1986672
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e13b18a-3b28-5586-a231-32743ab97511 with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8e13b18a-3b28-5586-a231-32743ab97511
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252F12725365d54d499f81353d50a6fbc186%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/12725365d54d499f81353d50a6fbc186/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/548/c7410c2b12b2481aa04eeb15fe0516b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986673
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986673%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986673: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986673
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5a16029-39db-55f4-b512-bef98bbc8c00 with identifier: 1986673
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a16029-39db-55f4-b512-bef98bbc8c00 with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5a16029-39db-55f4-b512-bef98bbc8c00
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F561%252Fa189273c19b54ccaae61b9a16d8b3243%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/561/a189273c19b54ccaae61b9a16d8b3243/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986674
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986674%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986674: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986674
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2025984-596b-5c0b-8dd2-05672f74a66c with identifier: 1986674
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2025984-596b-5c0b-8dd2-05672f74a66c with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2025984-596b-5c0b-8dd2-05672f74a66c
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F749%252Ffa7c50e750204ef1ad8c250f5e45986c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/749/fa7c50e750204ef1ad8c250f5e45986c/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986675
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986675%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986675: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986675
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with identifier: 1986675
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252F2df329d0c2e1471883839dcd139b366a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/2df329d0c2e1471883839dcd139b366a/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/557/f314ff2a00614d2d98f58b6ca446a158/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/576/0057f2369ade40279286764f8a224587/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/110/d6206be0085849fd90b3dc807dd5d91a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986676
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986676%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986676: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986676
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5664218e-3dc0-56c9-91b6-ec8566feff53 with identifier: 1986676
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5664218e-3dc0-56c9-91b6-ec8566feff53 with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5664218e-3dc0-56c9-91b6-ec8566feff53
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F256%252Fa0687677649d4d4c88110e572a5d011e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/256/a0687677649d4d4c88110e572a5d011e/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956fc210>
2026-03-27 13:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f287dbb4-61c7-540e-a678-b13e6d55a030/f287dbb4-61c7-540e-a678-b13e6d55a030_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252Fc7410c2b12b2481aa04eeb15fe0516b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/c7410c2b12b2481aa04eeb15fe0516b2/images/large/1.jpg saved to cache
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f287dbb4-61c7-540e-a678-b13e6d55a030
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f287dbb4-61c7-540e-a678-b13e6d55a030, skipping ID generation
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f287dbb4-61c7-540e-a678-b13e6d55a030 with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f287dbb4-61c7-540e-a678-b13e6d55a030 sending to next pipeline
2026-03-27 13:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f287dbb4-61c7-540e-a678-b13e6d55a030, identifier: 1986664
2026-03-27 13:31:33 [ayvens.es] INFO: Found listing with ID: 1986677
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986677%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [ayvens.es] INFO: Scrape type for 1986677: 1
2026-03-27 13:31:33 [ayvens.es] INFO: Extracting data for car ID: 1986677
2026-03-27 13:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c2915e-35ca-507a-8eb0-b8809abfae4e with identifier: 1986677
2026-03-27 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c2915e-35ca-507a-8eb0-b8809abfae4e with scrape type 1
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99c2915e-35ca-507a-8eb0-b8809abfae4e
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F58a21c80694b4495a14c98a72dd409be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/58a21c80694b4495a14c98a72dd409be/images/large/1.jpg not downloaded yet
2026-03-27 13:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f287dbb4-61c7-540e-a678-b13e6d55a030 with identifier: 1986664
2026-03-27 13:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f287dbb4-61c7-540e-a678-b13e6d55a030 with identifier: 1986664
2026-03-27 13:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f287dbb4-61c7-540e-a678-b13e6d55a030 with identifier: 1986664 to the API
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/548/c7410c2b12b2481aa04eeb15fe0516b2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f287dbb4-61c7-540e-a678-b13e6d55a030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 85083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f287dbb4-61c7-540e-a678-b13e6d55a030/f287dbb4-61c7-540e-a678-b13e6d55a030_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/548/c7410c2b12b2481aa04eeb15fe0516b2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986664%27 HTTP/1.1" 200 None
2026-03-27 13:31:34 [ayvens.es] INFO: Saving data for 1986664: {'created_time': 1774618294.096443, 'last_price_update_time': 1774618294.096453, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986664') HTTP/1.1" 204 0
2026-03-27 13:31:34 [ayvens.es] INFO: Found listing with ID: 1986678
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986678%27 HTTP/1.1" 200 None
2026-03-27 13:31:34 [ayvens.es] INFO: Scrape type for 1986678: 1
2026-03-27 13:31:34 [ayvens.es] INFO: Extracting data for car ID: 1986678
2026-03-27 13:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 429b4528-74ec-5701-97b6-b3d9ac42a82d with identifier: 1986678
2026-03-27 13:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429b4528-74ec-5701-97b6-b3d9ac42a82d with scrape type 1
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 429b4528-74ec-5701-97b6-b3d9ac42a82d
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252F3de522a398ec453688a7110c8764bc35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/3de522a398ec453688a7110c8764bc35/images/large/1.jpg not downloaded yet
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295722350>
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd209322-3ad3-512e-8914-fc2f7d30c22b/fd209322-3ad3-512e-8914-fc2f7d30c22b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252Ff314ff2a00614d2d98f58b6ca446a158%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/f314ff2a00614d2d98f58b6ca446a158/images/large/1.jpg saved to cache
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd209322-3ad3-512e-8914-fc2f7d30c22b
2026-03-27 13:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd209322-3ad3-512e-8914-fc2f7d30c22b, skipping ID generation
2026-03-27 13:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd209322-3ad3-512e-8914-fc2f7d30c22b with scrape type 1
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd209322-3ad3-512e-8914-fc2f7d30c22b sending to next pipeline
2026-03-27 13:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fd209322-3ad3-512e-8914-fc2f7d30c22b, identifier: 1986666
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295722f10>
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe59ba9-4183-5744-bcca-59f1c8462126/dbe59ba9-4183-5744-bcca-59f1c8462126_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F576%252F0057f2369ade40279286764f8a224587%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/576/0057f2369ade40279286764f8a224587/images/large/1.jpg saved to cache
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbe59ba9-4183-5744-bcca-59f1c8462126
2026-03-27 13:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbe59ba9-4183-5744-bcca-59f1c8462126, skipping ID generation
2026-03-27 13:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe59ba9-4183-5744-bcca-59f1c8462126 with scrape type 1
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbe59ba9-4183-5744-bcca-59f1c8462126 sending to next pipeline
2026-03-27 13:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dbe59ba9-4183-5744-bcca-59f1c8462126, identifier: 1986665
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529575e310>
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae/c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252Fd6206be0085849fd90b3dc807dd5d91a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/d6206be0085849fd90b3dc807dd5d91a/images/large/1.jpg saved to cache
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae
2026-03-27 13:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae, skipping ID generation
2026-03-27 13:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae with scrape type 1
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae sending to next pipeline
2026-03-27 13:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae, identifier: 1986667
2026-03-27 13:31:34 [ayvens.es] INFO: Found listing with ID: 1986679
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986679%27 HTTP/1.1" 200 None
2026-03-27 13:31:34 [ayvens.es] INFO: Scrape type for 1986679: 1
2026-03-27 13:31:34 [ayvens.es] INFO: Extracting data for car ID: 1986679
2026-03-27 13:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f900d456-c116-5f99-a8ee-1bc7759b9265 with identifier: 1986679
2026-03-27 13:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f900d456-c116-5f99-a8ee-1bc7759b9265 with scrape type 1
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f900d456-c116-5f99-a8ee-1bc7759b9265
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252Fa021ff101aa44509b4a6331c55c49ad2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/a021ff101aa44509b4a6331c55c49ad2/images/large/1.jpg not downloaded yet
2026-03-27 13:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fd209322-3ad3-512e-8914-fc2f7d30c22b with identifier: 1986666
2026-03-27 13:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fd209322-3ad3-512e-8914-fc2f7d30c22b with identifier: 1986666
2026-03-27 13:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fd209322-3ad3-512e-8914-fc2f7d30c22b with identifier: 1986666 to the API
2026-03-27 13:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/557/f314ff2a00614d2d98f58b6ca446a158/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fd209322-3ad3-512e-8914-fc2f7d30c22b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 114930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd209322-3ad3-512e-8914-fc2f7d30c22b/fd209322-3ad3-512e-8914-fc2f7d30c22b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/557/f314ff2a00614d2d98f58b6ca446a158/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 1.2 8v 51kW (69CV) Lounge',
 'transmission': 'manual',
 'trim': '1.2 8v 51kW (69CV) Lounge',
 'vin': None,
 'year': 2017}
2026-03-27 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986666%27 HTTP/1.1" 200 None
2026-03-27 13:31:35 [ayvens.es] INFO: Saving data for 1986666: {'created_time': 1774618295.870382, 'last_price_update_time': 1774618295.870393, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986666') HTTP/1.1" 204 0
2026-03-27 13:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dbe59ba9-4183-5744-bcca-59f1c8462126 with identifier: 1986665
2026-03-27 13:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dbe59ba9-4183-5744-bcca-59f1c8462126 with identifier: 1986665
2026-03-27 13:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dbe59ba9-4183-5744-bcca-59f1c8462126 with identifier: 1986665 to the API
2026-03-27 13:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/576/0057f2369ade40279286764f8a224587/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dbe59ba9-4183-5744-bcca-59f1c8462126',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2 GRAN TOURER',
 'odometer': 195157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe59ba9-4183-5744-bcca-59f1c8462126/dbe59ba9-4183-5744-bcca-59f1c8462126_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/576/0057f2369ade40279286764f8a224587/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 GRAN TOURER 218d',
 'transmission': 'manual',
 'trim': '218d',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986665%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [ayvens.es] INFO: Saving data for 1986665: {'created_time': 1774618296.180436, 'last_price_update_time': 1774618296.180445, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986665') HTTP/1.1" 204 0
2026-03-27 13:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae with identifier: 1986667
2026-03-27 13:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae with identifier: 1986667
2026-03-27 13:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae with identifier: 1986667 to the API
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/110/d6206be0085849fd90b3dc807dd5d91a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 290151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae/c7a1928c-69a3-5a11-9a9a-a29f7a57a0ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/110/d6206be0085849fd90b3dc807dd5d91a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW (150CV) Titanium',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW (150CV) Titanium',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986667%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [ayvens.es] INFO: Saving data for 1986667: {'created_time': 1774618296.522927, 'last_price_update_time': 1774618296.522938, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986667') HTTP/1.1" 204 0
2026-03-27 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/164/7abd9cca9ba246428ef054eef9fc6484/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/133/2d6ce993bf3f47268d040c03b28abe6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/749/fa7c50e750204ef1ad8c250f5e45986c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:36 [ayvens.es] INFO: Found listing with ID: 1986680
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986680%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [ayvens.es] INFO: Scrape type for 1986680: 1
2026-03-27 13:31:36 [ayvens.es] INFO: Extracting data for car ID: 1986680
2026-03-27 13:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392216bc-b60b-5196-bc1e-cdb83a6226b6 with identifier: 1986680
2026-03-27 13:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392216bc-b60b-5196-bc1e-cdb83a6226b6 with scrape type 1
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 392216bc-b60b-5196-bc1e-cdb83a6226b6
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F122a55f78b054f83ae5d3aee4e8e69d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/122a55f78b054f83ae5d3aee4e8e69d5/images/large/1.jpg not downloaded yet
2026-03-27 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/107/79afdff3dd5f4de7acdc83a429fd4217/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/357/12725365d54d499f81353d50a6fbc186/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:36 [ayvens.es] INFO: Found listing with ID: 1986681
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986681%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [ayvens.es] INFO: Scrape type for 1986681: 1
2026-03-27 13:31:36 [ayvens.es] INFO: Extracting data for car ID: 1986681
2026-03-27 13:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d43fd3-b12d-5401-9120-592e44bf005b with identifier: 1986681
2026-03-27 13:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d43fd3-b12d-5401-9120-592e44bf005b with scrape type 1
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3d43fd3-b12d-5401-9120-592e44bf005b
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252Fe97004394d084d07836b6f9f68cda393%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/e97004394d084d07836b6f9f68cda393/images/large/1.jpg not downloaded yet
2026-03-27 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/013/3b0565816a254311bd313de55bbb357c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/561/a189273c19b54ccaae61b9a16d8b3243/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/688/2df329d0c2e1471883839dcd139b366a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:36 [ayvens.es] INFO: Found listing with ID: 1986682
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986682%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [ayvens.es] INFO: Scrape type for 1986682: 1
2026-03-27 13:31:36 [ayvens.es] INFO: Extracting data for car ID: 1986682
2026-03-27 13:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e869898-566d-5835-bddc-5c3bfc4d44be with identifier: 1986682
2026-03-27 13:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e869898-566d-5835-bddc-5c3bfc4d44be with scrape type 1
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e869898-566d-5835-bddc-5c3bfc4d44be
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252Ff2f85c96386c4a3a9e3dd4390ac4bc7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/f2f85c96386c4a3a9e3dd4390ac4bc7d/images/large/1.jpg not downloaded yet
2026-03-27 13:31:36 [ayvens.es] INFO: Found listing with ID: 1986683
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986683%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [ayvens.es] INFO: Scrape type for 1986683: 1
2026-03-27 13:31:36 [ayvens.es] INFO: Extracting data for car ID: 1986683
2026-03-27 13:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efe404f7-a33b-5c4a-9cfb-268b4a54b48c with identifier: 1986683
2026-03-27 13:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c with scrape type 1
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252F9d035baa93ad4359b3177aaeebf79e55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/9d035baa93ad4359b3177aaeebf79e55/images/large/1.jpg not downloaded yet
2026-03-27 13:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957b7910>
2026-03-27 13:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2042b6af-7086-5de9-90e5-e48fd948d57f/2042b6af-7086-5de9-90e5-e48fd948d57f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F164%252F7abd9cca9ba246428ef054eef9fc6484%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/164/7abd9cca9ba246428ef054eef9fc6484/images/large/1.jpg saved to cache
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2042b6af-7086-5de9-90e5-e48fd948d57f
2026-03-27 13:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2042b6af-7086-5de9-90e5-e48fd948d57f, skipping ID generation
2026-03-27 13:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2042b6af-7086-5de9-90e5-e48fd948d57f with scrape type 1
2026-03-27 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2042b6af-7086-5de9-90e5-e48fd948d57f sending to next pipeline
2026-03-27 13:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2042b6af-7086-5de9-90e5-e48fd948d57f, identifier: 1986669
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962f9510>
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab06b5df-22a6-501a-bb3f-83990d1d6957/ab06b5df-22a6-501a-bb3f-83990d1d6957_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F133%252F2d6ce993bf3f47268d040c03b28abe6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/133/2d6ce993bf3f47268d040c03b28abe6e/images/large/1.jpg saved to cache
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab06b5df-22a6-501a-bb3f-83990d1d6957
2026-03-27 13:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab06b5df-22a6-501a-bb3f-83990d1d6957, skipping ID generation
2026-03-27 13:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab06b5df-22a6-501a-bb3f-83990d1d6957 with scrape type 1
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab06b5df-22a6-501a-bb3f-83990d1d6957 sending to next pipeline
2026-03-27 13:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab06b5df-22a6-501a-bb3f-83990d1d6957, identifier: 1986671
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296028e50>
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2025984-596b-5c0b-8dd2-05672f74a66c/f2025984-596b-5c0b-8dd2-05672f74a66c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F749%252Ffa7c50e750204ef1ad8c250f5e45986c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/749/fa7c50e750204ef1ad8c250f5e45986c/images/large/1.jpg saved to cache
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2025984-596b-5c0b-8dd2-05672f74a66c
2026-03-27 13:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2025984-596b-5c0b-8dd2-05672f74a66c, skipping ID generation
2026-03-27 13:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2025984-596b-5c0b-8dd2-05672f74a66c with scrape type 1
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2025984-596b-5c0b-8dd2-05672f74a66c sending to next pipeline
2026-03-27 13:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2025984-596b-5c0b-8dd2-05672f74a66c, identifier: 1986674
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f71710>
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8601ad7-3a34-53e6-943f-3f518fcfaa77/f8601ad7-3a34-53e6-943f-3f518fcfaa77_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252F79afdff3dd5f4de7acdc83a429fd4217%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/79afdff3dd5f4de7acdc83a429fd4217/images/large/1.jpg saved to cache
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8601ad7-3a34-53e6-943f-3f518fcfaa77
2026-03-27 13:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8601ad7-3a34-53e6-943f-3f518fcfaa77, skipping ID generation
2026-03-27 13:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8601ad7-3a34-53e6-943f-3f518fcfaa77 with scrape type 1
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8601ad7-3a34-53e6-943f-3f518fcfaa77 sending to next pipeline
2026-03-27 13:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f8601ad7-3a34-53e6-943f-3f518fcfaa77, identifier: 1986668
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bc33d0>
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e13b18a-3b28-5586-a231-32743ab97511/8e13b18a-3b28-5586-a231-32743ab97511_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252F12725365d54d499f81353d50a6fbc186%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/12725365d54d499f81353d50a6fbc186/images/large/1.jpg saved to cache
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e13b18a-3b28-5586-a231-32743ab97511
2026-03-27 13:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e13b18a-3b28-5586-a231-32743ab97511, skipping ID generation
2026-03-27 13:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e13b18a-3b28-5586-a231-32743ab97511 with scrape type 1
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e13b18a-3b28-5586-a231-32743ab97511 sending to next pipeline
2026-03-27 13:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8e13b18a-3b28-5586-a231-32743ab97511, identifier: 1986672
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529570d150>
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19811d5a-f341-58bf-a625-1f35d87f7ba8/19811d5a-f341-58bf-a625-1f35d87f7ba8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252F3b0565816a254311bd313de55bbb357c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/3b0565816a254311bd313de55bbb357c/images/large/1.jpg saved to cache
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19811d5a-f341-58bf-a625-1f35d87f7ba8
2026-03-27 13:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19811d5a-f341-58bf-a625-1f35d87f7ba8, skipping ID generation
2026-03-27 13:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19811d5a-f341-58bf-a625-1f35d87f7ba8 with scrape type 1
2026-03-27 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19811d5a-f341-58bf-a625-1f35d87f7ba8 sending to next pipeline
2026-03-27 13:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 19811d5a-f341-58bf-a625-1f35d87f7ba8, identifier: 1986670
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0b250>
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5a16029-39db-55f4-b512-bef98bbc8c00/d5a16029-39db-55f4-b512-bef98bbc8c00_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F561%252Fa189273c19b54ccaae61b9a16d8b3243%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/561/a189273c19b54ccaae61b9a16d8b3243/images/large/1.jpg saved to cache
2026-03-27 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5a16029-39db-55f4-b512-bef98bbc8c00
2026-03-27 13:31:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5a16029-39db-55f4-b512-bef98bbc8c00, skipping ID generation
2026-03-27 13:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5a16029-39db-55f4-b512-bef98bbc8c00 with scrape type 1
2026-03-27 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5a16029-39db-55f4-b512-bef98bbc8c00 sending to next pipeline
2026-03-27 13:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d5a16029-39db-55f4-b512-bef98bbc8c00, identifier: 1986673
2026-03-27 13:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963cf250>
2026-03-27 13:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6070cc-16d4-5b77-8317-87d44ca08cb8/6b6070cc-16d4-5b77-8317-87d44ca08cb8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252F2df329d0c2e1471883839dcd139b366a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/2df329d0c2e1471883839dcd139b366a/images/large/1.jpg saved to cache
2026-03-27 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8
2026-03-27 13:31:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b6070cc-16d4-5b77-8317-87d44ca08cb8, skipping ID generation
2026-03-27 13:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with scrape type 1
2026-03-27 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b6070cc-16d4-5b77-8317-87d44ca08cb8 sending to next pipeline
2026-03-27 13:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6b6070cc-16d4-5b77-8317-87d44ca08cb8, identifier: 1986675
2026-03-27 13:31:38 [ayvens.es] INFO: Found listing with ID: 1986684
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986684%27 HTTP/1.1" 200 None
2026-03-27 13:31:38 [ayvens.es] INFO: Scrape type for 1986684: 1
2026-03-27 13:31:38 [ayvens.es] INFO: Extracting data for car ID: 1986684
2026-03-27 13:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc04d02-9578-5962-8682-b41268fd2d2e with identifier: 1986684
2026-03-27 13:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc04d02-9578-5962-8682-b41268fd2d2e with scrape type 1
2026-03-27 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ecc04d02-9578-5962-8682-b41268fd2d2e
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252F60ae256d839f4be5b2217fcc8dfdc780%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/60ae256d839f4be5b2217fcc8dfdc780/images/large/1.jpg not downloaded yet
2026-03-27 13:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2042b6af-7086-5de9-90e5-e48fd948d57f with identifier: 1986669
2026-03-27 13:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2042b6af-7086-5de9-90e5-e48fd948d57f with identifier: 1986669
2026-03-27 13:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2042b6af-7086-5de9-90e5-e48fd948d57f with identifier: 1986669 to the API
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/164/7abd9cca9ba246428ef054eef9fc6484/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '2042b6af-7086-5de9-90e5-e48fd948d57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 99196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2042b6af-7086-5de9-90e5-e48fd948d57f/2042b6af-7086-5de9-90e5-e48fd948d57f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/164/7abd9cca9ba246428ef054eef9fc6484/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 1.2 8v 51kW (69CV) Pop',
 'transmission': 'manual',
 'trim': '1.2 8v 51kW (69CV) Pop',
 'vin': None,
 'year': 2018}
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986669%27 HTTP/1.1" 200 None
2026-03-27 13:31:38 [ayvens.es] INFO: Saving data for 1986669: {'created_time': 1774618298.617063, 'last_price_update_time': 1774618298.617078, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986669') HTTP/1.1" 204 0
2026-03-27 13:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab06b5df-22a6-501a-bb3f-83990d1d6957 with identifier: 1986671
2026-03-27 13:31:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab06b5df-22a6-501a-bb3f-83990d1d6957 with identifier: 1986671
2026-03-27 13:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab06b5df-22a6-501a-bb3f-83990d1d6957 with identifier: 1986671 to the API
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/133/2d6ce993bf3f47268d040c03b28abe6e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Verde',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab06b5df-22a6-501a-bb3f-83990d1d6957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 106461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab06b5df-22a6-501a-bb3f-83990d1d6957/ab06b5df-22a6-501a-bb3f-83990d1d6957_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/133/2d6ce993bf3f47268d040c03b28abe6e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986671%27 HTTP/1.1" 200 None
2026-03-27 13:31:38 [ayvens.es] INFO: Saving data for 1986671: {'created_time': 1774618298.961469, 'last_price_update_time': 1774618298.961479, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986671') HTTP/1.1" 204 0
2026-03-27 13:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2025984-596b-5c0b-8dd2-05672f74a66c with identifier: 1986674
2026-03-27 13:31:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2025984-596b-5c0b-8dd2-05672f74a66c with identifier: 1986674
2026-03-27 13:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2025984-596b-5c0b-8dd2-05672f74a66c with identifier: 1986674 to the API
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/749/fa7c50e750204ef1ad8c250f5e45986c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Urban',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f2025984-596b-5c0b-8dd2-05672f74a66c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 106165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2025984-596b-5c0b-8dd2-05672f74a66c/f2025984-596b-5c0b-8dd2-05672f74a66c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/749/fa7c50e750204ef1ad8c250f5e45986c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986674%27 HTTP/1.1" 200 None
2026-03-27 13:31:39 [ayvens.es] INFO: Saving data for 1986674: {'created_time': 1774618299.283059, 'last_price_update_time': 1774618299.28307, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986674') HTTP/1.1" 204 0
2026-03-27 13:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f8601ad7-3a34-53e6-943f-3f518fcfaa77 with identifier: 1986668
2026-03-27 13:31:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f8601ad7-3a34-53e6-943f-3f518fcfaa77 with identifier: 1986668
2026-03-27 13:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f8601ad7-3a34-53e6-943f-3f518fcfaa77 with identifier: 1986668 to the API
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/107/79afdff3dd5f4de7acdc83a429fd4217/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Clear',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f8601ad7-3a34-53e6-943f-3f518fcfaa77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 49616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8601ad7-3a34-53e6-943f-3f518fcfaa77/f8601ad7-3a34-53e6-943f-3f518fcfaa77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/107/79afdff3dd5f4de7acdc83a429fd4217/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986668%27 HTTP/1.1" 200 None
2026-03-27 13:31:39 [ayvens.es] INFO: Saving data for 1986668: {'created_time': 1774618299.60587, 'last_price_update_time': 1774618299.60588, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986668') HTTP/1.1" 204 0
2026-03-27 13:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8e13b18a-3b28-5586-a231-32743ab97511 with identifier: 1986672
2026-03-27 13:31:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8e13b18a-3b28-5586-a231-32743ab97511 with identifier: 1986672
2026-03-27 13:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8e13b18a-3b28-5586-a231-32743ab97511 with identifier: 1986672 to the API
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/357/12725365d54d499f81353d50a6fbc186/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'color': 'Fujy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '8e13b18a-3b28-5586-a231-32743ab97511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 143575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e13b18a-3b28-5586-a231-32743ab97511/8e13b18a-3b28-5586-a231-32743ab97511_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/357/12725365d54d499f81353d50a6fbc186/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0P 250PS MHEV R-Dynamic S 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0P 250PS MHEV R-Dynamic S 4WD Auto',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986672%27 HTTP/1.1" 200 None
2026-03-27 13:31:39 [ayvens.es] INFO: Saving data for 1986672: {'created_time': 1774618299.927996, 'last_price_update_time': 1774618299.928007, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986672') HTTP/1.1" 204 0
2026-03-27 13:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 19811d5a-f341-58bf-a625-1f35d87f7ba8 with identifier: 1986670
2026-03-27 13:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 19811d5a-f341-58bf-a625-1f35d87f7ba8 with identifier: 1986670
2026-03-27 13:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 19811d5a-f341-58bf-a625-1f35d87f7ba8 with identifier: 1986670 to the API
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/013/3b0565816a254311bd313de55bbb357c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '19811d5a-f341-58bf-a625-1f35d87f7ba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 81356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19811d5a-f341-58bf-a625-1f35d87f7ba8/19811d5a-f341-58bf-a625-1f35d87f7ba8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/013/3b0565816a254311bd313de55bbb357c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 2.0 TDI 110kW (150 CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150 CV)',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986670%27 HTTP/1.1" 200 None
2026-03-27 13:31:40 [ayvens.es] INFO: Saving data for 1986670: {'created_time': 1774618300.257387, 'last_price_update_time': 1774618300.257397, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986670') HTTP/1.1" 204 0
2026-03-27 13:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d5a16029-39db-55f4-b512-bef98bbc8c00 with identifier: 1986673
2026-03-27 13:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d5a16029-39db-55f4-b512-bef98bbc8c00 with identifier: 1986673
2026-03-27 13:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d5a16029-39db-55f4-b512-bef98bbc8c00 with identifier: 1986673 to the API
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/561/a189273c19b54ccaae61b9a16d8b3243/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd5a16029-39db-55f4-b512-bef98bbc8c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 64840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5a16029-39db-55f4-b512-bef98bbc8c00/d5a16029-39db-55f4-b512-bef98bbc8c00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/561/a189273c19b54ccaae61b9a16d8b3243/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986673%27 HTTP/1.1" 200 None
2026-03-27 13:31:40 [ayvens.es] INFO: Saving data for 1986673: {'created_time': 1774618300.590145, 'last_price_update_time': 1774618300.590157, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986673') HTTP/1.1" 204 0
2026-03-27 13:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with identifier: 1986675
2026-03-27 13:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with identifier: 1986675
2026-03-27 13:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6b6070cc-16d4-5b77-8317-87d44ca08cb8 with identifier: 1986675 to the API
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/688/2df329d0c2e1471883839dcd139b366a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '6b6070cc-16d4-5b77-8317-87d44ca08cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 75722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6070cc-16d4-5b77-8317-87d44ca08cb8/6b6070cc-16d4-5b77-8317-87d44ca08cb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/688/2df329d0c2e1471883839dcd139b366a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986675%27 HTTP/1.1" 200 None
2026-03-27 13:31:40 [ayvens.es] INFO: Saving data for 1986675: {'created_time': 1774618300.92824, 'last_price_update_time': 1774618300.928255, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986675') HTTP/1.1" 204 0
2026-03-27 13:31:40 [ayvens.es] INFO: Found listing with ID: 1986685
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986685%27 HTTP/1.1" 200 None
2026-03-27 13:31:40 [ayvens.es] INFO: Scrape type for 1986685: 1
2026-03-27 13:31:40 [ayvens.es] INFO: Extracting data for car ID: 1986685
2026-03-27 13:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f91a61-71ee-597e-834f-935bebe655dd with identifier: 1986685
2026-03-27 13:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f91a61-71ee-597e-834f-935bebe655dd with scrape type 1
2026-03-27 13:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 67f91a61-71ee-597e-834f-935bebe655dd
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F7cbf5b2dda0f4b539ceb295787a980b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/7cbf5b2dda0f4b539ceb295787a980b1/images/large/1.jpg not downloaded yet
2026-03-27 13:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/353/58a21c80694b4495a14c98a72dd409be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/757/122a55f78b054f83ae5d3aee4e8e69d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/302/3de522a398ec453688a7110c8764bc35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:41 [ayvens.es] INFO: Found listing with ID: 1986686
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986686%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [ayvens.es] INFO: Scrape type for 1986686: 1
2026-03-27 13:31:41 [ayvens.es] INFO: Extracting data for car ID: 1986686
2026-03-27 13:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2f57c88-6e57-58f9-a918-de8acdb787c7 with identifier: 1986686
2026-03-27 13:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f57c88-6e57-58f9-a918-de8acdb787c7 with scrape type 1
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2f57c88-6e57-58f9-a918-de8acdb787c7
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252Fcbeb07cedcc64393b88cc573d45126d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/cbeb07cedcc64393b88cc573d45126d4/images/large/1.jpg not downloaded yet
2026-03-27 13:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/256/a0687677649d4d4c88110e572a5d011e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/692/a021ff101aa44509b4a6331c55c49ad2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/535/e97004394d084d07836b6f9f68cda393/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:41 [ayvens.es] INFO: Found listing with ID: 1986687
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986687%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [ayvens.es] INFO: Scrape type for 1986687: 1
2026-03-27 13:31:41 [ayvens.es] INFO: Extracting data for car ID: 1986687
2026-03-27 13:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef6c3f1b-33bc-56db-9698-80ff9aa0dad1 with identifier: 1986687
2026-03-27 13:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef6c3f1b-33bc-56db-9698-80ff9aa0dad1 with scrape type 1
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef6c3f1b-33bc-56db-9698-80ff9aa0dad1
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F160%252F5e722f9e3b0e4f058370b7522b8a5aae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/160/5e722f9e3b0e4f058370b7522b8a5aae/images/large/1.jpg not downloaded yet
2026-03-27 13:31:41 [ayvens.es] INFO: Found listing with ID: 1986688
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986688%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [ayvens.es] INFO: Scrape type for 1986688: 1
2026-03-27 13:31:41 [ayvens.es] INFO: Extracting data for car ID: 1986688
2026-03-27 13:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45798655-6898-52fc-a90c-205b76d32f28 with identifier: 1986688
2026-03-27 13:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45798655-6898-52fc-a90c-205b76d32f28 with scrape type 1
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45798655-6898-52fc-a90c-205b76d32f28
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252F36d4deffc04749959cc1db2bf360e5bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/36d4deffc04749959cc1db2bf360e5bb/images/large/1.jpg not downloaded yet
2026-03-27 13:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/682/f2f85c96386c4a3a9e3dd4390ac4bc7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:41 [ayvens.es] INFO: Found listing with ID: 1986689
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986689%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [ayvens.es] INFO: Scrape type for 1986689: 1
2026-03-27 13:31:41 [ayvens.es] INFO: Extracting data for car ID: 1986689
2026-03-27 13:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with identifier: 1986689
2026-03-27 13:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with scrape type 1
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F846%252F198fd364b0034284bf7a6fed4c43cbda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/846/198fd364b0034284bf7a6fed4c43cbda/images/large/1.jpg not downloaded yet
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945d9910>
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c2915e-35ca-507a-8eb0-b8809abfae4e/99c2915e-35ca-507a-8eb0-b8809abfae4e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F58a21c80694b4495a14c98a72dd409be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/58a21c80694b4495a14c98a72dd409be/images/large/1.jpg saved to cache
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99c2915e-35ca-507a-8eb0-b8809abfae4e
2026-03-27 13:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99c2915e-35ca-507a-8eb0-b8809abfae4e, skipping ID generation
2026-03-27 13:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c2915e-35ca-507a-8eb0-b8809abfae4e with scrape type 1
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99c2915e-35ca-507a-8eb0-b8809abfae4e sending to next pipeline
2026-03-27 13:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99c2915e-35ca-507a-8eb0-b8809abfae4e, identifier: 1986677
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957a4c50>
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392216bc-b60b-5196-bc1e-cdb83a6226b6/392216bc-b60b-5196-bc1e-cdb83a6226b6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F122a55f78b054f83ae5d3aee4e8e69d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/122a55f78b054f83ae5d3aee4e8e69d5/images/large/1.jpg saved to cache
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 392216bc-b60b-5196-bc1e-cdb83a6226b6
2026-03-27 13:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 392216bc-b60b-5196-bc1e-cdb83a6226b6, skipping ID generation
2026-03-27 13:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392216bc-b60b-5196-bc1e-cdb83a6226b6 with scrape type 1
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 392216bc-b60b-5196-bc1e-cdb83a6226b6 sending to next pipeline
2026-03-27 13:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 392216bc-b60b-5196-bc1e-cdb83a6226b6, identifier: 1986680
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c30d10>
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_429b4528-74ec-5701-97b6-b3d9ac42a82d/429b4528-74ec-5701-97b6-b3d9ac42a82d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252F3de522a398ec453688a7110c8764bc35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/3de522a398ec453688a7110c8764bc35/images/large/1.jpg saved to cache
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 429b4528-74ec-5701-97b6-b3d9ac42a82d
2026-03-27 13:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 429b4528-74ec-5701-97b6-b3d9ac42a82d, skipping ID generation
2026-03-27 13:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429b4528-74ec-5701-97b6-b3d9ac42a82d with scrape type 1
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 429b4528-74ec-5701-97b6-b3d9ac42a82d sending to next pipeline
2026-03-27 13:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 429b4528-74ec-5701-97b6-b3d9ac42a82d, identifier: 1986678
2026-03-27 13:31:41 [ayvens.es] INFO: Found listing with ID: 1986690
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986690%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [ayvens.es] INFO: Scrape type for 1986690: 1
2026-03-27 13:31:41 [ayvens.es] INFO: Extracting data for car ID: 1986690
2026-03-27 13:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with identifier: 1986690
2026-03-27 13:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with scrape type 1
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F012%252F093f0abfac0d47d5a78f4f5de2c721dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/012/093f0abfac0d47d5a78f4f5de2c721dc/images/large/1.jpg not downloaded yet
2026-03-27 13:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99c2915e-35ca-507a-8eb0-b8809abfae4e with identifier: 1986677
2026-03-27 13:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99c2915e-35ca-507a-8eb0-b8809abfae4e with identifier: 1986677
2026-03-27 13:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99c2915e-35ca-507a-8eb0-b8809abfae4e with identifier: 1986677 to the API
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/353/58a21c80694b4495a14c98a72dd409be/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 18,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '99c2915e-35ca-507a-8eb0-b8809abfae4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 23976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c2915e-35ca-507a-8eb0-b8809abfae4e/99c2915e-35ca-507a-8eb0-b8809abfae4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/353/58a21c80694b4495a14c98a72dd409be/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 250 e Sedan',
 'transmission': 'manual',
 'trim': 'A 250 e Sedan',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986677%27 HTTP/1.1" 200 None
2026-03-27 13:31:42 [ayvens.es] INFO: Saving data for 1986677: {'created_time': 1774618302.006713, 'last_price_update_time': 1774618302.006733, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986677') HTTP/1.1" 204 0
2026-03-27 13:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 392216bc-b60b-5196-bc1e-cdb83a6226b6 with identifier: 1986680
2026-03-27 13:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 392216bc-b60b-5196-bc1e-cdb83a6226b6 with identifier: 1986680
2026-03-27 13:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 392216bc-b60b-5196-bc1e-cdb83a6226b6 with identifier: 1986680 to the API
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/757/122a55f78b054f83ae5d3aee4e8e69d5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '392216bc-b60b-5196-bc1e-cdb83a6226b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 72185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392216bc-b60b-5196-bc1e-cdb83a6226b6/392216bc-b60b-5196-bc1e-cdb83a6226b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/757/122a55f78b054f83ae5d3aee4e8e69d5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986680%27 HTTP/1.1" 200 None
2026-03-27 13:31:42 [ayvens.es] INFO: Saving data for 1986680: {'created_time': 1774618302.418841, 'last_price_update_time': 1774618302.418853, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986680') HTTP/1.1" 204 0
2026-03-27 13:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 429b4528-74ec-5701-97b6-b3d9ac42a82d with identifier: 1986678
2026-03-27 13:31:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 429b4528-74ec-5701-97b6-b3d9ac42a82d with identifier: 1986678
2026-03-27 13:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 429b4528-74ec-5701-97b6-b3d9ac42a82d with identifier: 1986678 to the API
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/302/3de522a398ec453688a7110c8764bc35/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Midnight',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '429b4528-74ec-5701-97b6-b3d9ac42a82d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 65839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_429b4528-74ec-5701-97b6-b3d9ac42a82d/429b4528-74ec-5701-97b6-b3d9ac42a82d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/302/3de522a398ec453688a7110c8764bc35/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986678%27 HTTP/1.1" 200 None
2026-03-27 13:31:42 [ayvens.es] INFO: Saving data for 1986678: {'created_time': 1774618302.730707, 'last_price_update_time': 1774618302.730717, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986678') HTTP/1.1" 204 0
2026-03-27 13:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296403310>
2026-03-27 13:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5664218e-3dc0-56c9-91b6-ec8566feff53/5664218e-3dc0-56c9-91b6-ec8566feff53_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F256%252Fa0687677649d4d4c88110e572a5d011e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/256/a0687677649d4d4c88110e572a5d011e/images/large/1.jpg saved to cache
2026-03-27 13:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5664218e-3dc0-56c9-91b6-ec8566feff53
2026-03-27 13:31:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5664218e-3dc0-56c9-91b6-ec8566feff53, skipping ID generation
2026-03-27 13:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5664218e-3dc0-56c9-91b6-ec8566feff53 with scrape type 1
2026-03-27 13:31:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5664218e-3dc0-56c9-91b6-ec8566feff53 sending to next pipeline
2026-03-27 13:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5664218e-3dc0-56c9-91b6-ec8566feff53, identifier: 1986676
2026-03-27 13:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962fbb90>
2026-03-27 13:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f900d456-c116-5f99-a8ee-1bc7759b9265/f900d456-c116-5f99-a8ee-1bc7759b9265_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252Fa021ff101aa44509b4a6331c55c49ad2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/a021ff101aa44509b4a6331c55c49ad2/images/large/1.jpg saved to cache
2026-03-27 13:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f900d456-c116-5f99-a8ee-1bc7759b9265
2026-03-27 13:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f900d456-c116-5f99-a8ee-1bc7759b9265, skipping ID generation
2026-03-27 13:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f900d456-c116-5f99-a8ee-1bc7759b9265 with scrape type 1
2026-03-27 13:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f900d456-c116-5f99-a8ee-1bc7759b9265 sending to next pipeline
2026-03-27 13:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f900d456-c116-5f99-a8ee-1bc7759b9265, identifier: 1986679
2026-03-27 13:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529615e710>
2026-03-27 13:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d43fd3-b12d-5401-9120-592e44bf005b/d3d43fd3-b12d-5401-9120-592e44bf005b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252Fe97004394d084d07836b6f9f68cda393%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/e97004394d084d07836b6f9f68cda393/images/large/1.jpg saved to cache
2026-03-27 13:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3d43fd3-b12d-5401-9120-592e44bf005b
2026-03-27 13:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3d43fd3-b12d-5401-9120-592e44bf005b, skipping ID generation
2026-03-27 13:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d43fd3-b12d-5401-9120-592e44bf005b with scrape type 1
2026-03-27 13:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3d43fd3-b12d-5401-9120-592e44bf005b sending to next pipeline
2026-03-27 13:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3d43fd3-b12d-5401-9120-592e44bf005b, identifier: 1986681
2026-03-27 13:31:43 [ayvens.es] INFO: Found listing with ID: 1986691
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986691%27 HTTP/1.1" 200 None
2026-03-27 13:31:43 [ayvens.es] INFO: Scrape type for 1986691: 1
2026-03-27 13:31:43 [ayvens.es] INFO: Extracting data for car ID: 1986691
2026-03-27 13:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430ee523-364a-5149-bac6-d0437e7b6a99 with identifier: 1986691
2026-03-27 13:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430ee523-364a-5149-bac6-d0437e7b6a99 with scrape type 1
2026-03-27 13:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 430ee523-364a-5149-bac6-d0437e7b6a99
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F291%252F2f988c4e53274e699e0606024618868d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/291/2f988c4e53274e699e0606024618868d/images/large/1.jpg not downloaded yet
2026-03-27 13:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5664218e-3dc0-56c9-91b6-ec8566feff53 with identifier: 1986676
2026-03-27 13:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5664218e-3dc0-56c9-91b6-ec8566feff53 with identifier: 1986676
2026-03-27 13:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5664218e-3dc0-56c9-91b6-ec8566feff53 with identifier: 1986676 to the API
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/256/a0687677649d4d4c88110e572a5d011e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Eiger',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5664218e-3dc0-56c9-91b6-ec8566feff53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 41485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5664218e-3dc0-56c9-91b6-ec8566feff53/5664218e-3dc0-56c9-91b6-ec8566feff53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/256/a0687677649d4d4c88110e572a5d011e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0D 163PS MHEV SE 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0D 163PS MHEV SE 4WD Auto',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986676%27 HTTP/1.1" 200 None
2026-03-27 13:31:43 [ayvens.es] INFO: Saving data for 1986676: {'created_time': 1774618303.603251, 'last_price_update_time': 1774618303.603261, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986676') HTTP/1.1" 204 0
2026-03-27 13:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f900d456-c116-5f99-a8ee-1bc7759b9265 with identifier: 1986679
2026-03-27 13:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f900d456-c116-5f99-a8ee-1bc7759b9265 with identifier: 1986679
2026-03-27 13:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f900d456-c116-5f99-a8ee-1bc7759b9265 with identifier: 1986679 to the API
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/692/a021ff101aa44509b4a6331c55c49ad2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f900d456-c116-5f99-a8ee-1bc7759b9265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 97086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900d456-c116-5f99-a8ee-1bc7759b9265/f900d456-c116-5f99-a8ee-1bc7759b9265_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/a021ff101aa44509b4a6331c55c49ad2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986679%27 HTTP/1.1" 200 None
2026-03-27 13:31:43 [ayvens.es] INFO: Saving data for 1986679: {'created_time': 1774618303.93599, 'last_price_update_time': 1774618303.936, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986679') HTTP/1.1" 204 0
2026-03-27 13:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3d43fd3-b12d-5401-9120-592e44bf005b with identifier: 1986681
2026-03-27 13:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3d43fd3-b12d-5401-9120-592e44bf005b with identifier: 1986681
2026-03-27 13:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3d43fd3-b12d-5401-9120-592e44bf005b with identifier: 1986681 to the API
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/535/e97004394d084d07836b6f9f68cda393/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3d43fd3-b12d-5401-9120-592e44bf005b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 194758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d43fd3-b12d-5401-9120-592e44bf005b/d3d43fd3-b12d-5401-9120-592e44bf005b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/e97004394d084d07836b6f9f68cda393/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Comfort Blue dCi 85kW (115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Comfort Blue dCi 85kW (115CV) 4X4',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986681%27 HTTP/1.1" 200 None
2026-03-27 13:31:44 [ayvens.es] INFO: Saving data for 1986681: {'created_time': 1774618304.311918, 'last_price_update_time': 1774618304.311927, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986681') HTTP/1.1" 204 0
2026-03-27 13:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945dae10>
2026-03-27 13:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e869898-566d-5835-bddc-5c3bfc4d44be/3e869898-566d-5835-bddc-5c3bfc4d44be_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252Ff2f85c96386c4a3a9e3dd4390ac4bc7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/f2f85c96386c4a3a9e3dd4390ac4bc7d/images/large/1.jpg saved to cache
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e869898-566d-5835-bddc-5c3bfc4d44be
2026-03-27 13:31:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e869898-566d-5835-bddc-5c3bfc4d44be, skipping ID generation
2026-03-27 13:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e869898-566d-5835-bddc-5c3bfc4d44be with scrape type 1
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e869898-566d-5835-bddc-5c3bfc4d44be sending to next pipeline
2026-03-27 13:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e869898-566d-5835-bddc-5c3bfc4d44be, identifier: 1986682
2026-03-27 13:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/013/9d035baa93ad4359b3177aaeebf79e55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/416/60ae256d839f4be5b2217fcc8dfdc780/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:44 [ayvens.es] INFO: Found listing with ID: 1986692
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986692%27 HTTP/1.1" 200 None
2026-03-27 13:31:44 [ayvens.es] INFO: Scrape type for 1986692: 1
2026-03-27 13:31:44 [ayvens.es] INFO: Extracting data for car ID: 1986692
2026-03-27 13:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with identifier: 1986692
2026-03-27 13:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with scrape type 1
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F4b13a3e9f05042369365ff708b5c2631%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/4b13a3e9f05042369365ff708b5c2631/images/large/1.jpg not downloaded yet
2026-03-27 13:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e869898-566d-5835-bddc-5c3bfc4d44be with identifier: 1986682
2026-03-27 13:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e869898-566d-5835-bddc-5c3bfc4d44be with identifier: 1986682
2026-03-27 13:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e869898-566d-5835-bddc-5c3bfc4d44be with identifier: 1986682 to the API
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/682/f2f85c96386c4a3a9e3dd4390ac4bc7d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e869898-566d-5835-bddc-5c3bfc4d44be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 116469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e869898-566d-5835-bddc-5c3bfc4d44be/3e869898-566d-5835-bddc-5c3bfc4d44be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/682/f2f85c96386c4a3a9e3dd4390ac4bc7d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 220 d',
 'transmission': 'manual',
 'trim': 'C 220 d',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986682%27 HTTP/1.1" 200 None
2026-03-27 13:31:44 [ayvens.es] INFO: Saving data for 1986682: {'created_time': 1774618304.807364, 'last_price_update_time': 1774618304.807377, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986682') HTTP/1.1" 204 0
2026-03-27 13:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/897/7cbf5b2dda0f4b539ceb295787a980b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/160/5e722f9e3b0e4f058370b7522b8a5aae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/129/cbeb07cedcc64393b88cc573d45126d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:44 [ayvens.es] INFO: Found listing with ID: 1986693
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986693%27 HTTP/1.1" 200 None
2026-03-27 13:31:44 [ayvens.es] INFO: Scrape type for 1986693: 1
2026-03-27 13:31:44 [ayvens.es] INFO: Extracting data for car ID: 1986693
2026-03-27 13:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26a01f7-b072-500a-80a8-6ab01f7025b2 with identifier: 1986693
2026-03-27 13:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26a01f7-b072-500a-80a8-6ab01f7025b2 with scrape type 1
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a26a01f7-b072-500a-80a8-6ab01f7025b2
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252Fdc45b82d95074a669a4838ca20f7677e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/dc45b82d95074a669a4838ca20f7677e/images/large/1.jpg not downloaded yet
2026-03-27 13:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529600a5d0>
2026-03-27 13:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efe404f7-a33b-5c4a-9cfb-268b4a54b48c/efe404f7-a33b-5c4a-9cfb-268b4a54b48c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252F9d035baa93ad4359b3177aaeebf79e55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/9d035baa93ad4359b3177aaeebf79e55/images/large/1.jpg saved to cache
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c
2026-03-27 13:31:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efe404f7-a33b-5c4a-9cfb-268b4a54b48c, skipping ID generation
2026-03-27 13:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c with scrape type 1
2026-03-27 13:31:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efe404f7-a33b-5c4a-9cfb-268b4a54b48c sending to next pipeline
2026-03-27 13:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: efe404f7-a33b-5c4a-9cfb-268b4a54b48c, identifier: 1986683
2026-03-27 13:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960562d0>
2026-03-27 13:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc04d02-9578-5962-8682-b41268fd2d2e/ecc04d02-9578-5962-8682-b41268fd2d2e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252F60ae256d839f4be5b2217fcc8dfdc780%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/60ae256d839f4be5b2217fcc8dfdc780/images/large/1.jpg saved to cache
2026-03-27 13:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecc04d02-9578-5962-8682-b41268fd2d2e
2026-03-27 13:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecc04d02-9578-5962-8682-b41268fd2d2e, skipping ID generation
2026-03-27 13:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc04d02-9578-5962-8682-b41268fd2d2e with scrape type 1
2026-03-27 13:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecc04d02-9578-5962-8682-b41268fd2d2e sending to next pipeline
2026-03-27 13:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ecc04d02-9578-5962-8682-b41268fd2d2e, identifier: 1986684
2026-03-27 13:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/706/36d4deffc04749959cc1db2bf360e5bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:45 [ayvens.es] INFO: Found listing with ID: 1986694
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986694%27 HTTP/1.1" 200 None
2026-03-27 13:31:45 [ayvens.es] INFO: Scrape type for 1986694: 1
2026-03-27 13:31:45 [ayvens.es] INFO: Extracting data for car ID: 1986694
2026-03-27 13:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a350417e-46b5-5412-b8fc-289aaf9c736c with identifier: 1986694
2026-03-27 13:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a350417e-46b5-5412-b8fc-289aaf9c736c with scrape type 1
2026-03-27 13:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a350417e-46b5-5412-b8fc-289aaf9c736c
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252F43e95aaabcd64da3a0e7299c480c13f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/43e95aaabcd64da3a0e7299c480c13f4/images/large/1.jpg not downloaded yet
2026-03-27 13:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: efe404f7-a33b-5c4a-9cfb-268b4a54b48c with identifier: 1986683
2026-03-27 13:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: efe404f7-a33b-5c4a-9cfb-268b4a54b48c with identifier: 1986683
2026-03-27 13:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: efe404f7-a33b-5c4a-9cfb-268b4a54b48c with identifier: 1986683 to the API
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/013/9d035baa93ad4359b3177aaeebf79e55/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'efe404f7-a33b-5c4a-9cfb-268b4a54b48c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 CACTUS',
 'odometer': 86950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efe404f7-a33b-5c4a-9cfb-268b4a54b48c/efe404f7-a33b-5c4a-9cfb-268b4a54b48c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/013/9d035baa93ad4359b3177aaeebf79e55/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 CACTUS BlueHDi 100 S&S Shine',
 'transmission': 'manual',
 'trim': 'BlueHDi 100 S&S Shine',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986683%27 HTTP/1.1" 200 None
2026-03-27 13:31:45 [ayvens.es] INFO: Saving data for 1986683: {'created_time': 1774618305.551386, 'last_price_update_time': 1774618305.551396, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986683') HTTP/1.1" 204 0
2026-03-27 13:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ecc04d02-9578-5962-8682-b41268fd2d2e with identifier: 1986684
2026-03-27 13:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ecc04d02-9578-5962-8682-b41268fd2d2e with identifier: 1986684
2026-03-27 13:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ecc04d02-9578-5962-8682-b41268fd2d2e with identifier: 1986684 to the API
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/416/60ae256d839f4be5b2217fcc8dfdc780/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ecc04d02-9578-5962-8682-b41268fd2d2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 164289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc04d02-9578-5962-8682-b41268fd2d2e/ecc04d02-9578-5962-8682-b41268fd2d2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/416/60ae256d839f4be5b2217fcc8dfdc780/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER SPORT 3.0D I6 220kW (300CV) MHEV AWD Auto '
          'HSE',
 'transmission': 'manual',
 'trim': '3.0D I6 220kW (300CV) MHEV AWD Auto HSE',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986684%27 HTTP/1.1" 200 None
2026-03-27 13:31:45 [ayvens.es] INFO: Saving data for 1986684: {'created_time': 1774618305.913499, 'last_price_update_time': 1774618305.913509, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986684') HTTP/1.1" 204 0
2026-03-27 13:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/846/198fd364b0034284bf7a6fed4c43cbda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:45 [ayvens.es] INFO: Found listing with ID: 1986695
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986695%27 HTTP/1.1" 200 None
2026-03-27 13:31:45 [ayvens.es] INFO: Scrape type for 1986695: 1
2026-03-27 13:31:45 [ayvens.es] INFO: Extracting data for car ID: 1986695
2026-03-27 13:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6e8131d-eccb-5269-8874-ae528d74bfd8 with identifier: 1986695
2026-03-27 13:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e8131d-eccb-5269-8874-ae528d74bfd8 with scrape type 1
2026-03-27 13:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6e8131d-eccb-5269-8874-ae528d74bfd8
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252Fc0a85e993f9b48d3bc8d6b5b4e0f4001%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/c0a85e993f9b48d3bc8d6b5b4e0f4001/images/large/1.jpg not downloaded yet
2026-03-27 13:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bcda50>
2026-03-27 13:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f91a61-71ee-597e-834f-935bebe655dd/67f91a61-71ee-597e-834f-935bebe655dd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252F7cbf5b2dda0f4b539ceb295787a980b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/7cbf5b2dda0f4b539ceb295787a980b1/images/large/1.jpg saved to cache
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67f91a61-71ee-597e-834f-935bebe655dd
2026-03-27 13:31:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67f91a61-71ee-597e-834f-935bebe655dd, skipping ID generation
2026-03-27 13:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f91a61-71ee-597e-834f-935bebe655dd with scrape type 1
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67f91a61-71ee-597e-834f-935bebe655dd sending to next pipeline
2026-03-27 13:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 67f91a61-71ee-597e-834f-935bebe655dd, identifier: 1986685
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bccfd0>
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6c3f1b-33bc-56db-9698-80ff9aa0dad1/ef6c3f1b-33bc-56db-9698-80ff9aa0dad1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F160%252F5e722f9e3b0e4f058370b7522b8a5aae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/160/5e722f9e3b0e4f058370b7522b8a5aae/images/large/1.jpg saved to cache
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef6c3f1b-33bc-56db-9698-80ff9aa0dad1
2026-03-27 13:31:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef6c3f1b-33bc-56db-9698-80ff9aa0dad1, skipping ID generation
2026-03-27 13:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef6c3f1b-33bc-56db-9698-80ff9aa0dad1 with scrape type 1
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef6c3f1b-33bc-56db-9698-80ff9aa0dad1 sending to next pipeline
2026-03-27 13:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef6c3f1b-33bc-56db-9698-80ff9aa0dad1, identifier: 1986687
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529619dd50>
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f57c88-6e57-58f9-a918-de8acdb787c7/b2f57c88-6e57-58f9-a918-de8acdb787c7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252Fcbeb07cedcc64393b88cc573d45126d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/cbeb07cedcc64393b88cc573d45126d4/images/large/1.jpg saved to cache
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2f57c88-6e57-58f9-a918-de8acdb787c7
2026-03-27 13:31:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2f57c88-6e57-58f9-a918-de8acdb787c7, skipping ID generation
2026-03-27 13:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f57c88-6e57-58f9-a918-de8acdb787c7 with scrape type 1
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2f57c88-6e57-58f9-a918-de8acdb787c7 sending to next pipeline
2026-03-27 13:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2f57c88-6e57-58f9-a918-de8acdb787c7, identifier: 1986686
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0c210>
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45798655-6898-52fc-a90c-205b76d32f28/45798655-6898-52fc-a90c-205b76d32f28_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252F36d4deffc04749959cc1db2bf360e5bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/36d4deffc04749959cc1db2bf360e5bb/images/large/1.jpg saved to cache
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45798655-6898-52fc-a90c-205b76d32f28
2026-03-27 13:31:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45798655-6898-52fc-a90c-205b76d32f28, skipping ID generation
2026-03-27 13:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45798655-6898-52fc-a90c-205b76d32f28 with scrape type 1
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45798655-6898-52fc-a90c-205b76d32f28 sending to next pipeline
2026-03-27 13:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45798655-6898-52fc-a90c-205b76d32f28, identifier: 1986688
2026-03-27 13:31:46 [ayvens.es] INFO: Found listing with ID: 1986696
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986696%27 HTTP/1.1" 200 None
2026-03-27 13:31:46 [ayvens.es] INFO: Scrape type for 1986696: 1
2026-03-27 13:31:46 [ayvens.es] INFO: Extracting data for car ID: 1986696
2026-03-27 13:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afdf6c14-8967-584b-a25d-0a1b3722109d with identifier: 1986696
2026-03-27 13:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afdf6c14-8967-584b-a25d-0a1b3722109d with scrape type 1
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afdf6c14-8967-584b-a25d-0a1b3722109d
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F665%252F19e6b8e068814461978a0bdbc91bd382%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/665/19e6b8e068814461978a0bdbc91bd382/images/large/1.jpg not downloaded yet
2026-03-27 13:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 67f91a61-71ee-597e-834f-935bebe655dd with identifier: 1986685
2026-03-27 13:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 67f91a61-71ee-597e-834f-935bebe655dd with identifier: 1986685
2026-03-27 13:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 67f91a61-71ee-597e-834f-935bebe655dd with identifier: 1986685 to the API
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/897/7cbf5b2dda0f4b539ceb295787a980b1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '67f91a61-71ee-597e-834f-935bebe655dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 182048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f91a61-71ee-597e-834f-935bebe655dd/67f91a61-71ee-597e-834f-935bebe655dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/897/7cbf5b2dda0f4b539ceb295787a980b1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 318d Auto.',
 'transmission': 'manual',
 'trim': '318d Auto.',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986685%27 HTTP/1.1" 200 None
2026-03-27 13:31:47 [ayvens.es] INFO: Saving data for 1986685: {'created_time': 1774618307.084992, 'last_price_update_time': 1774618307.085002, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986685') HTTP/1.1" 204 0
2026-03-27 13:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef6c3f1b-33bc-56db-9698-80ff9aa0dad1 with identifier: 1986687
2026-03-27 13:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef6c3f1b-33bc-56db-9698-80ff9aa0dad1 with identifier: 1986687
2026-03-27 13:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef6c3f1b-33bc-56db-9698-80ff9aa0dad1 with identifier: 1986687 to the API
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/160/5e722f9e3b0e4f058370b7522b8a5aae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef6c3f1b-33bc-56db-9698-80ff9aa0dad1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 105381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6c3f1b-33bc-56db-9698-80ff9aa0dad1/ef6c3f1b-33bc-56db-9698-80ff9aa0dad1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/160/5e722f9e3b0e4f058370b7522b8a5aae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER Active Standard BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Active Standard BlueHDi 73kW',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986687%27 HTTP/1.1" 200 None
2026-03-27 13:31:47 [ayvens.es] INFO: Saving data for 1986687: {'created_time': 1774618307.424887, 'last_price_update_time': 1774618307.424898, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986687') HTTP/1.1" 204 0
2026-03-27 13:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2f57c88-6e57-58f9-a918-de8acdb787c7 with identifier: 1986686
2026-03-27 13:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2f57c88-6e57-58f9-a918-de8acdb787c7 with identifier: 1986686
2026-03-27 13:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2f57c88-6e57-58f9-a918-de8acdb787c7 with identifier: 1986686 to the API
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/129/cbeb07cedcc64393b88cc573d45126d4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2f57c88-6e57-58f9-a918-de8acdb787c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 CACTUS',
 'odometer': 101517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f57c88-6e57-58f9-a918-de8acdb787c7/b2f57c88-6e57-58f9-a918-de8acdb787c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/129/cbeb07cedcc64393b88cc573d45126d4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 CACTUS (O) BlueHDi 100 S&S C-Series',
 'transmission': 'manual',
 'trim': '(O) BlueHDi 100 S&S C-Series',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986686%27 HTTP/1.1" 200 None
2026-03-27 13:31:47 [ayvens.es] INFO: Saving data for 1986686: {'created_time': 1774618307.779658, 'last_price_update_time': 1774618307.779669, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986686') HTTP/1.1" 204 0
2026-03-27 13:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45798655-6898-52fc-a90c-205b76d32f28 with identifier: 1986688
2026-03-27 13:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45798655-6898-52fc-a90c-205b76d32f28 with identifier: 1986688
2026-03-27 13:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45798655-6898-52fc-a90c-205b76d32f28 with identifier: 1986688 to the API
2026-03-27 13:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/706/36d4deffc04749959cc1db2bf360e5bb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '45798655-6898-52fc-a90c-205b76d32f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 124473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45798655-6898-52fc-a90c-205b76d32f28/45798655-6898-52fc-a90c-205b76d32f28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/706/36d4deffc04749959cc1db2bf360e5bb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 CDTi Ultimate Auto',
 'transmission': 'manual',
 'trim': '1.5 CDTi Ultimate Auto',
 'vin': None,
 'year': 2019}
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986688%27 HTTP/1.1" 200 None
2026-03-27 13:31:48 [ayvens.es] INFO: Saving data for 1986688: {'created_time': 1774618308.150156, 'last_price_update_time': 1774618308.150166, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986688') HTTP/1.1" 204 0
2026-03-27 13:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/291/2f988c4e53274e699e0606024618868d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/012/093f0abfac0d47d5a78f4f5de2c721dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:48 [ayvens.es] INFO: Found listing with ID: 1986697
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986697%27 HTTP/1.1" 200 None
2026-03-27 13:31:48 [ayvens.es] INFO: Scrape type for 1986697: 1
2026-03-27 13:31:48 [ayvens.es] INFO: Extracting data for car ID: 1986697
2026-03-27 13:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bca97f27-712f-5a0f-b8be-6b3bddef395c with identifier: 1986697
2026-03-27 13:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca97f27-712f-5a0f-b8be-6b3bddef395c with scrape type 1
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bca97f27-712f-5a0f-b8be-6b3bddef395c
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F298970f5f12e49cdbc21111818883c33%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/298970f5f12e49cdbc21111818883c33/images/large/1.jpg not downloaded yet
2026-03-27 13:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/108/4b13a3e9f05042369365ff708b5c2631/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295755bd0>
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8/3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F846%252F198fd364b0034284bf7a6fed4c43cbda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/846/198fd364b0034284bf7a6fed4c43cbda/images/large/1.jpg saved to cache
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8
2026-03-27 13:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8, skipping ID generation
2026-03-27 13:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with scrape type 1
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 sending to next pipeline
2026-03-27 13:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8, identifier: 1986689
2026-03-27 13:31:48 [ayvens.es] INFO: Found listing with ID: 1986698
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986698%27 HTTP/1.1" 200 None
2026-03-27 13:31:48 [ayvens.es] INFO: Scrape type for 1986698: 1
2026-03-27 13:31:48 [ayvens.es] INFO: Extracting data for car ID: 1986698
2026-03-27 13:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a630ed6a-a698-50ec-996b-fde1374fa337 with identifier: 1986698
2026-03-27 13:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a630ed6a-a698-50ec-996b-fde1374fa337 with scrape type 1
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a630ed6a-a698-50ec-996b-fde1374fa337
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F486%252F083e2e9f06e341f1a227c4be3cb61106%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/486/083e2e9f06e341f1a227c4be3cb61106/images/large/1.jpg not downloaded yet
2026-03-27 13:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with identifier: 1986689
2026-03-27 13:31:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with identifier: 1986689
2026-03-27 13:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8 with identifier: 1986689 to the API
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/846/198fd364b0034284bf7a6fed4c43cbda/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Mineralweiss',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 81660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8/3e1cc3d4-d1cc-5bbb-a648-3660ba9824c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/846/198fd364b0034284bf7a6fed4c43cbda/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 330e',
 'transmission': 'manual',
 'trim': '330e',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986689%27 HTTP/1.1" 200 None
2026-03-27 13:31:48 [ayvens.es] INFO: Saving data for 1986689: {'created_time': 1774618308.711728, 'last_price_update_time': 1774618308.711739, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986689') HTTP/1.1" 204 0
2026-03-27 13:31:48 [ayvens.es] INFO: Found listing with ID: 1986699
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986699%27 HTTP/1.1" 200 None
2026-03-27 13:31:48 [ayvens.es] INFO: Scrape type for 1986699: 1
2026-03-27 13:31:48 [ayvens.es] INFO: Extracting data for car ID: 1986699
2026-03-27 13:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f12a7744-79a5-5406-b132-ddfe39680a41 with identifier: 1986699
2026-03-27 13:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12a7744-79a5-5406-b132-ddfe39680a41 with scrape type 1
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f12a7744-79a5-5406-b132-ddfe39680a41
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F023%252F895eb46270824682aed51afa6ca165f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/023/895eb46270824682aed51afa6ca165f2/images/large/1.jpg not downloaded yet
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957971d0>
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_430ee523-364a-5149-bac6-d0437e7b6a99/430ee523-364a-5149-bac6-d0437e7b6a99_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F291%252F2f988c4e53274e699e0606024618868d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/291/2f988c4e53274e699e0606024618868d/images/large/1.jpg saved to cache
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 430ee523-364a-5149-bac6-d0437e7b6a99
2026-03-27 13:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 430ee523-364a-5149-bac6-d0437e7b6a99, skipping ID generation
2026-03-27 13:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430ee523-364a-5149-bac6-d0437e7b6a99 with scrape type 1
2026-03-27 13:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 430ee523-364a-5149-bac6-d0437e7b6a99 sending to next pipeline
2026-03-27 13:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 430ee523-364a-5149-bac6-d0437e7b6a99, identifier: 1986691
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962c8b10>
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ba80ec6-5687-5004-9b13-c43f9e42ea5c/5ba80ec6-5687-5004-9b13-c43f9e42ea5c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F012%252F093f0abfac0d47d5a78f4f5de2c721dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/012/093f0abfac0d47d5a78f4f5de2c721dc/images/large/1.jpg saved to cache
2026-03-27 13:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c
2026-03-27 13:31:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c, skipping ID generation
2026-03-27 13:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with scrape type 1
2026-03-27 13:31:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ba80ec6-5687-5004-9b13-c43f9e42ea5c sending to next pipeline
2026-03-27 13:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c, identifier: 1986690
2026-03-27 13:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529631b7d0>
2026-03-27 13:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54d8eaf-eb50-57a5-bac4-67196a4c5bf2/a54d8eaf-eb50-57a5-bac4-67196a4c5bf2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F4b13a3e9f05042369365ff708b5c2631%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/4b13a3e9f05042369365ff708b5c2631/images/large/1.jpg saved to cache
2026-03-27 13:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2
2026-03-27 13:31:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2, skipping ID generation
2026-03-27 13:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with scrape type 1
2026-03-27 13:31:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 sending to next pipeline
2026-03-27 13:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2, identifier: 1986692
2026-03-27 13:31:49 [ayvens.es] INFO: Found listing with ID: 1986700
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986700%27 HTTP/1.1" 200 None
2026-03-27 13:31:49 [ayvens.es] INFO: Scrape type for 1986700: 1
2026-03-27 13:31:49 [ayvens.es] INFO: Extracting data for car ID: 1986700
2026-03-27 13:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1794127-7af2-5157-9935-4d62cd87fc27 with identifier: 1986700
2026-03-27 13:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1794127-7af2-5157-9935-4d62cd87fc27 with scrape type 1
2026-03-27 13:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1794127-7af2-5157-9935-4d62cd87fc27
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F10feaec55d8c43d68b4f4782feaa630d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/10feaec55d8c43d68b4f4782feaa630d/images/large/1.jpg not downloaded yet
2026-03-27 13:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 430ee523-364a-5149-bac6-d0437e7b6a99 with identifier: 1986691
2026-03-27 13:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 430ee523-364a-5149-bac6-d0437e7b6a99 with identifier: 1986691
2026-03-27 13:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 430ee523-364a-5149-bac6-d0437e7b6a99 with identifier: 1986691 to the API
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/291/2f988c4e53274e699e0606024618868d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '430ee523-364a-5149-bac6-d0437e7b6a99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 86889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430ee523-364a-5149-bac6-d0437e7b6a99/430ee523-364a-5149-bac6-d0437e7b6a99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/291/2f988c4e53274e699e0606024618868d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW Titanium HEV AT SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW Titanium HEV AT SB',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986691%27 HTTP/1.1" 200 None
2026-03-27 13:31:49 [ayvens.es] INFO: Saving data for 1986691: {'created_time': 1774618309.619536, 'last_price_update_time': 1774618309.619548, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986691') HTTP/1.1" 204 0
2026-03-27 13:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with identifier: 1986690
2026-03-27 13:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with identifier: 1986690
2026-03-27 13:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5ba80ec6-5687-5004-9b13-c43f9e42ea5c with identifier: 1986690 to the API
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/012/093f0abfac0d47d5a78f4f5de2c721dc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ba80ec6-5687-5004-9b13-c43f9e42ea5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 84054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ba80ec6-5687-5004-9b13-c43f9e42ea5c/5ba80ec6-5687-5004-9b13-c43f9e42ea5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/012/093f0abfac0d47d5a78f4f5de2c721dc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986690%27 HTTP/1.1" 200 None
2026-03-27 13:31:49 [ayvens.es] INFO: Saving data for 1986690: {'created_time': 1774618309.923451, 'last_price_update_time': 1774618309.923461, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986690') HTTP/1.1" 204 0
2026-03-27 13:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with identifier: 1986692
2026-03-27 13:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with identifier: 1986692
2026-03-27 13:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with identifier: 1986692 to the API
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/108/4b13a3e9f05042369365ff708b5c2631/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a54d8eaf-eb50-57a5-bac4-67196a4c5bf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 129713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54d8eaf-eb50-57a5-bac4-67196a4c5bf2/a54d8eaf-eb50-57a5-bac4-67196a4c5bf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/108/4b13a3e9f05042369365ff708b5c2631/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO Ambiance dCi 75 EU6',
 'transmission': 'manual',
 'trim': 'Ambiance dCi 75 EU6',
 'vin': None,
 'year': 2018}
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986692%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [ayvens.es] INFO: Saving data for 1986692: {'created_time': 1774618310.240747, 'last_price_update_time': 1774618310.240757, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986692') HTTP/1.1" 204 0
2026-03-27 13:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/389/43e95aaabcd64da3a0e7299c480c13f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:50 [ayvens.es] INFO: Found listing with ID: 1986701
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986701%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [ayvens.es] INFO: Scrape type for 1986701: 1
2026-03-27 13:31:50 [ayvens.es] INFO: Extracting data for car ID: 1986701
2026-03-27 13:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d35df80-3256-5bd4-99b4-5a08d8f2569d with identifier: 1986701
2026-03-27 13:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d35df80-3256-5bd4-99b4-5a08d8f2569d with scrape type 1
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d35df80-3256-5bd4-99b4-5a08d8f2569d
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F3d7ededae67b4519afe1f55668a7b4aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/3d7ededae67b4519afe1f55668a7b4aa/images/large/1.jpg not downloaded yet
2026-03-27 13:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/760/dc45b82d95074a669a4838ca20f7677e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:50 [ayvens.es] INFO: Found listing with ID: 1986702
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986702%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [ayvens.es] INFO: Scrape type for 1986702: 1
2026-03-27 13:31:50 [ayvens.es] INFO: Extracting data for car ID: 1986702
2026-03-27 13:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25fd92b6-6ddd-57a8-8136-e443ce1f3581 with identifier: 1986702
2026-03-27 13:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25fd92b6-6ddd-57a8-8136-e443ce1f3581 with scrape type 1
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 25fd92b6-6ddd-57a8-8136-e443ce1f3581
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F586%252Fecd57334e5c94002b9b2c1bfd1d4ae7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/586/ecd57334e5c94002b9b2c1bfd1d4ae7d/images/large/1.jpg not downloaded yet
2026-03-27 13:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/924/c0a85e993f9b48d3bc8d6b5b4e0f4001/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/573/298970f5f12e49cdbc21111818883c33/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/665/19e6b8e068814461978a0bdbc91bd382/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:50 [ayvens.es] INFO: Found listing with ID: 1986703
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986703%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [ayvens.es] INFO: Scrape type for 1986703: 1
2026-03-27 13:31:50 [ayvens.es] INFO: Extracting data for car ID: 1986703
2026-03-27 13:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with identifier: 1986703
2026-03-27 13:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with scrape type 1
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F699%252F62291aaf2f974afd9bc0429f53c42ef2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/699/62291aaf2f974afd9bc0429f53c42ef2/images/large/1.jpg not downloaded yet
2026-03-27 13:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529631a150>
2026-03-27 13:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a350417e-46b5-5412-b8fc-289aaf9c736c/a350417e-46b5-5412-b8fc-289aaf9c736c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252F43e95aaabcd64da3a0e7299c480c13f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/43e95aaabcd64da3a0e7299c480c13f4/images/large/1.jpg saved to cache
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a350417e-46b5-5412-b8fc-289aaf9c736c
2026-03-27 13:31:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a350417e-46b5-5412-b8fc-289aaf9c736c, skipping ID generation
2026-03-27 13:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a350417e-46b5-5412-b8fc-289aaf9c736c with scrape type 1
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a350417e-46b5-5412-b8fc-289aaf9c736c sending to next pipeline
2026-03-27 13:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a350417e-46b5-5412-b8fc-289aaf9c736c, identifier: 1986694
2026-03-27 13:31:50 [ayvens.es] INFO: Found listing with ID: 1986704
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986704%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [ayvens.es] INFO: Scrape type for 1986704: 1
2026-03-27 13:31:50 [ayvens.es] INFO: Extracting data for car ID: 1986704
2026-03-27 13:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec126d4a-4230-5085-be86-e6602afd3967 with identifier: 1986704
2026-03-27 13:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec126d4a-4230-5085-be86-e6602afd3967 with scrape type 1
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec126d4a-4230-5085-be86-e6602afd3967
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F648%252Febcc7243b4c6404baf7873b388b8d510%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/648/ebcc7243b4c6404baf7873b388b8d510/images/large/1.jpg not downloaded yet
2026-03-27 13:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a350417e-46b5-5412-b8fc-289aaf9c736c with identifier: 1986694
2026-03-27 13:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a350417e-46b5-5412-b8fc-289aaf9c736c with identifier: 1986694
2026-03-27 13:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a350417e-46b5-5412-b8fc-289aaf9c736c with identifier: 1986694 to the API
2026-03-27 13:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/389/43e95aaabcd64da3a0e7299c480c13f4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a350417e-46b5-5412-b8fc-289aaf9c736c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 78284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a350417e-46b5-5412-b8fc-289aaf9c736c/a350417e-46b5-5412-b8fc-289aaf9c736c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/389/43e95aaabcd64da3a0e7299c480c13f4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986694%27 HTTP/1.1" 200 None
2026-03-27 13:31:51 [ayvens.es] INFO: Saving data for 1986694: {'created_time': 1774618311.459631, 'last_price_update_time': 1774618311.459642, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986694') HTTP/1.1" 204 0
2026-03-27 13:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295752650>
2026-03-27 13:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a26a01f7-b072-500a-80a8-6ab01f7025b2/a26a01f7-b072-500a-80a8-6ab01f7025b2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F760%252Fdc45b82d95074a669a4838ca20f7677e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/760/dc45b82d95074a669a4838ca20f7677e/images/large/1.jpg saved to cache
2026-03-27 13:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a26a01f7-b072-500a-80a8-6ab01f7025b2
2026-03-27 13:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a26a01f7-b072-500a-80a8-6ab01f7025b2, skipping ID generation
2026-03-27 13:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26a01f7-b072-500a-80a8-6ab01f7025b2 with scrape type 1
2026-03-27 13:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a26a01f7-b072-500a-80a8-6ab01f7025b2 sending to next pipeline
2026-03-27 13:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a26a01f7-b072-500a-80a8-6ab01f7025b2, identifier: 1986693
2026-03-27 13:31:51 [ayvens.es] INFO: Found listing with ID: 1986705
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986705%27 HTTP/1.1" 200 None
2026-03-27 13:31:51 [ayvens.es] INFO: Scrape type for 1986705: 1
2026-03-27 13:31:51 [ayvens.es] INFO: Extracting data for car ID: 1986705
2026-03-27 13:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with identifier: 1986705
2026-03-27 13:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with scrape type 1
2026-03-27 13:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fb193620647d4497c94070f9be7b894de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/b193620647d4497c94070f9be7b894de/images/large/1.jpg not downloaded yet
2026-03-27 13:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a26a01f7-b072-500a-80a8-6ab01f7025b2 with identifier: 1986693
2026-03-27 13:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a26a01f7-b072-500a-80a8-6ab01f7025b2 with identifier: 1986693
2026-03-27 13:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a26a01f7-b072-500a-80a8-6ab01f7025b2 with identifier: 1986693 to the API
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/760/dc45b82d95074a669a4838ca20f7677e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a26a01f7-b072-500a-80a8-6ab01f7025b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 86809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a26a01f7-b072-500a-80a8-6ab01f7025b2/a26a01f7-b072-500a-80a8-6ab01f7025b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/760/dc45b82d95074a669a4838ca20f7677e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 75KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': 'BlueHDi 75KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986693%27 HTTP/1.1" 200 None
2026-03-27 13:31:52 [ayvens.es] INFO: Saving data for 1986693: {'created_time': 1774618312.077613, 'last_price_update_time': 1774618312.077623, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986693') HTTP/1.1" 204 0
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962eccd0>
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e8131d-eccb-5269-8874-ae528d74bfd8/d6e8131d-eccb-5269-8874-ae528d74bfd8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252Fc0a85e993f9b48d3bc8d6b5b4e0f4001%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/c0a85e993f9b48d3bc8d6b5b4e0f4001/images/large/1.jpg saved to cache
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6e8131d-eccb-5269-8874-ae528d74bfd8
2026-03-27 13:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6e8131d-eccb-5269-8874-ae528d74bfd8, skipping ID generation
2026-03-27 13:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e8131d-eccb-5269-8874-ae528d74bfd8 with scrape type 1
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6e8131d-eccb-5269-8874-ae528d74bfd8 sending to next pipeline
2026-03-27 13:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6e8131d-eccb-5269-8874-ae528d74bfd8, identifier: 1986695
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962ece90>
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca97f27-712f-5a0f-b8be-6b3bddef395c/bca97f27-712f-5a0f-b8be-6b3bddef395c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F298970f5f12e49cdbc21111818883c33%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/298970f5f12e49cdbc21111818883c33/images/large/1.jpg saved to cache
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bca97f27-712f-5a0f-b8be-6b3bddef395c
2026-03-27 13:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bca97f27-712f-5a0f-b8be-6b3bddef395c, skipping ID generation
2026-03-27 13:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca97f27-712f-5a0f-b8be-6b3bddef395c with scrape type 1
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bca97f27-712f-5a0f-b8be-6b3bddef395c sending to next pipeline
2026-03-27 13:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bca97f27-712f-5a0f-b8be-6b3bddef395c, identifier: 1986697
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296067110>
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afdf6c14-8967-584b-a25d-0a1b3722109d/afdf6c14-8967-584b-a25d-0a1b3722109d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F665%252F19e6b8e068814461978a0bdbc91bd382%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/665/19e6b8e068814461978a0bdbc91bd382/images/large/1.jpg saved to cache
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afdf6c14-8967-584b-a25d-0a1b3722109d
2026-03-27 13:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afdf6c14-8967-584b-a25d-0a1b3722109d, skipping ID generation
2026-03-27 13:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afdf6c14-8967-584b-a25d-0a1b3722109d with scrape type 1
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afdf6c14-8967-584b-a25d-0a1b3722109d sending to next pipeline
2026-03-27 13:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: afdf6c14-8967-584b-a25d-0a1b3722109d, identifier: 1986696
2026-03-27 13:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/023/895eb46270824682aed51afa6ca165f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:52 [ayvens.es] INFO: Found listing with ID: 1986706
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986706%27 HTTP/1.1" 200 None
2026-03-27 13:31:52 [ayvens.es] INFO: Scrape type for 1986706: 1
2026-03-27 13:31:52 [ayvens.es] INFO: Extracting data for car ID: 1986706
2026-03-27 13:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9644e3c1-1590-5287-8d67-dbe408871dae with identifier: 1986706
2026-03-27 13:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9644e3c1-1590-5287-8d67-dbe408871dae with scrape type 1
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9644e3c1-1590-5287-8d67-dbe408871dae
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252F943420b6f98e4ddb8badaf1abf08fba8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/943420b6f98e4ddb8badaf1abf08fba8/images/large/1.jpg not downloaded yet
2026-03-27 13:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6e8131d-eccb-5269-8874-ae528d74bfd8 with identifier: 1986695
2026-03-27 13:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6e8131d-eccb-5269-8874-ae528d74bfd8 with identifier: 1986695
2026-03-27 13:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6e8131d-eccb-5269-8874-ae528d74bfd8 with identifier: 1986695 to the API
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/924/c0a85e993f9b48d3bc8d6b5b4e0f4001/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd6e8131d-eccb-5269-8874-ae528d74bfd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 242187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e8131d-eccb-5269-8874-ae528d74bfd8/d6e8131d-eccb-5269-8874-ae528d74bfd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/924/c0a85e993f9b48d3bc8d6b5b4e0f4001/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 GDi 97kW (132CV) Concept 4x2',
 'transmission': 'manual',
 'trim': '1.6 GDi 97kW (132CV) Concept 4x2',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986695%27 HTTP/1.1" 200 None
2026-03-27 13:31:52 [ayvens.es] INFO: Saving data for 1986695: {'created_time': 1774618312.949062, 'last_price_update_time': 1774618312.949072, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986695') HTTP/1.1" 204 0
2026-03-27 13:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bca97f27-712f-5a0f-b8be-6b3bddef395c with identifier: 1986697
2026-03-27 13:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bca97f27-712f-5a0f-b8be-6b3bddef395c with identifier: 1986697
2026-03-27 13:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bca97f27-712f-5a0f-b8be-6b3bddef395c with identifier: 1986697 to the API
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/573/298970f5f12e49cdbc21111818883c33/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bca97f27-712f-5a0f-b8be-6b3bddef395c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 110696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca97f27-712f-5a0f-b8be-6b3bddef395c/bca97f27-712f-5a0f-b8be-6b3bddef395c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/573/298970f5f12e49cdbc21111818883c33/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK PureTech 73 kW Manual PERFORMANCE '
          'LINE',
 'transmission': 'manual',
 'trim': 'PureTech 73 kW Manual PERFORMANCE LINE',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986697%27 HTTP/1.1" 200 None
2026-03-27 13:31:53 [ayvens.es] INFO: Saving data for 1986697: {'created_time': 1774618313.279517, 'last_price_update_time': 1774618313.279526, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986697') HTTP/1.1" 204 0
2026-03-27 13:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: afdf6c14-8967-584b-a25d-0a1b3722109d with identifier: 1986696
2026-03-27 13:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: afdf6c14-8967-584b-a25d-0a1b3722109d with identifier: 1986696
2026-03-27 13:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: afdf6c14-8967-584b-a25d-0a1b3722109d with identifier: 1986696 to the API
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/665/19e6b8e068814461978a0bdbc91bd382/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'afdf6c14-8967-584b-a25d-0a1b3722109d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 50199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afdf6c14-8967-584b-a25d-0a1b3722109d/afdf6c14-8967-584b-a25d-0a1b3722109d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/665/19e6b8e068814461978a0bdbc91bd382/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line X 2.5 Duratec FHEV Auto',
 'transmission': 'manual',
 'trim': 'ST-Line X 2.5 Duratec FHEV Auto',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986696%27 HTTP/1.1" 200 None
2026-03-27 13:31:53 [ayvens.es] INFO: Saving data for 1986696: {'created_time': 1774618313.625701, 'last_price_update_time': 1774618313.625711, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986696') HTTP/1.1" 204 0
2026-03-27 13:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/486/083e2e9f06e341f1a227c4be3cb61106/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/10feaec55d8c43d68b4f4782feaa630d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:53 [ayvens.es] INFO: Found listing with ID: 1986707
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986707%27 HTTP/1.1" 200 None
2026-03-27 13:31:53 [ayvens.es] INFO: Scrape type for 1986707: 1
2026-03-27 13:31:53 [ayvens.es] INFO: Extracting data for car ID: 1986707
2026-03-27 13:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3764d85a-cbbd-5039-80ab-82a279c54091 with identifier: 1986707
2026-03-27 13:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3764d85a-cbbd-5039-80ab-82a279c54091 with scrape type 1
2026-03-27 13:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3764d85a-cbbd-5039-80ab-82a279c54091
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F731%252Fa64e1f16e99e4dcca03661f41131feba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/731/a64e1f16e99e4dcca03661f41131feba/images/large/1.jpg not downloaded yet
2026-03-27 13:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529578d990>
2026-03-27 13:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12a7744-79a5-5406-b132-ddfe39680a41/f12a7744-79a5-5406-b132-ddfe39680a41_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F023%252F895eb46270824682aed51afa6ca165f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/023/895eb46270824682aed51afa6ca165f2/images/large/1.jpg saved to cache
2026-03-27 13:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f12a7744-79a5-5406-b132-ddfe39680a41
2026-03-27 13:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f12a7744-79a5-5406-b132-ddfe39680a41, skipping ID generation
2026-03-27 13:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12a7744-79a5-5406-b132-ddfe39680a41 with scrape type 1
2026-03-27 13:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f12a7744-79a5-5406-b132-ddfe39680a41 sending to next pipeline
2026-03-27 13:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f12a7744-79a5-5406-b132-ddfe39680a41, identifier: 1986699
2026-03-27 13:31:53 [ayvens.es] INFO: Found listing with ID: 1986708
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986708%27 HTTP/1.1" 200 None
2026-03-27 13:31:53 [ayvens.es] INFO: Scrape type for 1986708: 1
2026-03-27 13:31:53 [ayvens.es] INFO: Extracting data for car ID: 1986708
2026-03-27 13:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with identifier: 1986708
2026-03-27 13:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with scrape type 1
2026-03-27 13:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F052%252F1432bc1595134a7eb8995aa19d772130%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/052/1432bc1595134a7eb8995aa19d772130/images/large/1.jpg not downloaded yet
2026-03-27 13:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f12a7744-79a5-5406-b132-ddfe39680a41 with identifier: 1986699
2026-03-27 13:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f12a7744-79a5-5406-b132-ddfe39680a41 with identifier: 1986699
2026-03-27 13:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f12a7744-79a5-5406-b132-ddfe39680a41 with identifier: 1986699 to the API
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/023/895eb46270824682aed51afa6ca165f2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f12a7744-79a5-5406-b132-ddfe39680a41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 88858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12a7744-79a5-5406-b132-ddfe39680a41/f12a7744-79a5-5406-b132-ddfe39680a41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/023/895eb46270824682aed51afa6ca165f2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986699%27 HTTP/1.1" 200 None
2026-03-27 13:31:54 [ayvens.es] INFO: Saving data for 1986699: {'created_time': 1774618314.370325, 'last_price_update_time': 1774618314.370343, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986699') HTTP/1.1" 204 0
2026-03-27 13:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/586/ecd57334e5c94002b9b2c1bfd1d4ae7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/699/62291aaf2f974afd9bc0429f53c42ef2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/3d7ededae67b4519afe1f55668a7b4aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:54 [ayvens.es] INFO: Found listing with ID: 1986709
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986709%27 HTTP/1.1" 200 None
2026-03-27 13:31:54 [ayvens.es] INFO: Scrape type for 1986709: 1
2026-03-27 13:31:54 [ayvens.es] INFO: Extracting data for car ID: 1986709
2026-03-27 13:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with identifier: 1986709
2026-03-27 13:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with scrape type 1
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F697%252F3ee374cf16054e4fba6433b7e600e084%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/697/3ee374cf16054e4fba6433b7e600e084/images/large/1.jpg not downloaded yet
2026-03-27 13:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295704690>
2026-03-27 13:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a630ed6a-a698-50ec-996b-fde1374fa337/a630ed6a-a698-50ec-996b-fde1374fa337_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F486%252F083e2e9f06e341f1a227c4be3cb61106%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/486/083e2e9f06e341f1a227c4be3cb61106/images/large/1.jpg saved to cache
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a630ed6a-a698-50ec-996b-fde1374fa337
2026-03-27 13:31:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a630ed6a-a698-50ec-996b-fde1374fa337, skipping ID generation
2026-03-27 13:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a630ed6a-a698-50ec-996b-fde1374fa337 with scrape type 1
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a630ed6a-a698-50ec-996b-fde1374fa337 sending to next pipeline
2026-03-27 13:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a630ed6a-a698-50ec-996b-fde1374fa337, identifier: 1986698
2026-03-27 13:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f11fd0>
2026-03-27 13:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1794127-7af2-5157-9935-4d62cd87fc27/b1794127-7af2-5157-9935-4d62cd87fc27_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F10feaec55d8c43d68b4f4782feaa630d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/10feaec55d8c43d68b4f4782feaa630d/images/large/1.jpg saved to cache
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1794127-7af2-5157-9935-4d62cd87fc27
2026-03-27 13:31:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1794127-7af2-5157-9935-4d62cd87fc27, skipping ID generation
2026-03-27 13:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1794127-7af2-5157-9935-4d62cd87fc27 with scrape type 1
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1794127-7af2-5157-9935-4d62cd87fc27 sending to next pipeline
2026-03-27 13:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1794127-7af2-5157-9935-4d62cd87fc27, identifier: 1986700
2026-03-27 13:31:54 [ayvens.es] INFO: Found listing with ID: 1986710
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986710%27 HTTP/1.1" 200 None
2026-03-27 13:31:54 [ayvens.es] INFO: Scrape type for 1986710: 1
2026-03-27 13:31:54 [ayvens.es] INFO: Extracting data for car ID: 1986710
2026-03-27 13:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e355e9a-afab-5436-bc5b-186aa6b4d680 with identifier: 1986710
2026-03-27 13:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e355e9a-afab-5436-bc5b-186aa6b4d680 with scrape type 1
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7e355e9a-afab-5436-bc5b-186aa6b4d680
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252Fca946cab065842748388c066333e3175%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/ca946cab065842748388c066333e3175/images/large/1.jpg not downloaded yet
2026-03-27 13:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a630ed6a-a698-50ec-996b-fde1374fa337 with identifier: 1986698
2026-03-27 13:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a630ed6a-a698-50ec-996b-fde1374fa337 with identifier: 1986698
2026-03-27 13:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a630ed6a-a698-50ec-996b-fde1374fa337 with identifier: 1986698 to the API
2026-03-27 13:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/486/083e2e9f06e341f1a227c4be3cb61106/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a630ed6a-a698-50ec-996b-fde1374fa337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 42040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a630ed6a-a698-50ec-996b-fde1374fa337/a630ed6a-a698-50ec-996b-fde1374fa337_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/486/083e2e9f06e341f1a227c4be3cb61106/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '2.0 180H Advance',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986698%27 HTTP/1.1" 200 None
2026-03-27 13:31:55 [ayvens.es] INFO: Saving data for 1986698: {'created_time': 1774618315.148123, 'last_price_update_time': 1774618315.148134, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986698') HTTP/1.1" 204 0
2026-03-27 13:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1794127-7af2-5157-9935-4d62cd87fc27 with identifier: 1986700
2026-03-27 13:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1794127-7af2-5157-9935-4d62cd87fc27 with identifier: 1986700
2026-03-27 13:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1794127-7af2-5157-9935-4d62cd87fc27 with identifier: 1986700 to the API
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/10feaec55d8c43d68b4f4782feaa630d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b1794127-7af2-5157-9935-4d62cd87fc27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 152124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1794127-7af2-5157-9935-4d62cd87fc27/b1794127-7af2-5157-9935-4d62cd87fc27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/10feaec55d8c43d68b4f4782feaa630d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.0 TSI 81KW (110 CV) Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW (110 CV) Ambition',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986700%27 HTTP/1.1" 200 None
2026-03-27 13:31:55 [ayvens.es] INFO: Saving data for 1986700: {'created_time': 1774618315.470683, 'last_price_update_time': 1774618315.470692, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986700') HTTP/1.1" 204 0
2026-03-27 13:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/150/b193620647d4497c94070f9be7b894de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/648/ebcc7243b4c6404baf7873b388b8d510/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:55 [ayvens.es] INFO: Found listing with ID: 1986711
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986711%27 HTTP/1.1" 200 None
2026-03-27 13:31:55 [ayvens.es] INFO: Scrape type for 1986711: 1
2026-03-27 13:31:55 [ayvens.es] INFO: Extracting data for car ID: 1986711
2026-03-27 13:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8fedea7-c38b-5045-b1fc-2d9301e19ec5 with identifier: 1986711
2026-03-27 13:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fedea7-c38b-5045-b1fc-2d9301e19ec5 with scrape type 1
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8fedea7-c38b-5045-b1fc-2d9301e19ec5
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F058%252F07de7d177d9a4dac8f600d01a3e58364%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/058/07de7d177d9a4dac8f600d01a3e58364/images/large/1.jpg not downloaded yet
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f5f590>
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25fd92b6-6ddd-57a8-8136-e443ce1f3581/25fd92b6-6ddd-57a8-8136-e443ce1f3581_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F586%252Fecd57334e5c94002b9b2c1bfd1d4ae7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/586/ecd57334e5c94002b9b2c1bfd1d4ae7d/images/large/1.jpg saved to cache
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25fd92b6-6ddd-57a8-8136-e443ce1f3581
2026-03-27 13:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25fd92b6-6ddd-57a8-8136-e443ce1f3581, skipping ID generation
2026-03-27 13:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25fd92b6-6ddd-57a8-8136-e443ce1f3581 with scrape type 1
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25fd92b6-6ddd-57a8-8136-e443ce1f3581 sending to next pipeline
2026-03-27 13:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 25fd92b6-6ddd-57a8-8136-e443ce1f3581, identifier: 1986702
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957ac410>
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4/f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F699%252F62291aaf2f974afd9bc0429f53c42ef2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/699/62291aaf2f974afd9bc0429f53c42ef2/images/large/1.jpg saved to cache
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4
2026-03-27 13:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4, skipping ID generation
2026-03-27 13:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with scrape type 1
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 sending to next pipeline
2026-03-27 13:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4, identifier: 1986703
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295be4c90>
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d35df80-3256-5bd4-99b4-5a08d8f2569d/7d35df80-3256-5bd4-99b4-5a08d8f2569d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F3d7ededae67b4519afe1f55668a7b4aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/3d7ededae67b4519afe1f55668a7b4aa/images/large/1.jpg saved to cache
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d35df80-3256-5bd4-99b4-5a08d8f2569d
2026-03-27 13:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d35df80-3256-5bd4-99b4-5a08d8f2569d, skipping ID generation
2026-03-27 13:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d35df80-3256-5bd4-99b4-5a08d8f2569d with scrape type 1
2026-03-27 13:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d35df80-3256-5bd4-99b4-5a08d8f2569d sending to next pipeline
2026-03-27 13:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7d35df80-3256-5bd4-99b4-5a08d8f2569d, identifier: 1986701
2026-03-27 13:31:56 [ayvens.es] INFO: Found listing with ID: 1986712
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986712%27 HTTP/1.1" 200 None
2026-03-27 13:31:56 [ayvens.es] INFO: Scrape type for 1986712: 1
2026-03-27 13:31:56 [ayvens.es] INFO: Extracting data for car ID: 1986712
2026-03-27 13:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6788bec7-9f39-5e08-bbd8-ce53575c5383 with identifier: 1986712
2026-03-27 13:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6788bec7-9f39-5e08-bbd8-ce53575c5383 with scrape type 1
2026-03-27 13:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6788bec7-9f39-5e08-bbd8-ce53575c5383
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F4077efbd7cb342f9a94e0c7dc3da6a63%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/4077efbd7cb342f9a94e0c7dc3da6a63/images/large/1.jpg not downloaded yet
2026-03-27 13:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 25fd92b6-6ddd-57a8-8136-e443ce1f3581 with identifier: 1986702
2026-03-27 13:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 25fd92b6-6ddd-57a8-8136-e443ce1f3581 with identifier: 1986702
2026-03-27 13:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 25fd92b6-6ddd-57a8-8136-e443ce1f3581 with identifier: 1986702 to the API
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/586/ecd57334e5c94002b9b2c1bfd1d4ae7d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '25fd92b6-6ddd-57a8-8136-e443ce1f3581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 204747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25fd92b6-6ddd-57a8-8136-e443ce1f3581/25fd92b6-6ddd-57a8-8136-e443ce1f3581_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/586/ecd57334e5c94002b9b2c1bfd1d4ae7d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986702%27 HTTP/1.1" 200 None
2026-03-27 13:31:56 [ayvens.es] INFO: Saving data for 1986702: {'created_time': 1774618316.470202, 'last_price_update_time': 1774618316.470212, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986702') HTTP/1.1" 204 0
2026-03-27 13:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with identifier: 1986703
2026-03-27 13:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with identifier: 1986703
2026-03-27 13:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with identifier: 1986703 to the API
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/699/62291aaf2f974afd9bc0429f53c42ef2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 128369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4/f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/699/62291aaf2f974afd9bc0429f53c42ef2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986703%27 HTTP/1.1" 200 None
2026-03-27 13:31:56 [ayvens.es] INFO: Saving data for 1986703: {'created_time': 1774618316.829063, 'last_price_update_time': 1774618316.829076, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986703') HTTP/1.1" 204 0
2026-03-27 13:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7d35df80-3256-5bd4-99b4-5a08d8f2569d with identifier: 1986701
2026-03-27 13:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7d35df80-3256-5bd4-99b4-5a08d8f2569d with identifier: 1986701
2026-03-27 13:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7d35df80-3256-5bd4-99b4-5a08d8f2569d with identifier: 1986701 to the API
2026-03-27 13:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/3d7ededae67b4519afe1f55668a7b4aa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7d35df80-3256-5bd4-99b4-5a08d8f2569d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 47309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d35df80-3256-5bd4-99b4-5a08d8f2569d/7d35df80-3256-5bd4-99b4-5a08d8f2569d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/3d7ededae67b4519afe1f55668a7b4aa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986701%27 HTTP/1.1" 200 None
2026-03-27 13:31:57 [ayvens.es] INFO: Saving data for 1986701: {'created_time': 1774618317.140699, 'last_price_update_time': 1774618317.140711, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986701') HTTP/1.1" 204 0
2026-03-27 13:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/731/a64e1f16e99e4dcca03661f41131feba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/887/943420b6f98e4ddb8badaf1abf08fba8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:57 [ayvens.es] INFO: Found listing with ID: 1986713
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986713%27 HTTP/1.1" 200 None
2026-03-27 13:31:57 [ayvens.es] INFO: Scrape type for 1986713: 1
2026-03-27 13:31:57 [ayvens.es] INFO: Extracting data for car ID: 1986713
2026-03-27 13:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d6dad1-92cd-588c-9303-058cd344242d with identifier: 1986713
2026-03-27 13:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d6dad1-92cd-588c-9303-058cd344242d with scrape type 1
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13d6dad1-92cd-588c-9303-058cd344242d
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F9d4e09a0f0c7405a9cbb3eb0753e0885%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/9d4e09a0f0c7405a9cbb3eb0753e0885/images/large/1.jpg not downloaded yet
2026-03-27 13:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c31e50>
2026-03-27 13:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c930ce85-2b97-5987-a6a5-a3bdf9fc08f1/c930ce85-2b97-5987-a6a5-a3bdf9fc08f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fb193620647d4497c94070f9be7b894de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/b193620647d4497c94070f9be7b894de/images/large/1.jpg saved to cache
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1
2026-03-27 13:31:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1, skipping ID generation
2026-03-27 13:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with scrape type 1
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 sending to next pipeline
2026-03-27 13:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1, identifier: 1986705
2026-03-27 13:31:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c2c90>
2026-03-27 13:31:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec126d4a-4230-5085-be86-e6602afd3967/ec126d4a-4230-5085-be86-e6602afd3967_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F648%252Febcc7243b4c6404baf7873b388b8d510%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/648/ebcc7243b4c6404baf7873b388b8d510/images/large/1.jpg saved to cache
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec126d4a-4230-5085-be86-e6602afd3967
2026-03-27 13:31:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec126d4a-4230-5085-be86-e6602afd3967, skipping ID generation
2026-03-27 13:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec126d4a-4230-5085-be86-e6602afd3967 with scrape type 1
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec126d4a-4230-5085-be86-e6602afd3967 sending to next pipeline
2026-03-27 13:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ec126d4a-4230-5085-be86-e6602afd3967, identifier: 1986704
2026-03-27 13:31:57 [ayvens.es] INFO: Found listing with ID: 1986714
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986714%27 HTTP/1.1" 200 None
2026-03-27 13:31:57 [ayvens.es] INFO: Scrape type for 1986714: 1
2026-03-27 13:31:57 [ayvens.es] INFO: Extracting data for car ID: 1986714
2026-03-27 13:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with identifier: 1986714
2026-03-27 13:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with scrape type 1
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F263%252Fee2e2620d6e547e4a6ef05bd7c28c908%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/263/ee2e2620d6e547e4a6ef05bd7c28c908/images/large/1.jpg not downloaded yet
2026-03-27 13:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with identifier: 1986705
2026-03-27 13:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with identifier: 1986705
2026-03-27 13:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with identifier: 1986705 to the API
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/150/b193620647d4497c94070f9be7b894de/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c930ce85-2b97-5987-a6a5-a3bdf9fc08f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE',
 'odometer': 131317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c930ce85-2b97-5987-a6a5-a3bdf9fc08f1/c930ce85-2b97-5987-a6a5-a3bdf9fc08f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/150/b193620647d4497c94070f9be7b894de/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE 2.0D 120CV BUSINESS 1PL 2PT L2',
 'transmission': 'manual',
 'trim': '2.0D 120CV BUSINESS 1PL 2PT L2',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986705%27 HTTP/1.1" 200 None
2026-03-27 13:31:58 [ayvens.es] INFO: Saving data for 1986705: {'created_time': 1774618318.036064, 'last_price_update_time': 1774618318.036077, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986705') HTTP/1.1" 204 0
2026-03-27 13:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ec126d4a-4230-5085-be86-e6602afd3967 with identifier: 1986704
2026-03-27 13:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ec126d4a-4230-5085-be86-e6602afd3967 with identifier: 1986704
2026-03-27 13:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ec126d4a-4230-5085-be86-e6602afd3967 with identifier: 1986704 to the API
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/648/ebcc7243b4c6404baf7873b388b8d510/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ec126d4a-4230-5085-be86-e6602afd3967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 177263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec126d4a-4230-5085-be86-e6602afd3967/ec126d4a-4230-5085-be86-e6602afd3967_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/648/ebcc7243b4c6404baf7873b388b8d510/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986704%27 HTTP/1.1" 200 None
2026-03-27 13:31:58 [ayvens.es] INFO: Saving data for 1986704: {'created_time': 1774618318.378547, 'last_price_update_time': 1774618318.37856, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986704') HTTP/1.1" 204 0
2026-03-27 13:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/052/1432bc1595134a7eb8995aa19d772130/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/697/3ee374cf16054e4fba6433b7e600e084/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:58 [ayvens.es] INFO: Found listing with ID: 1986715
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986715%27 HTTP/1.1" 200 None
2026-03-27 13:31:58 [ayvens.es] INFO: Scrape type for 1986715: 1
2026-03-27 13:31:58 [ayvens.es] INFO: Extracting data for car ID: 1986715
2026-03-27 13:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with identifier: 1986715
2026-03-27 13:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with scrape type 1
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252F00789a58a89240d4aa1ad654906b5a25%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/00789a58a89240d4aa1ad654906b5a25/images/large/1.jpg not downloaded yet
2026-03-27 13:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295704890>
2026-03-27 13:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3764d85a-cbbd-5039-80ab-82a279c54091/3764d85a-cbbd-5039-80ab-82a279c54091_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F731%252Fa64e1f16e99e4dcca03661f41131feba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/731/a64e1f16e99e4dcca03661f41131feba/images/large/1.jpg saved to cache
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3764d85a-cbbd-5039-80ab-82a279c54091
2026-03-27 13:31:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3764d85a-cbbd-5039-80ab-82a279c54091, skipping ID generation
2026-03-27 13:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3764d85a-cbbd-5039-80ab-82a279c54091 with scrape type 1
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3764d85a-cbbd-5039-80ab-82a279c54091 sending to next pipeline
2026-03-27 13:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3764d85a-cbbd-5039-80ab-82a279c54091, identifier: 1986707
2026-03-27 13:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c32010>
2026-03-27 13:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9644e3c1-1590-5287-8d67-dbe408871dae/9644e3c1-1590-5287-8d67-dbe408871dae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252F943420b6f98e4ddb8badaf1abf08fba8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/943420b6f98e4ddb8badaf1abf08fba8/images/large/1.jpg saved to cache
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9644e3c1-1590-5287-8d67-dbe408871dae
2026-03-27 13:31:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9644e3c1-1590-5287-8d67-dbe408871dae, skipping ID generation
2026-03-27 13:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9644e3c1-1590-5287-8d67-dbe408871dae with scrape type 1
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9644e3c1-1590-5287-8d67-dbe408871dae sending to next pipeline
2026-03-27 13:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9644e3c1-1590-5287-8d67-dbe408871dae, identifier: 1986706
2026-03-27 13:31:58 [ayvens.es] INFO: Found listing with ID: 1986716
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986716%27 HTTP/1.1" 200 None
2026-03-27 13:31:58 [ayvens.es] INFO: Scrape type for 1986716: 1
2026-03-27 13:31:58 [ayvens.es] INFO: Extracting data for car ID: 1986716
2026-03-27 13:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with identifier: 1986716
2026-03-27 13:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with scrape type 1
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F361%252F6825472dd22542fe86ea93e25e08b5b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/361/6825472dd22542fe86ea93e25e08b5b1/images/large/1.jpg not downloaded yet
2026-03-27 13:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3764d85a-cbbd-5039-80ab-82a279c54091 with identifier: 1986707
2026-03-27 13:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3764d85a-cbbd-5039-80ab-82a279c54091 with identifier: 1986707
2026-03-27 13:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3764d85a-cbbd-5039-80ab-82a279c54091 with identifier: 1986707 to the API
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/731/a64e1f16e99e4dcca03661f41131feba/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3764d85a-cbbd-5039-80ab-82a279c54091',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 89179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3764d85a-cbbd-5039-80ab-82a279c54091/3764d85a-cbbd-5039-80ab-82a279c54091_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/731/a64e1f16e99e4dcca03661f41131feba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Cargo 2.0 TDI 90kW (122CV) 4MOTION',
 'transmission': 'manual',
 'trim': 'Cargo 2.0 TDI 90kW (122CV) 4MOTION',
 'vin': None,
 'year': 2022}
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986707%27 HTTP/1.1" 200 None
2026-03-27 13:31:59 [ayvens.es] INFO: Saving data for 1986707: {'created_time': 1774618319.57828, 'last_price_update_time': 1774618319.578292, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986707') HTTP/1.1" 204 0
2026-03-27 13:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9644e3c1-1590-5287-8d67-dbe408871dae with identifier: 1986706
2026-03-27 13:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9644e3c1-1590-5287-8d67-dbe408871dae with identifier: 1986706
2026-03-27 13:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9644e3c1-1590-5287-8d67-dbe408871dae with identifier: 1986706 to the API
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/887/943420b6f98e4ddb8badaf1abf08fba8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9644e3c1-1590-5287-8d67-dbe408871dae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 136507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9644e3c1-1590-5287-8d67-dbe408871dae/9644e3c1-1590-5287-8d67-dbe408871dae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/887/943420b6f98e4ddb8badaf1abf08fba8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2020}
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986706%27 HTTP/1.1" 200 None
2026-03-27 13:31:59 [ayvens.es] INFO: Saving data for 1986706: {'created_time': 1774618319.973655, 'last_price_update_time': 1774618319.973666, 'auction_closing_time': 1774868400.0}
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986706') HTTP/1.1" 204 0
2026-03-27 13:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/058/07de7d177d9a4dac8f600d01a3e58364/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:31:59 [ayvens.es] INFO: Found listing with ID: 1986717
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986717%27 HTTP/1.1" 200 None
2026-03-27 13:32:00 [ayvens.es] INFO: Scrape type for 1986717: 1
2026-03-27 13:32:00 [ayvens.es] INFO: Extracting data for car ID: 1986717
2026-03-27 13:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e462e9-ac7c-579d-9af0-31bdd352d810 with identifier: 1986717
2026-03-27 13:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e462e9-ac7c-579d-9af0-31bdd352d810 with scrape type 1
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 55e462e9-ac7c-579d-9af0-31bdd352d810
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F9b78fd1113784a1db3787cc11ff24602%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/9b78fd1113784a1db3787cc11ff24602/images/large/1.jpg not downloaded yet
2026-03-27 13:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960e7c90>
2026-03-27 13:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_121f2e30-8059-5aac-a0e7-a20fcbeaf690/121f2e30-8059-5aac-a0e7-a20fcbeaf690_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F052%252F1432bc1595134a7eb8995aa19d772130%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/052/1432bc1595134a7eb8995aa19d772130/images/large/1.jpg saved to cache
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690
2026-03-27 13:32:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 121f2e30-8059-5aac-a0e7-a20fcbeaf690, skipping ID generation
2026-03-27 13:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with scrape type 1
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 121f2e30-8059-5aac-a0e7-a20fcbeaf690 sending to next pipeline
2026-03-27 13:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 121f2e30-8059-5aac-a0e7-a20fcbeaf690, identifier: 1986708
2026-03-27 13:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960e7cd0>
2026-03-27 13:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d3e3a36-481b-5ef4-afe1-22fadba3f54f/8d3e3a36-481b-5ef4-afe1-22fadba3f54f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F697%252F3ee374cf16054e4fba6433b7e600e084%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/697/3ee374cf16054e4fba6433b7e600e084/images/large/1.jpg saved to cache
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f
2026-03-27 13:32:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f, skipping ID generation
2026-03-27 13:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with scrape type 1
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f sending to next pipeline
2026-03-27 13:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f, identifier: 1986709
2026-03-27 13:32:00 [ayvens.es] INFO: Found listing with ID: 1986718
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986718%27 HTTP/1.1" 200 None
2026-03-27 13:32:00 [ayvens.es] INFO: Scrape type for 1986718: 1
2026-03-27 13:32:00 [ayvens.es] INFO: Extracting data for car ID: 1986718
2026-03-27 13:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee31360e-9acd-5c2c-875f-126934f2db22 with identifier: 1986718
2026-03-27 13:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee31360e-9acd-5c2c-875f-126934f2db22 with scrape type 1
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee31360e-9acd-5c2c-875f-126934f2db22
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F369%252Ff15b04bcaf8b44d89960b7f25953a992%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/369/f15b04bcaf8b44d89960b7f25953a992/images/large/1.jpg not downloaded yet
2026-03-27 13:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with identifier: 1986708
2026-03-27 13:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with identifier: 1986708
2026-03-27 13:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 121f2e30-8059-5aac-a0e7-a20fcbeaf690 with identifier: 1986708 to the API
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/052/1432bc1595134a7eb8995aa19d772130/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '121f2e30-8059-5aac-a0e7-a20fcbeaf690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'YETI',
 'odometer': 233816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_121f2e30-8059-5aac-a0e7-a20fcbeaf690/121f2e30-8059-5aac-a0e7-a20fcbeaf690_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/052/1432bc1595134a7eb8995aa19d772130/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA YETI 2.0 TDI 110cv 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110cv 4x4 Ambition',
 'vin': None,
 'year': 2013}
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986708%27 HTTP/1.1" 200 None
2026-03-27 13:32:00 [ayvens.es] INFO: Saving data for 1986708: {'created_time': 1774618320.980121, 'last_price_update_time': 1774618320.980137, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986708') HTTP/1.1" 204 0
2026-03-27 13:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with identifier: 1986709
2026-03-27 13:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with identifier: 1986709
2026-03-27 13:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with identifier: 1986709 to the API
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/697/3ee374cf16054e4fba6433b7e600e084/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d3e3a36-481b-5ef4-afe1-22fadba3f54f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 72708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d3e3a36-481b-5ef4-afe1-22fadba3f54f/8d3e3a36-481b-5ef4-afe1-22fadba3f54f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/697/3ee374cf16054e4fba6433b7e600e084/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Cargo 2.0 TDI 90kW (122CV) 4MOTION',
 'transmission': 'manual',
 'trim': 'Cargo 2.0 TDI 90kW (122CV) 4MOTION',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986709%27 HTTP/1.1" 200 None
2026-03-27 13:32:01 [ayvens.es] INFO: Saving data for 1986709: {'created_time': 1774618321.307443, 'last_price_update_time': 1774618321.307454, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986709') HTTP/1.1" 204 0
2026-03-27 13:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/757/4077efbd7cb342f9a94e0c7dc3da6a63/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/249/ca946cab065842748388c066333e3175/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/511/9d4e09a0f0c7405a9cbb3eb0753e0885/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:01 [ayvens.es] INFO: Found listing with ID: 1986719
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986719%27 HTTP/1.1" 200 None
2026-03-27 13:32:01 [ayvens.es] INFO: Scrape type for 1986719: 1
2026-03-27 13:32:01 [ayvens.es] INFO: Extracting data for car ID: 1986719
2026-03-27 13:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59c33bb-1ddd-5e49-a7b8-dc050954c44d with identifier: 1986719
2026-03-27 13:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d with scrape type 1
2026-03-27 13:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F152%252F9a311c394c944ac4b5f5dcadc73a1eee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/152/9a311c394c944ac4b5f5dcadc73a1eee/images/large/1.jpg not downloaded yet
2026-03-27 13:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529600b810>
2026-03-27 13:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8fedea7-c38b-5045-b1fc-2d9301e19ec5/f8fedea7-c38b-5045-b1fc-2d9301e19ec5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F058%252F07de7d177d9a4dac8f600d01a3e58364%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/058/07de7d177d9a4dac8f600d01a3e58364/images/large/1.jpg saved to cache
2026-03-27 13:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8fedea7-c38b-5045-b1fc-2d9301e19ec5
2026-03-27 13:32:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8fedea7-c38b-5045-b1fc-2d9301e19ec5, skipping ID generation
2026-03-27 13:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8fedea7-c38b-5045-b1fc-2d9301e19ec5 with scrape type 1
2026-03-27 13:32:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8fedea7-c38b-5045-b1fc-2d9301e19ec5 sending to next pipeline
2026-03-27 13:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f8fedea7-c38b-5045-b1fc-2d9301e19ec5, identifier: 1986711
2026-03-27 13:32:01 [ayvens.es] INFO: Found listing with ID: 1986720
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986720%27 HTTP/1.1" 200 None
2026-03-27 13:32:01 [ayvens.es] INFO: Scrape type for 1986720: 1
2026-03-27 13:32:01 [ayvens.es] INFO: Extracting data for car ID: 1986720
2026-03-27 13:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with identifier: 1986720
2026-03-27 13:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with scrape type 1
2026-03-27 13:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F939%252Fa881df7502a6440c835ecfaf1a9d6f79%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/939/a881df7502a6440c835ecfaf1a9d6f79/images/large/1.jpg not downloaded yet
2026-03-27 13:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f8fedea7-c38b-5045-b1fc-2d9301e19ec5 with identifier: 1986711
2026-03-27 13:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f8fedea7-c38b-5045-b1fc-2d9301e19ec5 with identifier: 1986711
2026-03-27 13:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f8fedea7-c38b-5045-b1fc-2d9301e19ec5 with identifier: 1986711 to the API
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/058/07de7d177d9a4dac8f600d01a3e58364/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f8fedea7-c38b-5045-b1fc-2d9301e19ec5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 159940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8fedea7-c38b-5045-b1fc-2d9301e19ec5/f8fedea7-c38b-5045-b1fc-2d9301e19ec5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/058/07de7d177d9a4dac8f600d01a3e58364/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986711%27 HTTP/1.1" 200 None
2026-03-27 13:32:01 [ayvens.es] INFO: Saving data for 1986711: {'created_time': 1774618321.942448, 'last_price_update_time': 1774618321.94246, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986711') HTTP/1.1" 204 0
2026-03-27 13:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/384/00789a58a89240d4aa1ad654906b5a25/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:01 [ayvens.es] INFO: Found listing with ID: 1986721
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986721%27 HTTP/1.1" 200 None
2026-03-27 13:32:01 [ayvens.es] INFO: Scrape type for 1986721: 1
2026-03-27 13:32:01 [ayvens.es] INFO: Extracting data for car ID: 1986721
2026-03-27 13:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1978cc0-6fb2-54e5-b945-a5db91159c0e with identifier: 1986721
2026-03-27 13:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1978cc0-6fb2-54e5-b945-a5db91159c0e with scrape type 1
2026-03-27 13:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c1978cc0-6fb2-54e5-b945-a5db91159c0e
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252F2e2ccdb1744d4240b2225619ca6b05cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/2e2ccdb1744d4240b2225619ca6b05cf/images/large/1.jpg not downloaded yet
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960f4650>
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6788bec7-9f39-5e08-bbd8-ce53575c5383/6788bec7-9f39-5e08-bbd8-ce53575c5383_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F4077efbd7cb342f9a94e0c7dc3da6a63%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/4077efbd7cb342f9a94e0c7dc3da6a63/images/large/1.jpg saved to cache
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6788bec7-9f39-5e08-bbd8-ce53575c5383
2026-03-27 13:32:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6788bec7-9f39-5e08-bbd8-ce53575c5383, skipping ID generation
2026-03-27 13:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6788bec7-9f39-5e08-bbd8-ce53575c5383 with scrape type 1
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6788bec7-9f39-5e08-bbd8-ce53575c5383 sending to next pipeline
2026-03-27 13:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6788bec7-9f39-5e08-bbd8-ce53575c5383, identifier: 1986712
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295752490>
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e355e9a-afab-5436-bc5b-186aa6b4d680/7e355e9a-afab-5436-bc5b-186aa6b4d680_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F249%252Fca946cab065842748388c066333e3175%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/249/ca946cab065842748388c066333e3175/images/large/1.jpg saved to cache
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e355e9a-afab-5436-bc5b-186aa6b4d680
2026-03-27 13:32:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e355e9a-afab-5436-bc5b-186aa6b4d680, skipping ID generation
2026-03-27 13:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e355e9a-afab-5436-bc5b-186aa6b4d680 with scrape type 1
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e355e9a-afab-5436-bc5b-186aa6b4d680 sending to next pipeline
2026-03-27 13:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7e355e9a-afab-5436-bc5b-186aa6b4d680, identifier: 1986710
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962020d0>
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13d6dad1-92cd-588c-9303-058cd344242d/13d6dad1-92cd-588c-9303-058cd344242d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F9d4e09a0f0c7405a9cbb3eb0753e0885%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/9d4e09a0f0c7405a9cbb3eb0753e0885/images/large/1.jpg saved to cache
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13d6dad1-92cd-588c-9303-058cd344242d
2026-03-27 13:32:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13d6dad1-92cd-588c-9303-058cd344242d, skipping ID generation
2026-03-27 13:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d6dad1-92cd-588c-9303-058cd344242d with scrape type 1
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13d6dad1-92cd-588c-9303-058cd344242d sending to next pipeline
2026-03-27 13:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13d6dad1-92cd-588c-9303-058cd344242d, identifier: 1986713
2026-03-27 13:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/263/ee2e2620d6e547e4a6ef05bd7c28c908/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:02 [ayvens.es] INFO: Found listing with ID: 1986722
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986722%27 HTTP/1.1" 200 None
2026-03-27 13:32:02 [ayvens.es] INFO: Scrape type for 1986722: 1
2026-03-27 13:32:02 [ayvens.es] INFO: Extracting data for car ID: 1986722
2026-03-27 13:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7616fe7-e11c-55c7-981d-519231b19342 with identifier: 1986722
2026-03-27 13:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7616fe7-e11c-55c7-981d-519231b19342 with scrape type 1
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f7616fe7-e11c-55c7-981d-519231b19342
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F201%252Fa1f80f8a3fda49e7b7cc48dcf2514d3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/201/a1f80f8a3fda49e7b7cc48dcf2514d3d/images/large/1.jpg not downloaded yet
2026-03-27 13:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6788bec7-9f39-5e08-bbd8-ce53575c5383 with identifier: 1986712
2026-03-27 13:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6788bec7-9f39-5e08-bbd8-ce53575c5383 with identifier: 1986712
2026-03-27 13:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6788bec7-9f39-5e08-bbd8-ce53575c5383 with identifier: 1986712 to the API
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/757/4077efbd7cb342f9a94e0c7dc3da6a63/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6788bec7-9f39-5e08-bbd8-ce53575c5383',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 211016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6788bec7-9f39-5e08-bbd8-ce53575c5383/6788bec7-9f39-5e08-bbd8-ce53575c5383_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/757/4077efbd7cb342f9a94e0c7dc3da6a63/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986712%27 HTTP/1.1" 200 None
2026-03-27 13:32:02 [ayvens.es] INFO: Saving data for 1986712: {'created_time': 1774618322.883012, 'last_price_update_time': 1774618322.883024, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986712') HTTP/1.1" 204 0
2026-03-27 13:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7e355e9a-afab-5436-bc5b-186aa6b4d680 with identifier: 1986710
2026-03-27 13:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7e355e9a-afab-5436-bc5b-186aa6b4d680 with identifier: 1986710
2026-03-27 13:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7e355e9a-afab-5436-bc5b-186aa6b4d680 with identifier: 1986710 to the API
2026-03-27 13:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/249/ca946cab065842748388c066333e3175/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7e355e9a-afab-5436-bc5b-186aa6b4d680',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 92735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e355e9a-afab-5436-bc5b-186aa6b4d680/7e355e9a-afab-5436-bc5b-186aa6b4d680_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/249/ca946cab065842748388c066333e3175/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV) DSG Variant',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV) DSG Variant',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986710%27 HTTP/1.1" 200 None
2026-03-27 13:32:03 [ayvens.es] INFO: Saving data for 1986710: {'created_time': 1774618323.218711, 'last_price_update_time': 1774618323.218722, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986710') HTTP/1.1" 204 0
2026-03-27 13:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13d6dad1-92cd-588c-9303-058cd344242d with identifier: 1986713
2026-03-27 13:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13d6dad1-92cd-588c-9303-058cd344242d with identifier: 1986713
2026-03-27 13:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13d6dad1-92cd-588c-9303-058cd344242d with identifier: 1986713 to the API
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/511/9d4e09a0f0c7405a9cbb3eb0753e0885/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '13d6dad1-92cd-588c-9303-058cd344242d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 198003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13d6dad1-92cd-588c-9303-058cd344242d/13d6dad1-92cd-588c-9303-058cd344242d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/511/9d4e09a0f0c7405a9cbb3eb0753e0885/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA 1.5 TSI 110kW (150 CV) Manual Style',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW (150 CV) Manual Style',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986713%27 HTTP/1.1" 200 None
2026-03-27 13:32:03 [ayvens.es] INFO: Saving data for 1986713: {'created_time': 1774618323.536719, 'last_price_update_time': 1774618323.53673, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986713') HTTP/1.1" 204 0
2026-03-27 13:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/361/6825472dd22542fe86ea93e25e08b5b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/729/9b78fd1113784a1db3787cc11ff24602/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:03 [ayvens.es] INFO: Found listing with ID: 1986723
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986723%27 HTTP/1.1" 200 None
2026-03-27 13:32:03 [ayvens.es] INFO: Scrape type for 1986723: 1
2026-03-27 13:32:03 [ayvens.es] INFO: Extracting data for car ID: 1986723
2026-03-27 13:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2452118-a699-595a-a9c9-afbf9c6e6419 with identifier: 1986723
2026-03-27 13:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2452118-a699-595a-a9c9-afbf9c6e6419 with scrape type 1
2026-03-27 13:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d2452118-a699-595a-a9c9-afbf9c6e6419
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252Fcafe21fc040847eb9941ec8cc946e380%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/cafe21fc040847eb9941ec8cc946e380/images/large/1.jpg not downloaded yet
2026-03-27 13:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f106d0>
2026-03-27 13:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f7b66b-6394-5e3e-9d58-0a2cbe3366bf/89f7b66b-6394-5e3e-9d58-0a2cbe3366bf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252F00789a58a89240d4aa1ad654906b5a25%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/00789a58a89240d4aa1ad654906b5a25/images/large/1.jpg saved to cache
2026-03-27 13:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf
2026-03-27 13:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf, skipping ID generation
2026-03-27 13:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with scrape type 1
2026-03-27 13:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf sending to next pipeline
2026-03-27 13:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf, identifier: 1986715
2026-03-27 13:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957a5210>
2026-03-27 13:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8/8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F263%252Fee2e2620d6e547e4a6ef05bd7c28c908%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/263/ee2e2620d6e547e4a6ef05bd7c28c908/images/large/1.jpg saved to cache
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8
2026-03-27 13:32:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8, skipping ID generation
2026-03-27 13:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with scrape type 1
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 sending to next pipeline
2026-03-27 13:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8, identifier: 1986714
2026-03-27 13:32:04 [ayvens.es] INFO: Found listing with ID: 1986724
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986724%27 HTTP/1.1" 200 None
2026-03-27 13:32:04 [ayvens.es] INFO: Scrape type for 1986724: 1
2026-03-27 13:32:04 [ayvens.es] INFO: Extracting data for car ID: 1986724
2026-03-27 13:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with identifier: 1986724
2026-03-27 13:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with scrape type 1
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fc348545ba3f948e4ac19b53348a9c158%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/c348545ba3f948e4ac19b53348a9c158/images/large/1.jpg not downloaded yet
2026-03-27 13:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with identifier: 1986715
2026-03-27 13:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with identifier: 1986715
2026-03-27 13:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with identifier: 1986715 to the API
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/384/00789a58a89240d4aa1ad654906b5a25/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '89f7b66b-6394-5e3e-9d58-0a2cbe3366bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 169301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f7b66b-6394-5e3e-9d58-0a2cbe3366bf/89f7b66b-6394-5e3e-9d58-0a2cbe3366bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/384/00789a58a89240d4aa1ad654906b5a25/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986715%27 HTTP/1.1" 200 None
2026-03-27 13:32:04 [ayvens.es] INFO: Saving data for 1986715: {'created_time': 1774618324.502877, 'last_price_update_time': 1774618324.502888, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986715') HTTP/1.1" 204 0
2026-03-27 13:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with identifier: 1986714
2026-03-27 13:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with identifier: 1986714
2026-03-27 13:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with identifier: 1986714 to the API
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/263/ee2e2620d6e547e4a6ef05bd7c28c908/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 100168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8/8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/263/ee2e2620d6e547e4a6ef05bd7c28c908/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986714%27 HTTP/1.1" 200 None
2026-03-27 13:32:04 [ayvens.es] INFO: Saving data for 1986714: {'created_time': 1774618324.876805, 'last_price_update_time': 1774618324.876816, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986714') HTTP/1.1" 204 0
2026-03-27 13:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/369/f15b04bcaf8b44d89960b7f25953a992/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:04 [ayvens.es] INFO: Found listing with ID: 1986725
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986725%27 HTTP/1.1" 200 None
2026-03-27 13:32:04 [ayvens.es] INFO: Scrape type for 1986725: 1
2026-03-27 13:32:04 [ayvens.es] INFO: Extracting data for car ID: 1986725
2026-03-27 13:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8950396b-6249-5766-965d-1a65cefc07e2 with identifier: 1986725
2026-03-27 13:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8950396b-6249-5766-965d-1a65cefc07e2 with scrape type 1
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8950396b-6249-5766-965d-1a65cefc07e2
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F709%252F04ef5c004ebf47709fcd2fa36bacae9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/709/04ef5c004ebf47709fcd2fa36bacae9c/images/large/1.jpg not downloaded yet
2026-03-27 13:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/152/9a311c394c944ac4b5f5dcadc73a1eee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295e530d0>
2026-03-27 13:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c7136f0-dd04-5fab-a963-c5d85fde33e1/7c7136f0-dd04-5fab-a963-c5d85fde33e1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F361%252F6825472dd22542fe86ea93e25e08b5b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/361/6825472dd22542fe86ea93e25e08b5b1/images/large/1.jpg saved to cache
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1
2026-03-27 13:32:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c7136f0-dd04-5fab-a963-c5d85fde33e1, skipping ID generation
2026-03-27 13:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with scrape type 1
2026-03-27 13:32:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1 sending to next pipeline
2026-03-27 13:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7c7136f0-dd04-5fab-a963-c5d85fde33e1, identifier: 1986716
2026-03-27 13:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297e2d890>
2026-03-27 13:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e462e9-ac7c-579d-9af0-31bdd352d810/55e462e9-ac7c-579d-9af0-31bdd352d810_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F9b78fd1113784a1db3787cc11ff24602%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/9b78fd1113784a1db3787cc11ff24602/images/large/1.jpg saved to cache
2026-03-27 13:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55e462e9-ac7c-579d-9af0-31bdd352d810
2026-03-27 13:32:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55e462e9-ac7c-579d-9af0-31bdd352d810, skipping ID generation
2026-03-27 13:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e462e9-ac7c-579d-9af0-31bdd352d810 with scrape type 1
2026-03-27 13:32:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55e462e9-ac7c-579d-9af0-31bdd352d810 sending to next pipeline
2026-03-27 13:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 55e462e9-ac7c-579d-9af0-31bdd352d810, identifier: 1986717
2026-03-27 13:32:05 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 0 pages/min), scraped 152 items (at 96 items/min)
2026-03-27 13:32:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-27 13:32:05 [ayvens.es] INFO: Found listing with ID: 1986726
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986726%27 HTTP/1.1" 200 None
2026-03-27 13:32:05 [ayvens.es] INFO: Scrape type for 1986726: 1
2026-03-27 13:32:05 [ayvens.es] INFO: Extracting data for car ID: 1986726
2026-03-27 13:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b4b0b3-49a6-568d-9346-33b55b1182c6 with identifier: 1986726
2026-03-27 13:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b4b0b3-49a6-568d-9346-33b55b1182c6 with scrape type 1
2026-03-27 13:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26b4b0b3-49a6-568d-9346-33b55b1182c6
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F005%252Fa8aecf2df85c489fb323bb194f9e84f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/005/a8aecf2df85c489fb323bb194f9e84f9/images/large/1.jpg not downloaded yet
2026-03-27 13:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with identifier: 1986716
2026-03-27 13:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with identifier: 1986716
2026-03-27 13:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with identifier: 1986716 to the API
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/361/6825472dd22542fe86ea93e25e08b5b1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7c7136f0-dd04-5fab-a963-c5d85fde33e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 161149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c7136f0-dd04-5fab-a963-c5d85fde33e1/7c7136f0-dd04-5fab-a963-c5d85fde33e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/361/6825472dd22542fe86ea93e25e08b5b1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Go Eco',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986716%27 HTTP/1.1" 200 None
2026-03-27 13:32:05 [ayvens.es] INFO: Saving data for 1986716: {'created_time': 1774618325.857096, 'last_price_update_time': 1774618325.857105, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986716') HTTP/1.1" 204 0
2026-03-27 13:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 55e462e9-ac7c-579d-9af0-31bdd352d810 with identifier: 1986717
2026-03-27 13:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 55e462e9-ac7c-579d-9af0-31bdd352d810 with identifier: 1986717
2026-03-27 13:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 55e462e9-ac7c-579d-9af0-31bdd352d810 with identifier: 1986717 to the API
2026-03-27 13:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/729/9b78fd1113784a1db3787cc11ff24602/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '55e462e9-ac7c-579d-9af0-31bdd352d810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 118088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e462e9-ac7c-579d-9af0-31bdd352d810/55e462e9-ac7c-579d-9af0-31bdd352d810_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/729/9b78fd1113784a1db3787cc11ff24602/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Equilibre Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986717%27 HTTP/1.1" 200 None
2026-03-27 13:32:06 [ayvens.es] INFO: Saving data for 1986717: {'created_time': 1774618326.16349, 'last_price_update_time': 1774618326.163499, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986717') HTTP/1.1" 204 0
2026-03-27 13:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/939/a881df7502a6440c835ecfaf1a9d6f79/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:06 [ayvens.es] INFO: Found listing with ID: 1986727
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986727%27 HTTP/1.1" 200 None
2026-03-27 13:32:06 [ayvens.es] INFO: Scrape type for 1986727: 1
2026-03-27 13:32:06 [ayvens.es] INFO: Extracting data for car ID: 1986727
2026-03-27 13:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af25f67a-be95-510a-811f-f5868b0ac36e with identifier: 1986727
2026-03-27 13:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af25f67a-be95-510a-811f-f5868b0ac36e with scrape type 1
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af25f67a-be95-510a-811f-f5868b0ac36e
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F519%252F37378ebbb4e046038559b2eff00f8351%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/519/37378ebbb4e046038559b2eff00f8351/images/large/1.jpg not downloaded yet
2026-03-27 13:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632cc50>
2026-03-27 13:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee31360e-9acd-5c2c-875f-126934f2db22/ee31360e-9acd-5c2c-875f-126934f2db22_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F369%252Ff15b04bcaf8b44d89960b7f25953a992%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/369/f15b04bcaf8b44d89960b7f25953a992/images/large/1.jpg saved to cache
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee31360e-9acd-5c2c-875f-126934f2db22
2026-03-27 13:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee31360e-9acd-5c2c-875f-126934f2db22, skipping ID generation
2026-03-27 13:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee31360e-9acd-5c2c-875f-126934f2db22 with scrape type 1
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee31360e-9acd-5c2c-875f-126934f2db22 sending to next pipeline
2026-03-27 13:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee31360e-9acd-5c2c-875f-126934f2db22, identifier: 1986718
2026-03-27 13:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632e590>
2026-03-27 13:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59c33bb-1ddd-5e49-a7b8-dc050954c44d/f59c33bb-1ddd-5e49-a7b8-dc050954c44d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F152%252F9a311c394c944ac4b5f5dcadc73a1eee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/152/9a311c394c944ac4b5f5dcadc73a1eee/images/large/1.jpg saved to cache
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d
2026-03-27 13:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f59c33bb-1ddd-5e49-a7b8-dc050954c44d, skipping ID generation
2026-03-27 13:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d with scrape type 1
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f59c33bb-1ddd-5e49-a7b8-dc050954c44d sending to next pipeline
2026-03-27 13:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f59c33bb-1ddd-5e49-a7b8-dc050954c44d, identifier: 1986719
2026-03-27 13:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/810/2e2ccdb1744d4240b2225619ca6b05cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:06 [ayvens.es] INFO: Found listing with ID: 1986728
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986728%27 HTTP/1.1" 200 None
2026-03-27 13:32:06 [ayvens.es] INFO: Scrape type for 1986728: 1
2026-03-27 13:32:06 [ayvens.es] INFO: Extracting data for car ID: 1986728
2026-03-27 13:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with identifier: 1986728
2026-03-27 13:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with scrape type 1
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fd6f36a5049354e6b8b248a501e8443e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/d6f36a5049354e6b8b248a501e8443e1/images/large/1.jpg not downloaded yet
2026-03-27 13:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee31360e-9acd-5c2c-875f-126934f2db22 with identifier: 1986718
2026-03-27 13:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee31360e-9acd-5c2c-875f-126934f2db22 with identifier: 1986718
2026-03-27 13:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee31360e-9acd-5c2c-875f-126934f2db22 with identifier: 1986718 to the API
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/369/f15b04bcaf8b44d89960b7f25953a992/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ee31360e-9acd-5c2c-875f-126934f2db22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 71792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee31360e-9acd-5c2c-875f-126934f2db22/ee31360e-9acd-5c2c-875f-126934f2db22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/369/f15b04bcaf8b44d89960b7f25953a992/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) DSG Emotion',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) DSG Emotion',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986718%27 HTTP/1.1" 200 None
2026-03-27 13:32:06 [ayvens.es] INFO: Saving data for 1986718: {'created_time': 1774618326.961427, 'last_price_update_time': 1774618326.961436, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986718') HTTP/1.1" 204 0
2026-03-27 13:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f59c33bb-1ddd-5e49-a7b8-dc050954c44d with identifier: 1986719
2026-03-27 13:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f59c33bb-1ddd-5e49-a7b8-dc050954c44d with identifier: 1986719
2026-03-27 13:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f59c33bb-1ddd-5e49-a7b8-dc050954c44d with identifier: 1986719 to the API
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/152/9a311c394c944ac4b5f5dcadc73a1eee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f59c33bb-1ddd-5e49-a7b8-dc050954c44d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 112867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59c33bb-1ddd-5e49-a7b8-dc050954c44d/f59c33bb-1ddd-5e49-a7b8-dc050954c44d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/152/9a311c394c944ac4b5f5dcadc73a1eee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986719%27 HTTP/1.1" 200 None
2026-03-27 13:32:07 [ayvens.es] INFO: Saving data for 1986719: {'created_time': 1774618327.370656, 'last_price_update_time': 1774618327.370669, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986719') HTTP/1.1" 204 0
2026-03-27 13:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/201/a1f80f8a3fda49e7b7cc48dcf2514d3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/865/cafe21fc040847eb9941ec8cc946e380/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:07 [ayvens.es] INFO: Found listing with ID: 1986729
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986729%27 HTTP/1.1" 200 None
2026-03-27 13:32:07 [ayvens.es] INFO: Scrape type for 1986729: 1
2026-03-27 13:32:07 [ayvens.es] INFO: Extracting data for car ID: 1986729
2026-03-27 13:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1964f38e-7668-52d5-8f4e-a6779e2bc63b with identifier: 1986729
2026-03-27 13:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b with scrape type 1
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F541%252F3d21d3ab13cf4eeeb66f9273f26464da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/541/3d21d3ab13cf4eeeb66f9273f26464da/images/large/1.jpg not downloaded yet
2026-03-27 13:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296203f90>
2026-03-27 13:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2/1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F939%252Fa881df7502a6440c835ecfaf1a9d6f79%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/939/a881df7502a6440c835ecfaf1a9d6f79/images/large/1.jpg saved to cache
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2
2026-03-27 13:32:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2, skipping ID generation
2026-03-27 13:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with scrape type 1
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 sending to next pipeline
2026-03-27 13:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2, identifier: 1986720
2026-03-27 13:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c33e50>
2026-03-27 13:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1978cc0-6fb2-54e5-b945-a5db91159c0e/c1978cc0-6fb2-54e5-b945-a5db91159c0e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252F2e2ccdb1744d4240b2225619ca6b05cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/2e2ccdb1744d4240b2225619ca6b05cf/images/large/1.jpg saved to cache
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1978cc0-6fb2-54e5-b945-a5db91159c0e
2026-03-27 13:32:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1978cc0-6fb2-54e5-b945-a5db91159c0e, skipping ID generation
2026-03-27 13:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1978cc0-6fb2-54e5-b945-a5db91159c0e with scrape type 1
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1978cc0-6fb2-54e5-b945-a5db91159c0e sending to next pipeline
2026-03-27 13:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c1978cc0-6fb2-54e5-b945-a5db91159c0e, identifier: 1986721
2026-03-27 13:32:07 [ayvens.es] INFO: Found listing with ID: 1986730
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986730%27 HTTP/1.1" 200 None
2026-03-27 13:32:07 [ayvens.es] INFO: Scrape type for 1986730: 1
2026-03-27 13:32:07 [ayvens.es] INFO: Extracting data for car ID: 1986730
2026-03-27 13:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46d0f53-3f53-5d65-9a71-dca27c218565 with identifier: 1986730
2026-03-27 13:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46d0f53-3f53-5d65-9a71-dca27c218565 with scrape type 1
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d46d0f53-3f53-5d65-9a71-dca27c218565
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252F0f1dca2e147041b9a0715b6e86ba27bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/0f1dca2e147041b9a0715b6e86ba27bb/images/large/1.jpg not downloaded yet
2026-03-27 13:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with identifier: 1986720
2026-03-27 13:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with identifier: 1986720
2026-03-27 13:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2 with identifier: 1986720 to the API
2026-03-27 13:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/939/a881df7502a6440c835ecfaf1a9d6f79/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 127623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2/1b0f7266-fcd6-5fc6-94a4-40b4d5dfa8d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/939/a881df7502a6440c835ecfaf1a9d6f79/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.0 TSI 81KW (110 CV) Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW (110 CV) Ambition',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986720%27 HTTP/1.1" 200 None
2026-03-27 13:32:08 [ayvens.es] INFO: Saving data for 1986720: {'created_time': 1774618328.136071, 'last_price_update_time': 1774618328.136082, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986720') HTTP/1.1" 204 0
2026-03-27 13:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c1978cc0-6fb2-54e5-b945-a5db91159c0e with identifier: 1986721
2026-03-27 13:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c1978cc0-6fb2-54e5-b945-a5db91159c0e with identifier: 1986721
2026-03-27 13:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c1978cc0-6fb2-54e5-b945-a5db91159c0e with identifier: 1986721 to the API
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/810/2e2ccdb1744d4240b2225619ca6b05cf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c1978cc0-6fb2-54e5-b945-a5db91159c0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 65218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1978cc0-6fb2-54e5-b945-a5db91159c0e/c1978cc0-6fb2-54e5-b945-a5db91159c0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/810/2e2ccdb1744d4240b2225619ca6b05cf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS PLUS E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS PLUS E-CVT',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986721%27 HTTP/1.1" 200 None
2026-03-27 13:32:08 [ayvens.es] INFO: Saving data for 1986721: {'created_time': 1774618328.452121, 'last_price_update_time': 1774618328.452131, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986721') HTTP/1.1" 204 0
2026-03-27 13:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/709/04ef5c004ebf47709fcd2fa36bacae9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:08 [ayvens.es] INFO: Found listing with ID: 1986731
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986731%27 HTTP/1.1" 200 None
2026-03-27 13:32:08 [ayvens.es] INFO: Scrape type for 1986731: 1
2026-03-27 13:32:08 [ayvens.es] INFO: Extracting data for car ID: 1986731
2026-03-27 13:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8e7637-a87f-5ea7-8633-57101f65215e with identifier: 1986731
2026-03-27 13:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8e7637-a87f-5ea7-8633-57101f65215e with scrape type 1
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a8e7637-a87f-5ea7-8633-57101f65215e
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F712e25c01c7a47c590ba4f013a21eb59%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/712e25c01c7a47c590ba4f013a21eb59/images/large/1.jpg not downloaded yet
2026-03-27 13:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1ff90>
2026-03-27 13:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7616fe7-e11c-55c7-981d-519231b19342/f7616fe7-e11c-55c7-981d-519231b19342_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F201%252Fa1f80f8a3fda49e7b7cc48dcf2514d3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/201/a1f80f8a3fda49e7b7cc48dcf2514d3d/images/large/1.jpg saved to cache
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7616fe7-e11c-55c7-981d-519231b19342
2026-03-27 13:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7616fe7-e11c-55c7-981d-519231b19342, skipping ID generation
2026-03-27 13:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7616fe7-e11c-55c7-981d-519231b19342 with scrape type 1
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7616fe7-e11c-55c7-981d-519231b19342 sending to next pipeline
2026-03-27 13:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f7616fe7-e11c-55c7-981d-519231b19342, identifier: 1986722
2026-03-27 13:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295740610>
2026-03-27 13:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2452118-a699-595a-a9c9-afbf9c6e6419/d2452118-a699-595a-a9c9-afbf9c6e6419_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252Fcafe21fc040847eb9941ec8cc946e380%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/cafe21fc040847eb9941ec8cc946e380/images/large/1.jpg saved to cache
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2452118-a699-595a-a9c9-afbf9c6e6419
2026-03-27 13:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2452118-a699-595a-a9c9-afbf9c6e6419, skipping ID generation
2026-03-27 13:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2452118-a699-595a-a9c9-afbf9c6e6419 with scrape type 1
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2452118-a699-595a-a9c9-afbf9c6e6419 sending to next pipeline
2026-03-27 13:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d2452118-a699-595a-a9c9-afbf9c6e6419, identifier: 1986723
2026-03-27 13:32:08 [ayvens.es] INFO: Found listing with ID: 1986732
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986732%27 HTTP/1.1" 200 None
2026-03-27 13:32:08 [ayvens.es] INFO: Scrape type for 1986732: 1
2026-03-27 13:32:08 [ayvens.es] INFO: Extracting data for car ID: 1986732
2026-03-27 13:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f96cf6a-1104-5219-a6b6-25624f178ffe with identifier: 1986732
2026-03-27 13:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f96cf6a-1104-5219-a6b6-25624f178ffe with scrape type 1
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f96cf6a-1104-5219-a6b6-25624f178ffe
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F571%252Facc119e74481494abb0cda7978a14468%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/571/acc119e74481494abb0cda7978a14468/images/large/1.jpg not downloaded yet
2026-03-27 13:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f7616fe7-e11c-55c7-981d-519231b19342 with identifier: 1986722
2026-03-27 13:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f7616fe7-e11c-55c7-981d-519231b19342 with identifier: 1986722
2026-03-27 13:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f7616fe7-e11c-55c7-981d-519231b19342 with identifier: 1986722 to the API
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/201/a1f80f8a3fda49e7b7cc48dcf2514d3d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f7616fe7-e11c-55c7-981d-519231b19342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 181319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7616fe7-e11c-55c7-981d-519231b19342/f7616fe7-e11c-55c7-981d-519231b19342_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/201/a1f80f8a3fda49e7b7cc48dcf2514d3d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986722%27 HTTP/1.1" 200 None
2026-03-27 13:32:09 [ayvens.es] INFO: Saving data for 1986722: {'created_time': 1774618329.279641, 'last_price_update_time': 1774618329.279651, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986722') HTTP/1.1" 204 0
2026-03-27 13:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d2452118-a699-595a-a9c9-afbf9c6e6419 with identifier: 1986723
2026-03-27 13:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d2452118-a699-595a-a9c9-afbf9c6e6419 with identifier: 1986723
2026-03-27 13:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d2452118-a699-595a-a9c9-afbf9c6e6419 with identifier: 1986723 to the API
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/865/cafe21fc040847eb9941ec8cc946e380/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd2452118-a699-595a-a9c9-afbf9c6e6419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 80408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2452118-a699-595a-a9c9-afbf9c6e6419/d2452118-a699-595a-a9c9-afbf9c6e6419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/865/cafe21fc040847eb9941ec8cc946e380/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986723%27 HTTP/1.1" 200 None
2026-03-27 13:32:09 [ayvens.es] INFO: Saving data for 1986723: {'created_time': 1774618329.639643, 'last_price_update_time': 1774618329.639653, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986723') HTTP/1.1" 204 0
2026-03-27 13:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/056/c348545ba3f948e4ac19b53348a9c158/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/005/a8aecf2df85c489fb323bb194f9e84f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/519/37378ebbb4e046038559b2eff00f8351/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:09 [ayvens.es] INFO: Found listing with ID: 1986733
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986733%27 HTTP/1.1" 200 None
2026-03-27 13:32:09 [ayvens.es] INFO: Scrape type for 1986733: 1
2026-03-27 13:32:09 [ayvens.es] INFO: Extracting data for car ID: 1986733
2026-03-27 13:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with identifier: 1986733
2026-03-27 13:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with scrape type 1
2026-03-27 13:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252F98b13e9d4bc9423bb8a8854e4c95750f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/98b13e9d4bc9423bb8a8854e4c95750f/images/large/1.jpg not downloaded yet
2026-03-27 13:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f320d0>
2026-03-27 13:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8950396b-6249-5766-965d-1a65cefc07e2/8950396b-6249-5766-965d-1a65cefc07e2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F709%252F04ef5c004ebf47709fcd2fa36bacae9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/709/04ef5c004ebf47709fcd2fa36bacae9c/images/large/1.jpg saved to cache
2026-03-27 13:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8950396b-6249-5766-965d-1a65cefc07e2
2026-03-27 13:32:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8950396b-6249-5766-965d-1a65cefc07e2, skipping ID generation
2026-03-27 13:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8950396b-6249-5766-965d-1a65cefc07e2 with scrape type 1
2026-03-27 13:32:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8950396b-6249-5766-965d-1a65cefc07e2 sending to next pipeline
2026-03-27 13:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8950396b-6249-5766-965d-1a65cefc07e2, identifier: 1986725
2026-03-27 13:32:09 [ayvens.es] INFO: Found listing with ID: 1986734
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986734%27 HTTP/1.1" 200 None
2026-03-27 13:32:09 [ayvens.es] INFO: Scrape type for 1986734: 1
2026-03-27 13:32:09 [ayvens.es] INFO: Extracting data for car ID: 1986734
2026-03-27 13:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a8ac4d-8188-50b7-819c-47d3281b3c6e with identifier: 1986734
2026-03-27 13:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e with scrape type 1
2026-03-27 13:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F954%252Fde1f4812a1f54fd4affcc7a013db53eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/954/de1f4812a1f54fd4affcc7a013db53eb/images/large/1.jpg not downloaded yet
2026-03-27 13:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8950396b-6249-5766-965d-1a65cefc07e2 with identifier: 1986725
2026-03-27 13:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8950396b-6249-5766-965d-1a65cefc07e2 with identifier: 1986725
2026-03-27 13:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8950396b-6249-5766-965d-1a65cefc07e2 with identifier: 1986725 to the API
2026-03-27 13:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/709/04ef5c004ebf47709fcd2fa36bacae9c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8950396b-6249-5766-965d-1a65cefc07e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 105966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8950396b-6249-5766-965d-1a65cefc07e2/8950396b-6249-5766-965d-1a65cefc07e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/709/04ef5c004ebf47709fcd2fa36bacae9c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986725%27 HTTP/1.1" 200 None
2026-03-27 13:32:10 [ayvens.es] INFO: Saving data for 1986725: {'created_time': 1774618330.95928, 'last_price_update_time': 1774618330.959292, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986725') HTTP/1.1" 204 0
2026-03-27 13:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/150/d6f36a5049354e6b8b248a501e8443e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:10 [ayvens.es] INFO: Found listing with ID: 1986735
2026-03-27 13:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986735%27 HTTP/1.1" 200 None
2026-03-27 13:32:10 [ayvens.es] INFO: Scrape type for 1986735: 1
2026-03-27 13:32:10 [ayvens.es] INFO: Extracting data for car ID: 1986735
2026-03-27 13:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a90f410f-3080-5ff0-90f8-7decd650d0e3 with identifier: 1986735
2026-03-27 13:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90f410f-3080-5ff0-90f8-7decd650d0e3 with scrape type 1
2026-03-27 13:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a90f410f-3080-5ff0-90f8-7decd650d0e3
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F941%252F9432822ea64d43c79d15fe006debad0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/941/9432822ea64d43c79d15fe006debad0d/images/large/1.jpg not downloaded yet
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0c7d0>
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1128460-8b3a-5381-9b4e-f6e6e11acdf7/b1128460-8b3a-5381-9b4e-f6e6e11acdf7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fc348545ba3f948e4ac19b53348a9c158%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/c348545ba3f948e4ac19b53348a9c158/images/large/1.jpg saved to cache
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7
2026-03-27 13:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1128460-8b3a-5381-9b4e-f6e6e11acdf7, skipping ID generation
2026-03-27 13:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with scrape type 1
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7 sending to next pipeline
2026-03-27 13:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1128460-8b3a-5381-9b4e-f6e6e11acdf7, identifier: 1986724
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963d1350>
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b4b0b3-49a6-568d-9346-33b55b1182c6/26b4b0b3-49a6-568d-9346-33b55b1182c6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F005%252Fa8aecf2df85c489fb323bb194f9e84f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/005/a8aecf2df85c489fb323bb194f9e84f9/images/large/1.jpg saved to cache
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26b4b0b3-49a6-568d-9346-33b55b1182c6
2026-03-27 13:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26b4b0b3-49a6-568d-9346-33b55b1182c6, skipping ID generation
2026-03-27 13:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b4b0b3-49a6-568d-9346-33b55b1182c6 with scrape type 1
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26b4b0b3-49a6-568d-9346-33b55b1182c6 sending to next pipeline
2026-03-27 13:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 26b4b0b3-49a6-568d-9346-33b55b1182c6, identifier: 1986726
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957423d0>
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af25f67a-be95-510a-811f-f5868b0ac36e/af25f67a-be95-510a-811f-f5868b0ac36e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F519%252F37378ebbb4e046038559b2eff00f8351%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/519/37378ebbb4e046038559b2eff00f8351/images/large/1.jpg saved to cache
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af25f67a-be95-510a-811f-f5868b0ac36e
2026-03-27 13:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af25f67a-be95-510a-811f-f5868b0ac36e, skipping ID generation
2026-03-27 13:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af25f67a-be95-510a-811f-f5868b0ac36e with scrape type 1
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af25f67a-be95-510a-811f-f5868b0ac36e sending to next pipeline
2026-03-27 13:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: af25f67a-be95-510a-811f-f5868b0ac36e, identifier: 1986727
2026-03-27 13:32:11 [ayvens.es] INFO: Found listing with ID: 1986736
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986736%27 HTTP/1.1" 200 None
2026-03-27 13:32:11 [ayvens.es] INFO: Scrape type for 1986736: 1
2026-03-27 13:32:11 [ayvens.es] INFO: Extracting data for car ID: 1986736
2026-03-27 13:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with identifier: 1986736
2026-03-27 13:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with scrape type 1
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252F2f519870a64f4aea8a9bd9558eef4c32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/2f519870a64f4aea8a9bd9558eef4c32/images/large/1.jpg not downloaded yet
2026-03-27 13:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with identifier: 1986724
2026-03-27 13:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with identifier: 1986724
2026-03-27 13:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with identifier: 1986724 to the API
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/056/c348545ba3f948e4ac19b53348a9c158/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b1128460-8b3a-5381-9b4e-f6e6e11acdf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 33751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1128460-8b3a-5381-9b4e-f6e6e11acdf7/b1128460-8b3a-5381-9b4e-f6e6e11acdf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/c348545ba3f948e4ac19b53348a9c158/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986724%27 HTTP/1.1" 200 None
2026-03-27 13:32:11 [ayvens.es] INFO: Saving data for 1986724: {'created_time': 1774618331.94331, 'last_price_update_time': 1774618331.943322, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986724') HTTP/1.1" 204 0
2026-03-27 13:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 26b4b0b3-49a6-568d-9346-33b55b1182c6 with identifier: 1986726
2026-03-27 13:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 26b4b0b3-49a6-568d-9346-33b55b1182c6 with identifier: 1986726
2026-03-27 13:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 26b4b0b3-49a6-568d-9346-33b55b1182c6 with identifier: 1986726 to the API
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/005/a8aecf2df85c489fb323bb194f9e84f9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '26b4b0b3-49a6-568d-9346-33b55b1182c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 196809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b4b0b3-49a6-568d-9346-33b55b1182c6/26b4b0b3-49a6-568d-9346-33b55b1182c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/005/a8aecf2df85c489fb323bb194f9e84f9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986726%27 HTTP/1.1" 200 None
2026-03-27 13:32:12 [ayvens.es] INFO: Saving data for 1986726: {'created_time': 1774618332.422766, 'last_price_update_time': 1774618332.422777, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986726') HTTP/1.1" 204 0
2026-03-27 13:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: af25f67a-be95-510a-811f-f5868b0ac36e with identifier: 1986727
2026-03-27 13:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: af25f67a-be95-510a-811f-f5868b0ac36e with identifier: 1986727
2026-03-27 13:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: af25f67a-be95-510a-811f-f5868b0ac36e with identifier: 1986727 to the API
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/519/37378ebbb4e046038559b2eff00f8351/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'af25f67a-be95-510a-811f-f5868b0ac36e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 136941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af25f67a-be95-510a-811f-f5868b0ac36e/af25f67a-be95-510a-811f-f5868b0ac36e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/519/37378ebbb4e046038559b2eff00f8351/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986727%27 HTTP/1.1" 200 None
2026-03-27 13:32:12 [ayvens.es] INFO: Saving data for 1986727: {'created_time': 1774618332.760687, 'last_price_update_time': 1774618332.760698, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986727') HTTP/1.1" 204 0
2026-03-27 13:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/541/3d21d3ab13cf4eeeb66f9273f26464da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:12 [ayvens.es] INFO: Found listing with ID: 1986737
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986737%27 HTTP/1.1" 200 None
2026-03-27 13:32:12 [ayvens.es] INFO: Scrape type for 1986737: 1
2026-03-27 13:32:12 [ayvens.es] INFO: Extracting data for car ID: 1986737
2026-03-27 13:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d333fac-1d12-579f-8e97-6ce29213f36e with identifier: 1986737
2026-03-27 13:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d333fac-1d12-579f-8e97-6ce29213f36e with scrape type 1
2026-03-27 13:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6d333fac-1d12-579f-8e97-6ce29213f36e
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252F8782abc5d383403b8e9d14d9b8087cc7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/8782abc5d383403b8e9d14d9b8087cc7/images/large/1.jpg not downloaded yet
2026-03-27 13:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963eca90>
2026-03-27 13:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb915b7-c7a4-595a-89b9-96a16f454ad4/8cb915b7-c7a4-595a-89b9-96a16f454ad4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fd6f36a5049354e6b8b248a501e8443e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/d6f36a5049354e6b8b248a501e8443e1/images/large/1.jpg saved to cache
2026-03-27 13:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4
2026-03-27 13:32:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cb915b7-c7a4-595a-89b9-96a16f454ad4, skipping ID generation
2026-03-27 13:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with scrape type 1
2026-03-27 13:32:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4 sending to next pipeline
2026-03-27 13:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8cb915b7-c7a4-595a-89b9-96a16f454ad4, identifier: 1986728
2026-03-27 13:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/819/0f1dca2e147041b9a0715b6e86ba27bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/712e25c01c7a47c590ba4f013a21eb59/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:12 [ayvens.es] INFO: Found listing with ID: 1986738
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986738%27 HTTP/1.1" 200 None
2026-03-27 13:32:13 [ayvens.es] INFO: Scrape type for 1986738: 1
2026-03-27 13:32:13 [ayvens.es] INFO: Extracting data for car ID: 1986738
2026-03-27 13:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6 with identifier: 1986738
2026-03-27 13:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6 with scrape type 1
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F709%252F12f22b42fcdd41f4b75213d3d1289523%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/709/12f22b42fcdd41f4b75213d3d1289523/images/large/1.jpg not downloaded yet
2026-03-27 13:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with identifier: 1986728
2026-03-27 13:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with identifier: 1986728
2026-03-27 13:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with identifier: 1986728 to the API
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/150/d6f36a5049354e6b8b248a501e8443e1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8cb915b7-c7a4-595a-89b9-96a16f454ad4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 172258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb915b7-c7a4-595a-89b9-96a16f454ad4/8cb915b7-c7a4-595a-89b9-96a16f454ad4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/150/d6f36a5049354e6b8b248a501e8443e1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2018}
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986728%27 HTTP/1.1" 200 None
2026-03-27 13:32:13 [ayvens.es] INFO: Saving data for 1986728: {'created_time': 1774618333.314545, 'last_price_update_time': 1774618333.314556, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986728') HTTP/1.1" 204 0
2026-03-27 13:32:13 [ayvens.es] INFO: Found listing with ID: 1986739
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986739%27 HTTP/1.1" 200 None
2026-03-27 13:32:13 [ayvens.es] INFO: Scrape type for 1986739: 1
2026-03-27 13:32:13 [ayvens.es] INFO: Extracting data for car ID: 1986739
2026-03-27 13:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306d75cf-d6c4-5884-afb7-f7b044283c4e with identifier: 1986739
2026-03-27 13:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d75cf-d6c4-5884-afb7-f7b044283c4e with scrape type 1
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 306d75cf-d6c4-5884-afb7-f7b044283c4e
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F979%252F259e6a4fc7844b8a9f1ac1db276fc93c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/979/259e6a4fc7844b8a9f1ac1db276fc93c/images/large/1.jpg not downloaded yet
2026-03-27 13:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/303/98b13e9d4bc9423bb8a8854e4c95750f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963ee190>
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1964f38e-7668-52d5-8f4e-a6779e2bc63b/1964f38e-7668-52d5-8f4e-a6779e2bc63b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F541%252F3d21d3ab13cf4eeeb66f9273f26464da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/541/3d21d3ab13cf4eeeb66f9273f26464da/images/large/1.jpg saved to cache
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b
2026-03-27 13:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1964f38e-7668-52d5-8f4e-a6779e2bc63b, skipping ID generation
2026-03-27 13:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b with scrape type 1
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b sending to next pipeline
2026-03-27 13:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1964f38e-7668-52d5-8f4e-a6779e2bc63b, identifier: 1986729
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296319810>
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46d0f53-3f53-5d65-9a71-dca27c218565/d46d0f53-3f53-5d65-9a71-dca27c218565_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252F0f1dca2e147041b9a0715b6e86ba27bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/0f1dca2e147041b9a0715b6e86ba27bb/images/large/1.jpg saved to cache
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d46d0f53-3f53-5d65-9a71-dca27c218565
2026-03-27 13:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d46d0f53-3f53-5d65-9a71-dca27c218565, skipping ID generation
2026-03-27 13:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46d0f53-3f53-5d65-9a71-dca27c218565 with scrape type 1
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d46d0f53-3f53-5d65-9a71-dca27c218565 sending to next pipeline
2026-03-27 13:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d46d0f53-3f53-5d65-9a71-dca27c218565, identifier: 1986730
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296200590>
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8e7637-a87f-5ea7-8633-57101f65215e/0a8e7637-a87f-5ea7-8633-57101f65215e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F712e25c01c7a47c590ba4f013a21eb59%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/712e25c01c7a47c590ba4f013a21eb59/images/large/1.jpg saved to cache
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a8e7637-a87f-5ea7-8633-57101f65215e
2026-03-27 13:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a8e7637-a87f-5ea7-8633-57101f65215e, skipping ID generation
2026-03-27 13:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8e7637-a87f-5ea7-8633-57101f65215e with scrape type 1
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a8e7637-a87f-5ea7-8633-57101f65215e sending to next pipeline
2026-03-27 13:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0a8e7637-a87f-5ea7-8633-57101f65215e, identifier: 1986731
2026-03-27 13:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/571/acc119e74481494abb0cda7978a14468/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:13 [ayvens.es] INFO: Found listing with ID: 1986740
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986740%27 HTTP/1.1" 200 None
2026-03-27 13:32:13 [ayvens.es] INFO: Scrape type for 1986740: 1
2026-03-27 13:32:13 [ayvens.es] INFO: Extracting data for car ID: 1986740
2026-03-27 13:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with identifier: 1986740
2026-03-27 13:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with scrape type 1
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F992%252F8b628a79fe444ed18c9c20497ad800a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/992/8b628a79fe444ed18c9c20497ad800a3/images/large/1.jpg not downloaded yet
2026-03-27 13:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1964f38e-7668-52d5-8f4e-a6779e2bc63b with identifier: 1986729
2026-03-27 13:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1964f38e-7668-52d5-8f4e-a6779e2bc63b with identifier: 1986729
2026-03-27 13:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1964f38e-7668-52d5-8f4e-a6779e2bc63b with identifier: 1986729 to the API
2026-03-27 13:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/541/3d21d3ab13cf4eeeb66f9273f26464da/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1964f38e-7668-52d5-8f4e-a6779e2bc63b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 68790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1964f38e-7668-52d5-8f4e-a6779e2bc63b/1964f38e-7668-52d5-8f4e-a6779e2bc63b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/541/3d21d3ab13cf4eeeb66f9273f26464da/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR (O) 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '(O) 2.0 180H Advance',
 'vin': None,
 'year': 2023}
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986729%27 HTTP/1.1" 200 None
2026-03-27 13:32:14 [ayvens.es] INFO: Saving data for 1986729: {'created_time': 1774618334.162982, 'last_price_update_time': 1774618334.162992, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986729') HTTP/1.1" 204 0
2026-03-27 13:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d46d0f53-3f53-5d65-9a71-dca27c218565 with identifier: 1986730
2026-03-27 13:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d46d0f53-3f53-5d65-9a71-dca27c218565 with identifier: 1986730
2026-03-27 13:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d46d0f53-3f53-5d65-9a71-dca27c218565 with identifier: 1986730 to the API
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/819/0f1dca2e147041b9a0715b6e86ba27bb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Sophistograu',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd46d0f53-3f53-5d65-9a71-dca27c218565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 39524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46d0f53-3f53-5d65-9a71-dca27c218565/d46d0f53-3f53-5d65-9a71-dca27c218565_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/819/0f1dca2e147041b9a0715b6e86ba27bb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986730%27 HTTP/1.1" 200 None
2026-03-27 13:32:14 [ayvens.es] INFO: Saving data for 1986730: {'created_time': 1774618334.578854, 'last_price_update_time': 1774618334.578864, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986730') HTTP/1.1" 204 0
2026-03-27 13:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0a8e7637-a87f-5ea7-8633-57101f65215e with identifier: 1986731
2026-03-27 13:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0a8e7637-a87f-5ea7-8633-57101f65215e with identifier: 1986731
2026-03-27 13:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0a8e7637-a87f-5ea7-8633-57101f65215e with identifier: 1986731 to the API
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/712e25c01c7a47c590ba4f013a21eb59/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a8e7637-a87f-5ea7-8633-57101f65215e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 87681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8e7637-a87f-5ea7-8633-57101f65215e/0a8e7637-a87f-5ea7-8633-57101f65215e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/712e25c01c7a47c590ba4f013a21eb59/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986731%27 HTTP/1.1" 200 None
2026-03-27 13:32:14 [ayvens.es] INFO: Saving data for 1986731: {'created_time': 1774618334.950443, 'last_price_update_time': 1774618334.950452, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986731') HTTP/1.1" 204 0
2026-03-27 13:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/954/de1f4812a1f54fd4affcc7a013db53eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:14 [ayvens.es] INFO: Found listing with ID: 1986741
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986741%27 HTTP/1.1" 200 None
2026-03-27 13:32:14 [ayvens.es] INFO: Scrape type for 1986741: 1
2026-03-27 13:32:14 [ayvens.es] INFO: Extracting data for car ID: 1986741
2026-03-27 13:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with identifier: 1986741
2026-03-27 13:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with scrape type 1
2026-03-27 13:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6
2026-03-27 13:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252F16dcda1d422843fb8cb5a49399b35d95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/16dcda1d422843fb8cb5a49399b35d95/images/large/1.jpg not downloaded yet
2026-03-27 13:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962b77d0>
2026-03-27 13:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8/3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252F98b13e9d4bc9423bb8a8854e4c95750f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/98b13e9d4bc9423bb8a8854e4c95750f/images/large/1.jpg saved to cache
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8
2026-03-27 13:32:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8, skipping ID generation
2026-03-27 13:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with scrape type 1
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 sending to next pipeline
2026-03-27 13:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8, identifier: 1986733
2026-03-27 13:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956e99d0>
2026-03-27 13:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f96cf6a-1104-5219-a6b6-25624f178ffe/3f96cf6a-1104-5219-a6b6-25624f178ffe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F571%252Facc119e74481494abb0cda7978a14468%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/571/acc119e74481494abb0cda7978a14468/images/large/1.jpg saved to cache
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f96cf6a-1104-5219-a6b6-25624f178ffe
2026-03-27 13:32:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f96cf6a-1104-5219-a6b6-25624f178ffe, skipping ID generation
2026-03-27 13:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f96cf6a-1104-5219-a6b6-25624f178ffe with scrape type 1
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f96cf6a-1104-5219-a6b6-25624f178ffe sending to next pipeline
2026-03-27 13:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3f96cf6a-1104-5219-a6b6-25624f178ffe, identifier: 1986732
2026-03-27 13:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/941/9432822ea64d43c79d15fe006debad0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:15 [ayvens.es] INFO: Found listing with ID: 1986742
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986742%27 HTTP/1.1" 200 None
2026-03-27 13:32:15 [ayvens.es] INFO: Scrape type for 1986742: 1
2026-03-27 13:32:15 [ayvens.es] INFO: Extracting data for car ID: 1986742
2026-03-27 13:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84820689-4506-5f49-9705-df4b5564459e with identifier: 1986742
2026-03-27 13:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84820689-4506-5f49-9705-df4b5564459e with scrape type 1
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84820689-4506-5f49-9705-df4b5564459e
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252Fad4246bf65444b50ab9aad34cf86e1bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/ad4246bf65444b50ab9aad34cf86e1bc/images/large/1.jpg not downloaded yet
2026-03-27 13:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with identifier: 1986733
2026-03-27 13:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with identifier: 1986733
2026-03-27 13:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8 with identifier: 1986733 to the API
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/303/98b13e9d4bc9423bb8a8854e4c95750f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 286296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8/3a3dbe37-2d5f-53ea-900a-0aa85c2b85a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/303/98b13e9d4bc9423bb8a8854e4c95750f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986733%27 HTTP/1.1" 200 None
2026-03-27 13:32:15 [ayvens.es] INFO: Saving data for 1986733: {'created_time': 1774618335.71953, 'last_price_update_time': 1774618335.719541, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986733') HTTP/1.1" 204 0
2026-03-27 13:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3f96cf6a-1104-5219-a6b6-25624f178ffe with identifier: 1986732
2026-03-27 13:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3f96cf6a-1104-5219-a6b6-25624f178ffe with identifier: 1986732
2026-03-27 13:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3f96cf6a-1104-5219-a6b6-25624f178ffe with identifier: 1986732 to the API
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/571/acc119e74481494abb0cda7978a14468/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3f96cf6a-1104-5219-a6b6-25624f178ffe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 87845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f96cf6a-1104-5219-a6b6-25624f178ffe/3f96cf6a-1104-5219-a6b6-25624f178ffe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/571/acc119e74481494abb0cda7978a14468/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L2H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '350 96kW L2H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986732%27 HTTP/1.1" 200 None
2026-03-27 13:32:16 [ayvens.es] INFO: Saving data for 1986732: {'created_time': 1774618336.050381, 'last_price_update_time': 1774618336.050391, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986732') HTTP/1.1" 204 0
2026-03-27 13:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/150/2f519870a64f4aea8a9bd9558eef4c32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/107/8782abc5d383403b8e9d14d9b8087cc7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:16 [ayvens.es] INFO: Found listing with ID: 1986743
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986743%27 HTTP/1.1" 200 None
2026-03-27 13:32:16 [ayvens.es] INFO: Scrape type for 1986743: 1
2026-03-27 13:32:16 [ayvens.es] INFO: Extracting data for car ID: 1986743
2026-03-27 13:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5e1ab8-1493-5c49-a389-502c577143fc with identifier: 1986743
2026-03-27 13:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5e1ab8-1493-5c49-a389-502c577143fc with scrape type 1
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1c5e1ab8-1493-5c49-a389-502c577143fc
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F6bd2fb458e384f93be1e3df4142b0766%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/6bd2fb458e384f93be1e3df4142b0766/images/large/1.jpg not downloaded yet
2026-03-27 13:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529577e310>
2026-03-27 13:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a8ac4d-8188-50b7-819c-47d3281b3c6e/94a8ac4d-8188-50b7-819c-47d3281b3c6e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F954%252Fde1f4812a1f54fd4affcc7a013db53eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/954/de1f4812a1f54fd4affcc7a013db53eb/images/large/1.jpg saved to cache
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e
2026-03-27 13:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94a8ac4d-8188-50b7-819c-47d3281b3c6e, skipping ID generation
2026-03-27 13:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e with scrape type 1
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e sending to next pipeline
2026-03-27 13:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94a8ac4d-8188-50b7-819c-47d3281b3c6e, identifier: 1986734
2026-03-27 13:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957a4d50>
2026-03-27 13:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90f410f-3080-5ff0-90f8-7decd650d0e3/a90f410f-3080-5ff0-90f8-7decd650d0e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F941%252F9432822ea64d43c79d15fe006debad0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/941/9432822ea64d43c79d15fe006debad0d/images/large/1.jpg saved to cache
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a90f410f-3080-5ff0-90f8-7decd650d0e3
2026-03-27 13:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a90f410f-3080-5ff0-90f8-7decd650d0e3, skipping ID generation
2026-03-27 13:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90f410f-3080-5ff0-90f8-7decd650d0e3 with scrape type 1
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a90f410f-3080-5ff0-90f8-7decd650d0e3 sending to next pipeline
2026-03-27 13:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a90f410f-3080-5ff0-90f8-7decd650d0e3, identifier: 1986735
2026-03-27 13:32:16 [ayvens.es] INFO: Found listing with ID: 1986744
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986744%27 HTTP/1.1" 200 None
2026-03-27 13:32:16 [ayvens.es] INFO: Scrape type for 1986744: 1
2026-03-27 13:32:16 [ayvens.es] INFO: Extracting data for car ID: 1986744
2026-03-27 13:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612c972f-89f0-5e93-80d8-77912a342d36 with identifier: 1986744
2026-03-27 13:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612c972f-89f0-5e93-80d8-77912a342d36 with scrape type 1
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 612c972f-89f0-5e93-80d8-77912a342d36
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F084%252Fd59c8749452a4fb8a346b36daeff4315%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/084/d59c8749452a4fb8a346b36daeff4315/images/large/1.jpg not downloaded yet
2026-03-27 13:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94a8ac4d-8188-50b7-819c-47d3281b3c6e with identifier: 1986734
2026-03-27 13:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94a8ac4d-8188-50b7-819c-47d3281b3c6e with identifier: 1986734
2026-03-27 13:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94a8ac4d-8188-50b7-819c-47d3281b3c6e with identifier: 1986734 to the API
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/954/de1f4812a1f54fd4affcc7a013db53eb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '94a8ac4d-8188-50b7-819c-47d3281b3c6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 112422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a8ac4d-8188-50b7-819c-47d3281b3c6e/94a8ac4d-8188-50b7-819c-47d3281b3c6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/954/de1f4812a1f54fd4affcc7a013db53eb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Prestige Bl. dCi 85kW(115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Prestige Bl. dCi 85kW(115CV) 4X4',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986734%27 HTTP/1.1" 200 None
2026-03-27 13:32:16 [ayvens.es] INFO: Saving data for 1986734: {'created_time': 1774618336.833609, 'last_price_update_time': 1774618336.833621, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986734') HTTP/1.1" 204 0
2026-03-27 13:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a90f410f-3080-5ff0-90f8-7decd650d0e3 with identifier: 1986735
2026-03-27 13:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a90f410f-3080-5ff0-90f8-7decd650d0e3 with identifier: 1986735
2026-03-27 13:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a90f410f-3080-5ff0-90f8-7decd650d0e3 with identifier: 1986735 to the API
2026-03-27 13:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/941/9432822ea64d43c79d15fe006debad0d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Clear',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a90f410f-3080-5ff0-90f8-7decd650d0e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 135392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90f410f-3080-5ff0-90f8-7decd650d0e3/a90f410f-3080-5ff0-90f8-7decd650d0e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/941/9432822ea64d43c79d15fe006debad0d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDi HEV 104kW (141CV) Drive',
 'transmission': 'manual',
 'trim': '1.6 GDi HEV 104kW (141CV) Drive',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986735%27 HTTP/1.1" 200 None
2026-03-27 13:32:17 [ayvens.es] INFO: Saving data for 1986735: {'created_time': 1774618337.179492, 'last_price_update_time': 1774618337.179501, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986735') HTTP/1.1" 204 0
2026-03-27 13:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/709/12f22b42fcdd41f4b75213d3d1289523/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:17 [ayvens.es] INFO: Found listing with ID: 1986745
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986745%27 HTTP/1.1" 200 None
2026-03-27 13:32:17 [ayvens.es] INFO: Scrape type for 1986745: 1
2026-03-27 13:32:17 [ayvens.es] INFO: Extracting data for car ID: 1986745
2026-03-27 13:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75265a9-305c-5c84-bf41-4fbfce833b43 with identifier: 1986745
2026-03-27 13:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75265a9-305c-5c84-bf41-4fbfce833b43 with scrape type 1
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d75265a9-305c-5c84-bf41-4fbfce833b43
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F728%252Fa26a2c706f744ce78e22e68f458c52c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/728/a26a2c706f744ce78e22e68f458c52c8/images/large/1.jpg not downloaded yet
2026-03-27 13:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295750e90>
2026-03-27 13:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2/0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252F2f519870a64f4aea8a9bd9558eef4c32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/2f519870a64f4aea8a9bd9558eef4c32/images/large/1.jpg saved to cache
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2
2026-03-27 13:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2, skipping ID generation
2026-03-27 13:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with scrape type 1
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 sending to next pipeline
2026-03-27 13:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2, identifier: 1986736
2026-03-27 13:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296203b10>
2026-03-27 13:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d333fac-1d12-579f-8e97-6ce29213f36e/6d333fac-1d12-579f-8e97-6ce29213f36e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252F8782abc5d383403b8e9d14d9b8087cc7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/8782abc5d383403b8e9d14d9b8087cc7/images/large/1.jpg saved to cache
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d333fac-1d12-579f-8e97-6ce29213f36e
2026-03-27 13:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d333fac-1d12-579f-8e97-6ce29213f36e, skipping ID generation
2026-03-27 13:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d333fac-1d12-579f-8e97-6ce29213f36e with scrape type 1
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d333fac-1d12-579f-8e97-6ce29213f36e sending to next pipeline
2026-03-27 13:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6d333fac-1d12-579f-8e97-6ce29213f36e, identifier: 1986737
2026-03-27 13:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/979/259e6a4fc7844b8a9f1ac1db276fc93c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:17 [ayvens.es] INFO: Found listing with ID: 1986746
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986746%27 HTTP/1.1" 200 None
2026-03-27 13:32:17 [ayvens.es] INFO: Scrape type for 1986746: 1
2026-03-27 13:32:17 [ayvens.es] INFO: Extracting data for car ID: 1986746
2026-03-27 13:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d8f69b-f468-5aea-8639-d190c4a28536 with identifier: 1986746
2026-03-27 13:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d8f69b-f468-5aea-8639-d190c4a28536 with scrape type 1
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29d8f69b-f468-5aea-8639-d190c4a28536
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F969%252Fc58f5c8cf4e24217b259ada92a91e784%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/969/c58f5c8cf4e24217b259ada92a91e784/images/large/1.jpg not downloaded yet
2026-03-27 13:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with identifier: 1986736
2026-03-27 13:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with identifier: 1986736
2026-03-27 13:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with identifier: 1986736 to the API
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/150/2f519870a64f4aea8a9bd9558eef4c32/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 68644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2/0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/150/2f519870a64f4aea8a9bd9558eef4c32/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 92kW (125cv) Titanium MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 92kW (125cv) Titanium MHEV',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986736%27 HTTP/1.1" 200 None
2026-03-27 13:32:18 [ayvens.es] INFO: Saving data for 1986736: {'created_time': 1774618338.040466, 'last_price_update_time': 1774618338.040476, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986736') HTTP/1.1" 204 0
2026-03-27 13:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6d333fac-1d12-579f-8e97-6ce29213f36e with identifier: 1986737
2026-03-27 13:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6d333fac-1d12-579f-8e97-6ce29213f36e with identifier: 1986737
2026-03-27 13:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6d333fac-1d12-579f-8e97-6ce29213f36e with identifier: 1986737 to the API
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/107/8782abc5d383403b8e9d14d9b8087cc7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6d333fac-1d12-579f-8e97-6ce29213f36e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 189427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d333fac-1d12-579f-8e97-6ce29213f36e/6d333fac-1d12-579f-8e97-6ce29213f36e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/107/8782abc5d383403b8e9d14d9b8087cc7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'transmission': 'manual',
 'trim': '2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986737%27 HTTP/1.1" 200 None
2026-03-27 13:32:18 [ayvens.es] INFO: Saving data for 1986737: {'created_time': 1774618338.380313, 'last_price_update_time': 1774618338.380323, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986737') HTTP/1.1" 204 0
2026-03-27 13:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/705/16dcda1d422843fb8cb5a49399b35d95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/992/8b628a79fe444ed18c9c20497ad800a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:18 [ayvens.es] INFO: Found listing with ID: 1986747
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986747%27 HTTP/1.1" 200 None
2026-03-27 13:32:18 [ayvens.es] INFO: Scrape type for 1986747: 1
2026-03-27 13:32:18 [ayvens.es] INFO: Extracting data for car ID: 1986747
2026-03-27 13:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with identifier: 1986747
2026-03-27 13:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with scrape type 1
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252Fb642a58d4bcf4cc6b765bff738061549%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/b642a58d4bcf4cc6b765bff738061549/images/large/1.jpg not downloaded yet
2026-03-27 13:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c33710>
2026-03-27 13:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa30953-0b01-5ee7-8ea5-601fa8f53aa6/7aa30953-0b01-5ee7-8ea5-601fa8f53aa6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F709%252F12f22b42fcdd41f4b75213d3d1289523%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/709/12f22b42fcdd41f4b75213d3d1289523/images/large/1.jpg saved to cache
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6
2026-03-27 13:32:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6, skipping ID generation
2026-03-27 13:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6 with scrape type 1
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6 sending to next pipeline
2026-03-27 13:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6, identifier: 1986738
2026-03-27 13:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f32b10>
2026-03-27 13:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d75cf-d6c4-5884-afb7-f7b044283c4e/306d75cf-d6c4-5884-afb7-f7b044283c4e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F979%252F259e6a4fc7844b8a9f1ac1db276fc93c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/979/259e6a4fc7844b8a9f1ac1db276fc93c/images/large/1.jpg saved to cache
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 306d75cf-d6c4-5884-afb7-f7b044283c4e
2026-03-27 13:32:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 306d75cf-d6c4-5884-afb7-f7b044283c4e, skipping ID generation
2026-03-27 13:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d75cf-d6c4-5884-afb7-f7b044283c4e with scrape type 1
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 306d75cf-d6c4-5884-afb7-f7b044283c4e sending to next pipeline
2026-03-27 13:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 306d75cf-d6c4-5884-afb7-f7b044283c4e, identifier: 1986739
2026-03-27 13:32:18 [ayvens.es] INFO: Found listing with ID: 1986748
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986748%27 HTTP/1.1" 200 None
2026-03-27 13:32:18 [ayvens.es] INFO: Scrape type for 1986748: 1
2026-03-27 13:32:18 [ayvens.es] INFO: Extracting data for car ID: 1986748
2026-03-27 13:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b939fb27-d4c2-5611-a448-5558db49b031 with identifier: 1986748
2026-03-27 13:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b939fb27-d4c2-5611-a448-5558db49b031 with scrape type 1
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b939fb27-d4c2-5611-a448-5558db49b031
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F85d4db3bd4a9421da2bd6568e04a4e51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/85d4db3bd4a9421da2bd6568e04a4e51/images/large/1.jpg not downloaded yet
2026-03-27 13:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6 with identifier: 1986738
2026-03-27 13:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6 with identifier: 1986738
2026-03-27 13:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7aa30953-0b01-5ee7-8ea5-601fa8f53aa6 with identifier: 1986738 to the API
2026-03-27 13:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/709/12f22b42fcdd41f4b75213d3d1289523/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '7aa30953-0b01-5ee7-8ea5-601fa8f53aa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 197091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa30953-0b01-5ee7-8ea5-601fa8f53aa6/7aa30953-0b01-5ee7-8ea5-601fa8f53aa6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/709/12f22b42fcdd41f4b75213d3d1289523/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 GDi 97kW (132CV) Concept 4x2',
 'transmission': 'manual',
 'trim': '1.6 GDi 97kW (132CV) Concept 4x2',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986738%27 HTTP/1.1" 200 None
2026-03-27 13:32:19 [ayvens.es] INFO: Saving data for 1986738: {'created_time': 1774618339.186165, 'last_price_update_time': 1774618339.186175, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986738') HTTP/1.1" 204 0
2026-03-27 13:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 306d75cf-d6c4-5884-afb7-f7b044283c4e with identifier: 1986739
2026-03-27 13:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 306d75cf-d6c4-5884-afb7-f7b044283c4e with identifier: 1986739
2026-03-27 13:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 306d75cf-d6c4-5884-afb7-f7b044283c4e with identifier: 1986739 to the API
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/979/259e6a4fc7844b8a9f1ac1db276fc93c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '306d75cf-d6c4-5884-afb7-f7b044283c4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 96127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d75cf-d6c4-5884-afb7-f7b044283c4e/306d75cf-d6c4-5884-afb7-f7b044283c4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/979/259e6a4fc7844b8a9f1ac1db276fc93c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986739%27 HTTP/1.1" 200 None
2026-03-27 13:32:19 [ayvens.es] INFO: Saving data for 1986739: {'created_time': 1774618339.515752, 'last_price_update_time': 1774618339.515764, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986739') HTTP/1.1" 204 0
2026-03-27 13:32:19 [ayvens.es] INFO: Found listing with ID: 1986749
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986749%27 HTTP/1.1" 200 None
2026-03-27 13:32:19 [ayvens.es] INFO: Scrape type for 1986749: 1
2026-03-27 13:32:19 [ayvens.es] INFO: Extracting data for car ID: 1986749
2026-03-27 13:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e639cc2d-8302-5d90-99ba-645feb377709 with identifier: 1986749
2026-03-27 13:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e639cc2d-8302-5d90-99ba-645feb377709 with scrape type 1
2026-03-27 13:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e639cc2d-8302-5d90-99ba-645feb377709
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252F2533246d105840c88fc301ed3dc72398%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/2533246d105840c88fc301ed3dc72398/images/large/1.jpg not downloaded yet
2026-03-27 13:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/135/6bd2fb458e384f93be1e3df4142b0766/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962b4110>
2026-03-27 13:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4d6341-f785-58d8-a20e-6dbb0eeab4a6/3d4d6341-f785-58d8-a20e-6dbb0eeab4a6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252F16dcda1d422843fb8cb5a49399b35d95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/16dcda1d422843fb8cb5a49399b35d95/images/large/1.jpg saved to cache
2026-03-27 13:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6
2026-03-27 13:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6, skipping ID generation
2026-03-27 13:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with scrape type 1
2026-03-27 13:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 sending to next pipeline
2026-03-27 13:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6, identifier: 1986741
2026-03-27 13:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295746290>
2026-03-27 13:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222fa4c4-1e2d-5824-bec8-c656f6e8d4c5/222fa4c4-1e2d-5824-bec8-c656f6e8d4c5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F992%252F8b628a79fe444ed18c9c20497ad800a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/992/8b628a79fe444ed18c9c20497ad800a3/images/large/1.jpg saved to cache
2026-03-27 13:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5
2026-03-27 13:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5, skipping ID generation
2026-03-27 13:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with scrape type 1
2026-03-27 13:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 sending to next pipeline
2026-03-27 13:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5, identifier: 1986740
2026-03-27 13:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/531/ad4246bf65444b50ab9aad34cf86e1bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:19 [ayvens.es] INFO: Found listing with ID: 1986750
2026-03-27 13:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986750%27 HTTP/1.1" 200 None
2026-03-27 13:32:20 [ayvens.es] INFO: Scrape type for 1986750: 1
2026-03-27 13:32:20 [ayvens.es] INFO: Extracting data for car ID: 1986750
2026-03-27 13:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f2e172-bc10-5879-8808-3c608062d020 with identifier: 1986750
2026-03-27 13:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f2e172-bc10-5879-8808-3c608062d020 with scrape type 1
2026-03-27 13:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 91f2e172-bc10-5879-8808-3c608062d020
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F324%252Fbbf5efa363f24a96b8c89dcae73d87e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/324/bbf5efa363f24a96b8c89dcae73d87e5/images/large/1.jpg not downloaded yet
2026-03-27 13:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with identifier: 1986741
2026-03-27 13:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with identifier: 1986741
2026-03-27 13:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with identifier: 1986741 to the API
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/705/16dcda1d422843fb8cb5a49399b35d95/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3d4d6341-f785-58d8-a20e-6dbb0eeab4a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 139010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4d6341-f785-58d8-a20e-6dbb0eeab4a6/3d4d6341-f785-58d8-a20e-6dbb0eeab4a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/705/16dcda1d422843fb8cb5a49399b35d95/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo Base 1.3 Multijet 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Multijet 70kW (95CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986741%27 HTTP/1.1" 200 None
2026-03-27 13:32:20 [ayvens.es] INFO: Saving data for 1986741: {'created_time': 1774618340.351742, 'last_price_update_time': 1774618340.351751, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986741') HTTP/1.1" 204 0
2026-03-27 13:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with identifier: 1986740
2026-03-27 13:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with identifier: 1986740
2026-03-27 13:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with identifier: 1986740 to the API
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/992/8b628a79fe444ed18c9c20497ad800a3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '222fa4c4-1e2d-5824-bec8-c656f6e8d4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C5 AIRCROSS',
 'odometer': 133209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222fa4c4-1e2d-5824-bec8-c656f6e8d4c5/222fa4c4-1e2d-5824-bec8-c656f6e8d4c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/992/8b628a79fe444ed18c9c20497ad800a3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C5 AIRCROSS BlueHdi 96kW (130CV) S&S EAT8 Feel',
 'transmission': 'manual',
 'trim': 'BlueHdi 96kW (130CV) S&S EAT8 Feel',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986740%27 HTTP/1.1" 200 None
2026-03-27 13:32:20 [ayvens.es] INFO: Saving data for 1986740: {'created_time': 1774618340.660923, 'last_price_update_time': 1774618340.660935, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986740') HTTP/1.1" 204 0
2026-03-27 13:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/728/a26a2c706f744ce78e22e68f458c52c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/084/d59c8749452a4fb8a346b36daeff4315/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:20 [ayvens.es] INFO: Found listing with ID: 1986751
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986751%27 HTTP/1.1" 200 None
2026-03-27 13:32:20 [ayvens.es] INFO: Scrape type for 1986751: 1
2026-03-27 13:32:20 [ayvens.es] INFO: Extracting data for car ID: 1986751
2026-03-27 13:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with identifier: 1986751
2026-03-27 13:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with scrape type 1
2026-03-27 13:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252Fe73e1239bf7c4a88889ea9fc5c965143%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/e73e1239bf7c4a88889ea9fc5c965143/images/large/1.jpg not downloaded yet
2026-03-27 13:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529600af50>
2026-03-27 13:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c5e1ab8-1493-5c49-a389-502c577143fc/1c5e1ab8-1493-5c49-a389-502c577143fc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F6bd2fb458e384f93be1e3df4142b0766%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/6bd2fb458e384f93be1e3df4142b0766/images/large/1.jpg saved to cache
2026-03-27 13:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c5e1ab8-1493-5c49-a389-502c577143fc
2026-03-27 13:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c5e1ab8-1493-5c49-a389-502c577143fc, skipping ID generation
2026-03-27 13:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5e1ab8-1493-5c49-a389-502c577143fc with scrape type 1
2026-03-27 13:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c5e1ab8-1493-5c49-a389-502c577143fc sending to next pipeline
2026-03-27 13:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1c5e1ab8-1493-5c49-a389-502c577143fc, identifier: 1986743
2026-03-27 13:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1c5e1ab8-1493-5c49-a389-502c577143fc with identifier: 1986743
2026-03-27 13:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1c5e1ab8-1493-5c49-a389-502c577143fc with identifier: 1986743
2026-03-27 13:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1c5e1ab8-1493-5c49-a389-502c577143fc with identifier: 1986743 to the API
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/135/6bd2fb458e384f93be1e3df4142b0766/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 276,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '3.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '1c5e1ab8-1493-5c49-a389-502c577143fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NT400 CABSTAR',
 'odometer': 82048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c5e1ab8-1493-5c49-a389-502c577143fc/1c5e1ab8-1493-5c49-a389-502c577143fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/135/6bd2fb458e384f93be1e3df4142b0766/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NT400 CABSTAR 45.15/3 Premium Cab Abatible Larga',
 'transmission': 'manual',
 'trim': '45.15/3 Premium Cab Abatible Larga',
 'vin': None,
 'year': 2018}
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986743%27 HTTP/1.1" 200 None
2026-03-27 13:32:21 [ayvens.es] INFO: Saving data for 1986743: {'created_time': 1774618341.261941, 'last_price_update_time': 1774618341.261951, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986743') HTTP/1.1" 204 0
2026-03-27 13:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962c8d90>
2026-03-27 13:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84820689-4506-5f49-9705-df4b5564459e/84820689-4506-5f49-9705-df4b5564459e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252Fad4246bf65444b50ab9aad34cf86e1bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/ad4246bf65444b50ab9aad34cf86e1bc/images/large/1.jpg saved to cache
2026-03-27 13:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84820689-4506-5f49-9705-df4b5564459e
2026-03-27 13:32:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84820689-4506-5f49-9705-df4b5564459e, skipping ID generation
2026-03-27 13:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84820689-4506-5f49-9705-df4b5564459e with scrape type 1
2026-03-27 13:32:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84820689-4506-5f49-9705-df4b5564459e sending to next pipeline
2026-03-27 13:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84820689-4506-5f49-9705-df4b5564459e, identifier: 1986742
2026-03-27 13:32:21 [ayvens.es] INFO: Found listing with ID: 1986752
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986752%27 HTTP/1.1" 200 None
2026-03-27 13:32:21 [ayvens.es] INFO: Scrape type for 1986752: 1
2026-03-27 13:32:21 [ayvens.es] INFO: Extracting data for car ID: 1986752
2026-03-27 13:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17551b1f-08d6-5284-92bc-5d5c83bc2304 with identifier: 1986752
2026-03-27 13:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17551b1f-08d6-5284-92bc-5d5c83bc2304 with scrape type 1
2026-03-27 13:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 17551b1f-08d6-5284-92bc-5d5c83bc2304
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F564%252Fd53286fbc78c4de591988f16ba75db36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/564/d53286fbc78c4de591988f16ba75db36/images/large/1.jpg not downloaded yet
2026-03-27 13:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84820689-4506-5f49-9705-df4b5564459e with identifier: 1986742
2026-03-27 13:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84820689-4506-5f49-9705-df4b5564459e with identifier: 1986742
2026-03-27 13:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84820689-4506-5f49-9705-df4b5564459e with identifier: 1986742 to the API
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/531/ad4246bf65444b50ab9aad34cf86e1bc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '84820689-4506-5f49-9705-df4b5564459e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 184364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84820689-4506-5f49-9705-df4b5564459e/84820689-4506-5f49-9705-df4b5564459e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/531/ad4246bf65444b50ab9aad34cf86e1bc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW (150CV) Titanium',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW (150CV) Titanium',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986742%27 HTTP/1.1" 200 None
2026-03-27 13:32:21 [ayvens.es] INFO: Saving data for 1986742: {'created_time': 1774618341.963593, 'last_price_update_time': 1774618341.963603, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986742') HTTP/1.1" 204 0
2026-03-27 13:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295e524d0>
2026-03-27 13:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75265a9-305c-5c84-bf41-4fbfce833b43/d75265a9-305c-5c84-bf41-4fbfce833b43_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F728%252Fa26a2c706f744ce78e22e68f458c52c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/728/a26a2c706f744ce78e22e68f458c52c8/images/large/1.jpg saved to cache
2026-03-27 13:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d75265a9-305c-5c84-bf41-4fbfce833b43
2026-03-27 13:32:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d75265a9-305c-5c84-bf41-4fbfce833b43, skipping ID generation
2026-03-27 13:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75265a9-305c-5c84-bf41-4fbfce833b43 with scrape type 1
2026-03-27 13:32:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d75265a9-305c-5c84-bf41-4fbfce833b43 sending to next pipeline
2026-03-27 13:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d75265a9-305c-5c84-bf41-4fbfce833b43, identifier: 1986745
2026-03-27 13:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962ec310>
2026-03-27 13:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612c972f-89f0-5e93-80d8-77912a342d36/612c972f-89f0-5e93-80d8-77912a342d36_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F084%252Fd59c8749452a4fb8a346b36daeff4315%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/084/d59c8749452a4fb8a346b36daeff4315/images/large/1.jpg saved to cache
2026-03-27 13:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 612c972f-89f0-5e93-80d8-77912a342d36
2026-03-27 13:32:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 612c972f-89f0-5e93-80d8-77912a342d36, skipping ID generation
2026-03-27 13:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612c972f-89f0-5e93-80d8-77912a342d36 with scrape type 1
2026-03-27 13:32:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 612c972f-89f0-5e93-80d8-77912a342d36 sending to next pipeline
2026-03-27 13:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 612c972f-89f0-5e93-80d8-77912a342d36, identifier: 1986744
2026-03-27 13:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/969/c58f5c8cf4e24217b259ada92a91e784/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:22 [ayvens.es] INFO: Found listing with ID: 1986753
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986753%27 HTTP/1.1" 200 None
2026-03-27 13:32:22 [ayvens.es] INFO: Scrape type for 1986753: 1
2026-03-27 13:32:22 [ayvens.es] INFO: Extracting data for car ID: 1986753
2026-03-27 13:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with identifier: 1986753
2026-03-27 13:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with scrape type 1
2026-03-27 13:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F38851525c31e43b6bfac8912b491eab5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/38851525c31e43b6bfac8912b491eab5/images/large/1.jpg not downloaded yet
2026-03-27 13:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d75265a9-305c-5c84-bf41-4fbfce833b43 with identifier: 1986745
2026-03-27 13:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d75265a9-305c-5c84-bf41-4fbfce833b43 with identifier: 1986745
2026-03-27 13:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d75265a9-305c-5c84-bf41-4fbfce833b43 with identifier: 1986745 to the API
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/728/a26a2c706f744ce78e22e68f458c52c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd75265a9-305c-5c84-bf41-4fbfce833b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'GRAND C-MAX',
 'odometer': 138918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75265a9-305c-5c84-bf41-4fbfce833b43/d75265a9-305c-5c84-bf41-4fbfce833b43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/728/a26a2c706f744ce78e22e68f458c52c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD GRAND C-MAX 1.5 TDCi 88kW (120CV) Business',
 'transmission': 'manual',
 'trim': '1.5 TDCi 88kW (120CV) Business',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986745%27 HTTP/1.1" 200 None
2026-03-27 13:32:22 [ayvens.es] INFO: Saving data for 1986745: {'created_time': 1774618342.686084, 'last_price_update_time': 1774618342.686095, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986745') HTTP/1.1" 204 0
2026-03-27 13:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 612c972f-89f0-5e93-80d8-77912a342d36 with identifier: 1986744
2026-03-27 13:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 612c972f-89f0-5e93-80d8-77912a342d36 with identifier: 1986744
2026-03-27 13:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 612c972f-89f0-5e93-80d8-77912a342d36 with identifier: 1986744 to the API
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/084/d59c8749452a4fb8a346b36daeff4315/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '612c972f-89f0-5e93-80d8-77912a342d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 89936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612c972f-89f0-5e93-80d8-77912a342d36/612c972f-89f0-5e93-80d8-77912a342d36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/084/d59c8749452a4fb8a346b36daeff4315/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel Pack',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986744%27 HTTP/1.1" 200 None
2026-03-27 13:32:23 [ayvens.es] INFO: Saving data for 1986744: {'created_time': 1774618343.021586, 'last_price_update_time': 1774618343.021596, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986744') HTTP/1.1" 204 0
2026-03-27 13:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/b642a58d4bcf4cc6b765bff738061549/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:23 [ayvens.es] INFO: Found listing with ID: 1986754
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986754%27 HTTP/1.1" 200 None
2026-03-27 13:32:23 [ayvens.es] INFO: Scrape type for 1986754: 1
2026-03-27 13:32:23 [ayvens.es] INFO: Extracting data for car ID: 1986754
2026-03-27 13:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590d4b35-c670-55a3-b53f-f8626340876f with identifier: 1986754
2026-03-27 13:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590d4b35-c670-55a3-b53f-f8626340876f with scrape type 1
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 590d4b35-c670-55a3-b53f-f8626340876f
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252Fd7045fa6780e41f78a142de55b8597cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/d7045fa6780e41f78a142de55b8597cd/images/large/1.jpg not downloaded yet
2026-03-27 13:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/342/2533246d105840c88fc301ed3dc72398/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bf0b90>
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d8f69b-f468-5aea-8639-d190c4a28536/29d8f69b-f468-5aea-8639-d190c4a28536_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F969%252Fc58f5c8cf4e24217b259ada92a91e784%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/969/c58f5c8cf4e24217b259ada92a91e784/images/large/1.jpg saved to cache
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29d8f69b-f468-5aea-8639-d190c4a28536
2026-03-27 13:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29d8f69b-f468-5aea-8639-d190c4a28536, skipping ID generation
2026-03-27 13:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d8f69b-f468-5aea-8639-d190c4a28536 with scrape type 1
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29d8f69b-f468-5aea-8639-d190c4a28536 sending to next pipeline
2026-03-27 13:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29d8f69b-f468-5aea-8639-d190c4a28536, identifier: 1986746
2026-03-27 13:32:23 [ayvens.es] INFO: Found listing with ID: 1986755
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986755%27 HTTP/1.1" 200 None
2026-03-27 13:32:23 [ayvens.es] INFO: Scrape type for 1986755: 1
2026-03-27 13:32:23 [ayvens.es] INFO: Extracting data for car ID: 1986755
2026-03-27 13:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82576d07-fc62-52a9-a4e5-1e06986c719d with identifier: 1986755
2026-03-27 13:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82576d07-fc62-52a9-a4e5-1e06986c719d with scrape type 1
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 82576d07-fc62-52a9-a4e5-1e06986c719d
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F484%252Ff4c73190c75f4dafa807b6b3f04668ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/484/f4c73190c75f4dafa807b6b3f04668ba/images/large/1.jpg not downloaded yet
2026-03-27 13:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29d8f69b-f468-5aea-8639-d190c4a28536 with identifier: 1986746
2026-03-27 13:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29d8f69b-f468-5aea-8639-d190c4a28536 with identifier: 1986746
2026-03-27 13:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29d8f69b-f468-5aea-8639-d190c4a28536 with identifier: 1986746 to the API
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/969/c58f5c8cf4e24217b259ada92a91e784/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Santorini',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '29d8f69b-f468-5aea-8639-d190c4a28536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 115513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d8f69b-f468-5aea-8639-d190c4a28536/29d8f69b-f468-5aea-8639-d190c4a28536_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/969/c58f5c8cf4e24217b259ada92a91e784/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0D 110kW S',
 'transmission': 'manual',
 'trim': '2.0D 110kW S',
 'vin': None,
 'year': 2018}
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986746%27 HTTP/1.1" 200 None
2026-03-27 13:32:23 [ayvens.es] INFO: Saving data for 1986746: {'created_time': 1774618343.604365, 'last_price_update_time': 1774618343.604378, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986746') HTTP/1.1" 204 0
2026-03-27 13:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/324/bbf5efa363f24a96b8c89dcae73d87e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/049/85d4db3bd4a9421da2bd6568e04a4e51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:23 [ayvens.es] INFO: Found listing with ID: 1986756
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986756%27 HTTP/1.1" 200 None
2026-03-27 13:32:23 [ayvens.es] INFO: Scrape type for 1986756: 1
2026-03-27 13:32:23 [ayvens.es] INFO: Extracting data for car ID: 1986756
2026-03-27 13:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dae128f-8dbd-5cea-a840-33deeadeaa9b with identifier: 1986756
2026-03-27 13:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b with scrape type 1
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252F9950327126dc43ba837b2c987653ebb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/9950327126dc43ba837b2c987653ebb7/images/large/1.jpg not downloaded yet
2026-03-27 13:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/538/e73e1239bf7c4a88889ea9fc5c965143/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296011ed0>
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b01c6d1-3da4-504b-ba36-8dc3443fc416/7b01c6d1-3da4-504b-ba36-8dc3443fc416_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252Fb642a58d4bcf4cc6b765bff738061549%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/b642a58d4bcf4cc6b765bff738061549/images/large/1.jpg saved to cache
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416
2026-03-27 13:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b01c6d1-3da4-504b-ba36-8dc3443fc416, skipping ID generation
2026-03-27 13:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with scrape type 1
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b01c6d1-3da4-504b-ba36-8dc3443fc416 sending to next pipeline
2026-03-27 13:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7b01c6d1-3da4-504b-ba36-8dc3443fc416, identifier: 1986747
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957a4190>
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e639cc2d-8302-5d90-99ba-645feb377709/e639cc2d-8302-5d90-99ba-645feb377709_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252F2533246d105840c88fc301ed3dc72398%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/2533246d105840c88fc301ed3dc72398/images/large/1.jpg saved to cache
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e639cc2d-8302-5d90-99ba-645feb377709
2026-03-27 13:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e639cc2d-8302-5d90-99ba-645feb377709, skipping ID generation
2026-03-27 13:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e639cc2d-8302-5d90-99ba-645feb377709 with scrape type 1
2026-03-27 13:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e639cc2d-8302-5d90-99ba-645feb377709 sending to next pipeline
2026-03-27 13:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e639cc2d-8302-5d90-99ba-645feb377709, identifier: 1986749
2026-03-27 13:32:24 [ayvens.es] INFO: Found listing with ID: 1986757
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986757%27 HTTP/1.1" 200 None
2026-03-27 13:32:24 [ayvens.es] INFO: Scrape type for 1986757: 1
2026-03-27 13:32:24 [ayvens.es] INFO: Extracting data for car ID: 1986757
2026-03-27 13:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec4cd7ed-1744-502f-b328-5f33a533167a with identifier: 1986757
2026-03-27 13:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4cd7ed-1744-502f-b328-5f33a533167a with scrape type 1
2026-03-27 13:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec4cd7ed-1744-502f-b328-5f33a533167a
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252Fea23c29b76a24852a5a806c3ecf307d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/ea23c29b76a24852a5a806c3ecf307d0/images/large/1.jpg not downloaded yet
2026-03-27 13:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with identifier: 1986747
2026-03-27 13:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with identifier: 1986747
2026-03-27 13:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7b01c6d1-3da4-504b-ba36-8dc3443fc416 with identifier: 1986747 to the API
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/635/b642a58d4bcf4cc6b765bff738061549/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '7b01c6d1-3da4-504b-ba36-8dc3443fc416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 56848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b01c6d1-3da4-504b-ba36-8dc3443fc416/7b01c6d1-3da4-504b-ba36-8dc3443fc416_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/b642a58d4bcf4cc6b765bff738061549/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986747%27 HTTP/1.1" 200 None
2026-03-27 13:32:24 [ayvens.es] INFO: Saving data for 1986747: {'created_time': 1774618344.423106, 'last_price_update_time': 1774618344.423115, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986747') HTTP/1.1" 204 0
2026-03-27 13:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e639cc2d-8302-5d90-99ba-645feb377709 with identifier: 1986749
2026-03-27 13:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e639cc2d-8302-5d90-99ba-645feb377709 with identifier: 1986749
2026-03-27 13:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e639cc2d-8302-5d90-99ba-645feb377709 with identifier: 1986749 to the API
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/342/2533246d105840c88fc301ed3dc72398/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e639cc2d-8302-5d90-99ba-645feb377709',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 113953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e639cc2d-8302-5d90-99ba-645feb377709/e639cc2d-8302-5d90-99ba-645feb377709_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/342/2533246d105840c88fc301ed3dc72398/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986749%27 HTTP/1.1" 200 None
2026-03-27 13:32:24 [ayvens.es] INFO: Saving data for 1986749: {'created_time': 1774618344.752084, 'last_price_update_time': 1774618344.752095, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986749') HTTP/1.1" 204 0
2026-03-27 13:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/564/d53286fbc78c4de591988f16ba75db36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:24 [ayvens.es] INFO: Found listing with ID: 1986758
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986758%27 HTTP/1.1" 200 None
2026-03-27 13:32:24 [ayvens.es] INFO: Scrape type for 1986758: 1
2026-03-27 13:32:24 [ayvens.es] INFO: Extracting data for car ID: 1986758
2026-03-27 13:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d09e721-a595-5d2e-967a-89a270e45bd6 with identifier: 1986758
2026-03-27 13:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d09e721-a595-5d2e-967a-89a270e45bd6 with scrape type 1
2026-03-27 13:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8d09e721-a595-5d2e-967a-89a270e45bd6
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F468%252F79b399eba1a1432c8159918f1de7d00e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/468/79b399eba1a1432c8159918f1de7d00e/images/large/1.jpg not downloaded yet
2026-03-27 13:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960af590>
2026-03-27 13:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f2e172-bc10-5879-8808-3c608062d020/91f2e172-bc10-5879-8808-3c608062d020_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F324%252Fbbf5efa363f24a96b8c89dcae73d87e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/324/bbf5efa363f24a96b8c89dcae73d87e5/images/large/1.jpg saved to cache
2026-03-27 13:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91f2e172-bc10-5879-8808-3c608062d020
2026-03-27 13:32:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91f2e172-bc10-5879-8808-3c608062d020, skipping ID generation
2026-03-27 13:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f2e172-bc10-5879-8808-3c608062d020 with scrape type 1
2026-03-27 13:32:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91f2e172-bc10-5879-8808-3c608062d020 sending to next pipeline
2026-03-27 13:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 91f2e172-bc10-5879-8808-3c608062d020, identifier: 1986750
2026-03-27 13:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960ae210>
2026-03-27 13:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b939fb27-d4c2-5611-a448-5558db49b031/b939fb27-d4c2-5611-a448-5558db49b031_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F85d4db3bd4a9421da2bd6568e04a4e51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/85d4db3bd4a9421da2bd6568e04a4e51/images/large/1.jpg saved to cache
2026-03-27 13:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b939fb27-d4c2-5611-a448-5558db49b031
2026-03-27 13:32:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b939fb27-d4c2-5611-a448-5558db49b031, skipping ID generation
2026-03-27 13:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b939fb27-d4c2-5611-a448-5558db49b031 with scrape type 1
2026-03-27 13:32:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b939fb27-d4c2-5611-a448-5558db49b031 sending to next pipeline
2026-03-27 13:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b939fb27-d4c2-5611-a448-5558db49b031, identifier: 1986748
2026-03-27 13:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961ab690>
2026-03-27 13:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43/2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252Fe73e1239bf7c4a88889ea9fc5c965143%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/e73e1239bf7c4a88889ea9fc5c965143/images/large/1.jpg saved to cache
2026-03-27 13:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43
2026-03-27 13:32:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43, skipping ID generation
2026-03-27 13:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with scrape type 1
2026-03-27 13:32:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 sending to next pipeline
2026-03-27 13:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43, identifier: 1986751
2026-03-27 13:32:25 [ayvens.es] INFO: Found listing with ID: 1986759
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986759%27 HTTP/1.1" 200 None
2026-03-27 13:32:25 [ayvens.es] INFO: Scrape type for 1986759: 1
2026-03-27 13:32:25 [ayvens.es] INFO: Extracting data for car ID: 1986759
2026-03-27 13:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2 with identifier: 1986759
2026-03-27 13:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2 with scrape type 1
2026-03-27 13:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252Ff92b3b38ca3d457bb94f50ce3cec648e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/f92b3b38ca3d457bb94f50ce3cec648e/images/large/1.jpg not downloaded yet
2026-03-27 13:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 91f2e172-bc10-5879-8808-3c608062d020 with identifier: 1986750
2026-03-27 13:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 91f2e172-bc10-5879-8808-3c608062d020 with identifier: 1986750
2026-03-27 13:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 91f2e172-bc10-5879-8808-3c608062d020 with identifier: 1986750 to the API
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/324/bbf5efa363f24a96b8c89dcae73d87e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '91f2e172-bc10-5879-8808-3c608062d020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 162403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f2e172-bc10-5879-8808-3c608062d020/91f2e172-bc10-5879-8808-3c608062d020_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/324/bbf5efa363f24a96b8c89dcae73d87e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986750%27 HTTP/1.1" 200 None
2026-03-27 13:32:25 [ayvens.es] INFO: Saving data for 1986750: {'created_time': 1774618345.660853, 'last_price_update_time': 1774618345.660864, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986750') HTTP/1.1" 204 0
2026-03-27 13:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b939fb27-d4c2-5611-a448-5558db49b031 with identifier: 1986748
2026-03-27 13:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b939fb27-d4c2-5611-a448-5558db49b031 with identifier: 1986748
2026-03-27 13:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b939fb27-d4c2-5611-a448-5558db49b031 with identifier: 1986748 to the API
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/049/85d4db3bd4a9421da2bd6568e04a4e51/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b939fb27-d4c2-5611-a448-5558db49b031',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 158087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b939fb27-d4c2-5611-a448-5558db49b031/b939fb27-d4c2-5611-a448-5558db49b031_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/049/85d4db3bd4a9421da2bd6568e04a4e51/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986748%27 HTTP/1.1" 200 None
2026-03-27 13:32:26 [ayvens.es] INFO: Saving data for 1986748: {'created_time': 1774618346.042068, 'last_price_update_time': 1774618346.042078, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986748') HTTP/1.1" 204 0
2026-03-27 13:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with identifier: 1986751
2026-03-27 13:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with identifier: 1986751
2026-03-27 13:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43 with identifier: 1986751 to the API
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/538/e73e1239bf7c4a88889ea9fc5c965143/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 36212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43/2bfce1c7-85e0-53b0-b0c0-b3fbf6bf0e43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/538/e73e1239bf7c4a88889ea9fc5c965143/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK PureTech 73 kW Manual PERFORMANCE '
          'LINE',
 'transmission': 'manual',
 'trim': 'PureTech 73 kW Manual PERFORMANCE LINE',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986751%27 HTTP/1.1" 200 None
2026-03-27 13:32:26 [ayvens.es] INFO: Saving data for 1986751: {'created_time': 1774618346.37336, 'last_price_update_time': 1774618346.37337, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986751') HTTP/1.1" 204 0
2026-03-27 13:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/562/38851525c31e43b6bfac8912b491eab5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/170/d7045fa6780e41f78a142de55b8597cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:26 [ayvens.es] INFO: Found listing with ID: 1986760
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986760%27 HTTP/1.1" 200 None
2026-03-27 13:32:26 [ayvens.es] INFO: Scrape type for 1986760: 1
2026-03-27 13:32:26 [ayvens.es] INFO: Extracting data for car ID: 1986760
2026-03-27 13:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce73904d-6be0-53b1-acc8-2805c7d91380 with identifier: 1986760
2026-03-27 13:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce73904d-6be0-53b1-acc8-2805c7d91380 with scrape type 1
2026-03-27 13:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce73904d-6be0-53b1-acc8-2805c7d91380
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F900%252F94c35e8fb3db4147ab98ed8860203f07%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/900/94c35e8fb3db4147ab98ed8860203f07/images/large/1.jpg not downloaded yet
2026-03-27 13:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/484/f4c73190c75f4dafa807b6b3f04668ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296309890>
2026-03-27 13:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17551b1f-08d6-5284-92bc-5d5c83bc2304/17551b1f-08d6-5284-92bc-5d5c83bc2304_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F564%252Fd53286fbc78c4de591988f16ba75db36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/564/d53286fbc78c4de591988f16ba75db36/images/large/1.jpg saved to cache
2026-03-27 13:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17551b1f-08d6-5284-92bc-5d5c83bc2304
2026-03-27 13:32:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17551b1f-08d6-5284-92bc-5d5c83bc2304, skipping ID generation
2026-03-27 13:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17551b1f-08d6-5284-92bc-5d5c83bc2304 with scrape type 1
2026-03-27 13:32:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17551b1f-08d6-5284-92bc-5d5c83bc2304 sending to next pipeline
2026-03-27 13:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 17551b1f-08d6-5284-92bc-5d5c83bc2304, identifier: 1986752
2026-03-27 13:32:26 [ayvens.es] INFO: Found listing with ID: 1986761
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986761%27 HTTP/1.1" 200 None
2026-03-27 13:32:26 [ayvens.es] INFO: Scrape type for 1986761: 1
2026-03-27 13:32:26 [ayvens.es] INFO: Extracting data for car ID: 1986761
2026-03-27 13:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13130dfd-bbfd-52b9-a434-38e047dee08c with identifier: 1986761
2026-03-27 13:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13130dfd-bbfd-52b9-a434-38e047dee08c with scrape type 1
2026-03-27 13:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13130dfd-bbfd-52b9-a434-38e047dee08c
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252F3043d08ac1c84e54b1bb74606e9e15e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/3043d08ac1c84e54b1bb74606e9e15e7/images/large/1.jpg not downloaded yet
2026-03-27 13:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 17551b1f-08d6-5284-92bc-5d5c83bc2304 with identifier: 1986752
2026-03-27 13:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 17551b1f-08d6-5284-92bc-5d5c83bc2304 with identifier: 1986752
2026-03-27 13:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 17551b1f-08d6-5284-92bc-5d5c83bc2304 with identifier: 1986752 to the API
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/564/d53286fbc78c4de591988f16ba75db36/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '17551b1f-08d6-5284-92bc-5d5c83bc2304',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 99178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17551b1f-08d6-5284-92bc-5d5c83bc2304/17551b1f-08d6-5284-92bc-5d5c83bc2304_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/564/d53286fbc78c4de591988f16ba75db36/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986752%27 HTTP/1.1" 200 None
2026-03-27 13:32:27 [ayvens.es] INFO: Saving data for 1986752: {'created_time': 1774618347.003097, 'last_price_update_time': 1774618347.003108, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986752') HTTP/1.1" 204 0
2026-03-27 13:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/024/9950327126dc43ba837b2c987653ebb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:27 [ayvens.es] INFO: Found listing with ID: 1986762
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986762%27 HTTP/1.1" 200 None
2026-03-27 13:32:27 [ayvens.es] INFO: Scrape type for 1986762: 1
2026-03-27 13:32:27 [ayvens.es] INFO: Extracting data for car ID: 1986762
2026-03-27 13:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a16c1ba-085f-58d2-9346-37c788ad93d7 with identifier: 1986762
2026-03-27 13:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a16c1ba-085f-58d2-9346-37c788ad93d7 with scrape type 1
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5a16c1ba-085f-58d2-9346-37c788ad93d7
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F190%252F23fcbc3160a84aac96719f01447f568a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/190/23fcbc3160a84aac96719f01447f568a/images/large/1.jpg not downloaded yet
2026-03-27 13:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/809/ea23c29b76a24852a5a806c3ecf307d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529671b490>
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89c8a2c8-80ff-5d49-abf7-752c55ad3d27/89c8a2c8-80ff-5d49-abf7-752c55ad3d27_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F38851525c31e43b6bfac8912b491eab5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/38851525c31e43b6bfac8912b491eab5/images/large/1.jpg saved to cache
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27
2026-03-27 13:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27, skipping ID generation
2026-03-27 13:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with scrape type 1
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 sending to next pipeline
2026-03-27 13:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27, identifier: 1986753
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962b6d50>
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_590d4b35-c670-55a3-b53f-f8626340876f/590d4b35-c670-55a3-b53f-f8626340876f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252Fd7045fa6780e41f78a142de55b8597cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/d7045fa6780e41f78a142de55b8597cd/images/large/1.jpg saved to cache
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 590d4b35-c670-55a3-b53f-f8626340876f
2026-03-27 13:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 590d4b35-c670-55a3-b53f-f8626340876f, skipping ID generation
2026-03-27 13:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590d4b35-c670-55a3-b53f-f8626340876f with scrape type 1
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 590d4b35-c670-55a3-b53f-f8626340876f sending to next pipeline
2026-03-27 13:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 590d4b35-c670-55a3-b53f-f8626340876f, identifier: 1986754
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295767250>
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82576d07-fc62-52a9-a4e5-1e06986c719d/82576d07-fc62-52a9-a4e5-1e06986c719d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F484%252Ff4c73190c75f4dafa807b6b3f04668ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/484/f4c73190c75f4dafa807b6b3f04668ba/images/large/1.jpg saved to cache
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82576d07-fc62-52a9-a4e5-1e06986c719d
2026-03-27 13:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82576d07-fc62-52a9-a4e5-1e06986c719d, skipping ID generation
2026-03-27 13:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82576d07-fc62-52a9-a4e5-1e06986c719d with scrape type 1
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82576d07-fc62-52a9-a4e5-1e06986c719d sending to next pipeline
2026-03-27 13:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 82576d07-fc62-52a9-a4e5-1e06986c719d, identifier: 1986755
2026-03-27 13:32:27 [ayvens.es] INFO: Found listing with ID: 1986763
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986763%27 HTTP/1.1" 200 None
2026-03-27 13:32:27 [ayvens.es] INFO: Scrape type for 1986763: 1
2026-03-27 13:32:27 [ayvens.es] INFO: Extracting data for car ID: 1986763
2026-03-27 13:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d5b7422-53f8-5a18-8074-b88e9a465f74 with identifier: 1986763
2026-03-27 13:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5b7422-53f8-5a18-8074-b88e9a465f74 with scrape type 1
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d5b7422-53f8-5a18-8074-b88e9a465f74
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252Fd714886e2cf04b6c89feec46e00cad87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/d714886e2cf04b6c89feec46e00cad87/images/large/1.jpg not downloaded yet
2026-03-27 13:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with identifier: 1986753
2026-03-27 13:32:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with identifier: 1986753
2026-03-27 13:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with identifier: 1986753 to the API
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/562/38851525c31e43b6bfac8912b491eab5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Hielo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '89c8a2c8-80ff-5d49-abf7-752c55ad3d27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV300',
 'odometer': 109720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89c8a2c8-80ff-5d49-abf7-752c55ad3d27/89c8a2c8-80ff-5d49-abf7-752c55ad3d27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/562/38851525c31e43b6bfac8912b491eab5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-24',
 'seats_number': 6,
 'seller_name': None,
 'title': 'NISSAN NV300 Combi 6 2.0dCi 88kW L1H1 1T Optima',
 'transmission': 'manual',
 'trim': 'Combi 6 2.0dCi 88kW L1H1 1T Optima',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986753%27 HTTP/1.1" 200 None
2026-03-27 13:32:28 [ayvens.es] INFO: Saving data for 1986753: {'created_time': 1774618348.163262, 'last_price_update_time': 1774618348.163274, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986753') HTTP/1.1" 204 0
2026-03-27 13:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 590d4b35-c670-55a3-b53f-f8626340876f with identifier: 1986754
2026-03-27 13:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 590d4b35-c670-55a3-b53f-f8626340876f with identifier: 1986754
2026-03-27 13:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 590d4b35-c670-55a3-b53f-f8626340876f with identifier: 1986754 to the API
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/170/d7045fa6780e41f78a142de55b8597cd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '590d4b35-c670-55a3-b53f-f8626340876f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 51234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_590d4b35-c670-55a3-b53f-f8626340876f/590d4b35-c670-55a3-b53f-f8626340876f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/170/d7045fa6780e41f78a142de55b8597cd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986754%27 HTTP/1.1" 200 None
2026-03-27 13:32:28 [ayvens.es] INFO: Saving data for 1986754: {'created_time': 1774618348.554771, 'last_price_update_time': 1774618348.55478, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986754') HTTP/1.1" 204 0
2026-03-27 13:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 82576d07-fc62-52a9-a4e5-1e06986c719d with identifier: 1986755
2026-03-27 13:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 82576d07-fc62-52a9-a4e5-1e06986c719d with identifier: 1986755
2026-03-27 13:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 82576d07-fc62-52a9-a4e5-1e06986c719d with identifier: 1986755 to the API
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/484/f4c73190c75f4dafa807b6b3f04668ba/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '82576d07-fc62-52a9-a4e5-1e06986c719d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 172549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82576d07-fc62-52a9-a4e5-1e06986c719d/82576d07-fc62-52a9-a4e5-1e06986c719d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/484/f4c73190c75f4dafa807b6b3f04668ba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986755%27 HTTP/1.1" 200 None
2026-03-27 13:32:28 [ayvens.es] INFO: Saving data for 1986755: {'created_time': 1774618348.89193, 'last_price_update_time': 1774618348.891996, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986755') HTTP/1.1" 204 0
2026-03-27 13:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/468/79b399eba1a1432c8159918f1de7d00e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:28 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-27 13:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297943f50>
2026-03-27 13:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dae128f-8dbd-5cea-a840-33deeadeaa9b/8dae128f-8dbd-5cea-a840-33deeadeaa9b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252F9950327126dc43ba837b2c987653ebb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/9950327126dc43ba837b2c987653ebb7/images/large/1.jpg saved to cache
2026-03-27 13:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b
2026-03-27 13:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8dae128f-8dbd-5cea-a840-33deeadeaa9b, skipping ID generation
2026-03-27 13:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b with scrape type 1
2026-03-27 13:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b sending to next pipeline
2026-03-27 13:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8dae128f-8dbd-5cea-a840-33deeadeaa9b, identifier: 1986756
2026-03-27 13:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bf1f10>
2026-03-27 13:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec4cd7ed-1744-502f-b328-5f33a533167a/ec4cd7ed-1744-502f-b328-5f33a533167a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252Fea23c29b76a24852a5a806c3ecf307d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/ea23c29b76a24852a5a806c3ecf307d0/images/large/1.jpg saved to cache
2026-03-27 13:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec4cd7ed-1744-502f-b328-5f33a533167a
2026-03-27 13:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec4cd7ed-1744-502f-b328-5f33a533167a, skipping ID generation
2026-03-27 13:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4cd7ed-1744-502f-b328-5f33a533167a with scrape type 1
2026-03-27 13:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec4cd7ed-1744-502f-b328-5f33a533167a sending to next pipeline
2026-03-27 13:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ec4cd7ed-1744-502f-b328-5f33a533167a, identifier: 1986757
2026-03-27 13:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8dae128f-8dbd-5cea-a840-33deeadeaa9b with identifier: 1986756
2026-03-27 13:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8dae128f-8dbd-5cea-a840-33deeadeaa9b with identifier: 1986756
2026-03-27 13:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8dae128f-8dbd-5cea-a840-33deeadeaa9b with identifier: 1986756 to the API
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/024/9950327126dc43ba837b2c987653ebb7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8dae128f-8dbd-5cea-a840-33deeadeaa9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 242299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dae128f-8dbd-5cea-a840-33deeadeaa9b/8dae128f-8dbd-5cea-a840-33deeadeaa9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/9950327126dc43ba837b2c987653ebb7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Sp. T. Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Sp. T. Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986756%27 HTTP/1.1" 200 None
2026-03-27 13:32:29 [ayvens.es] INFO: Saving data for 1986756: {'created_time': 1774618349.581894, 'last_price_update_time': 1774618349.581904, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986756') HTTP/1.1" 204 0
2026-03-27 13:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ec4cd7ed-1744-502f-b328-5f33a533167a with identifier: 1986757
2026-03-27 13:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ec4cd7ed-1744-502f-b328-5f33a533167a with identifier: 1986757
2026-03-27 13:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ec4cd7ed-1744-502f-b328-5f33a533167a with identifier: 1986757 to the API
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/809/ea23c29b76a24852a5a806c3ecf307d0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ec4cd7ed-1744-502f-b328-5f33a533167a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 107298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec4cd7ed-1744-502f-b328-5f33a533167a/ec4cd7ed-1744-502f-b328-5f33a533167a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/809/ea23c29b76a24852a5a806c3ecf307d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PureTech 96KW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.2 PureTech 96KW (130CV) S&S Allure',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986757%27 HTTP/1.1" 200 None
2026-03-27 13:32:29 [ayvens.es] INFO: Saving data for 1986757: {'created_time': 1774618349.900972, 'last_price_update_time': 1774618349.900982, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986757') HTTP/1.1" 204 0
2026-03-27 13:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 13:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/688/f92b3b38ca3d457bb94f50ce3cec648e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/900/94c35e8fb3db4147ab98ed8860203f07/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956e8650>
2026-03-27 13:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d09e721-a595-5d2e-967a-89a270e45bd6/8d09e721-a595-5d2e-967a-89a270e45bd6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F468%252F79b399eba1a1432c8159918f1de7d00e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/468/79b399eba1a1432c8159918f1de7d00e/images/large/1.jpg saved to cache
2026-03-27 13:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d09e721-a595-5d2e-967a-89a270e45bd6
2026-03-27 13:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d09e721-a595-5d2e-967a-89a270e45bd6, skipping ID generation
2026-03-27 13:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d09e721-a595-5d2e-967a-89a270e45bd6 with scrape type 1
2026-03-27 13:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d09e721-a595-5d2e-967a-89a270e45bd6 sending to next pipeline
2026-03-27 13:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8d09e721-a595-5d2e-967a-89a270e45bd6, identifier: 1986758
2026-03-27 13:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8d09e721-a595-5d2e-967a-89a270e45bd6 with identifier: 1986758
2026-03-27 13:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8d09e721-a595-5d2e-967a-89a270e45bd6 with identifier: 1986758
2026-03-27 13:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8d09e721-a595-5d2e-967a-89a270e45bd6 with identifier: 1986758 to the API
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/468/79b399eba1a1432c8159918f1de7d00e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d09e721-a595-5d2e-967a-89a270e45bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 139045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d09e721-a595-5d2e-967a-89a270e45bd6/8d09e721-a595-5d2e-967a-89a270e45bd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/468/79b399eba1a1432c8159918f1de7d00e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986758%27 HTTP/1.1" 200 None
2026-03-27 13:32:30 [ayvens.es] INFO: Saving data for 1986758: {'created_time': 1774618350.388486, 'last_price_update_time': 1774618350.388497, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986758') HTTP/1.1" 204 0
2026-03-27 13:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/190/23fcbc3160a84aac96719f01447f568a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1cf90>
2026-03-27 13:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2/cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252Ff92b3b38ca3d457bb94f50ce3cec648e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/f92b3b38ca3d457bb94f50ce3cec648e/images/large/1.jpg saved to cache
2026-03-27 13:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2
2026-03-27 13:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2, skipping ID generation
2026-03-27 13:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2 with scrape type 1
2026-03-27 13:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2 sending to next pipeline
2026-03-27 13:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2, identifier: 1986759
2026-03-27 13:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297b1fa50>
2026-03-27 13:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce73904d-6be0-53b1-acc8-2805c7d91380/ce73904d-6be0-53b1-acc8-2805c7d91380_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F900%252F94c35e8fb3db4147ab98ed8860203f07%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/900/94c35e8fb3db4147ab98ed8860203f07/images/large/1.jpg saved to cache
2026-03-27 13:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce73904d-6be0-53b1-acc8-2805c7d91380
2026-03-27 13:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce73904d-6be0-53b1-acc8-2805c7d91380, skipping ID generation
2026-03-27 13:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce73904d-6be0-53b1-acc8-2805c7d91380 with scrape type 1
2026-03-27 13:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce73904d-6be0-53b1-acc8-2805c7d91380 sending to next pipeline
2026-03-27 13:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce73904d-6be0-53b1-acc8-2805c7d91380, identifier: 1986760
2026-03-27 13:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2 with identifier: 1986759
2026-03-27 13:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2 with identifier: 1986759
2026-03-27 13:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2 with identifier: 1986759 to the API
2026-03-27 13:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/688/f92b3b38ca3d457bb94f50ce3cec648e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 66151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2/cea5f8b9-39b5-5db7-b100-1c02b9fcc0e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/688/f92b3b38ca3d457bb94f50ce3cec648e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986759%27 HTTP/1.1" 200 None
2026-03-27 13:32:31 [ayvens.es] INFO: Saving data for 1986759: {'created_time': 1774618351.338386, 'last_price_update_time': 1774618351.338399, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986759') HTTP/1.1" 204 0
2026-03-27 13:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce73904d-6be0-53b1-acc8-2805c7d91380 with identifier: 1986760
2026-03-27 13:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce73904d-6be0-53b1-acc8-2805c7d91380 with identifier: 1986760
2026-03-27 13:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce73904d-6be0-53b1-acc8-2805c7d91380 with identifier: 1986760 to the API
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/900/94c35e8fb3db4147ab98ed8860203f07/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce73904d-6be0-53b1-acc8-2805c7d91380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 CACTUS',
 'odometer': 207938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce73904d-6be0-53b1-acc8-2805c7d91380/ce73904d-6be0-53b1-acc8-2805c7d91380_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/900/94c35e8fb3db4147ab98ed8860203f07/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 CACTUS BlueHDi 100 S&S Shine',
 'transmission': 'manual',
 'trim': 'BlueHDi 100 S&S Shine',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986760%27 HTTP/1.1" 200 None
2026-03-27 13:32:31 [ayvens.es] INFO: Saving data for 1986760: {'created_time': 1774618351.773599, 'last_price_update_time': 1774618351.773609, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986760') HTTP/1.1" 204 0
2026-03-27 13:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/d714886e2cf04b6c89feec46e00cad87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957ad810>
2026-03-27 13:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a16c1ba-085f-58d2-9346-37c788ad93d7/5a16c1ba-085f-58d2-9346-37c788ad93d7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F190%252F23fcbc3160a84aac96719f01447f568a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/190/23fcbc3160a84aac96719f01447f568a/images/large/1.jpg saved to cache
2026-03-27 13:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a16c1ba-085f-58d2-9346-37c788ad93d7
2026-03-27 13:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a16c1ba-085f-58d2-9346-37c788ad93d7, skipping ID generation
2026-03-27 13:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a16c1ba-085f-58d2-9346-37c788ad93d7 with scrape type 1
2026-03-27 13:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a16c1ba-085f-58d2-9346-37c788ad93d7 sending to next pipeline
2026-03-27 13:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5a16c1ba-085f-58d2-9346-37c788ad93d7, identifier: 1986762
2026-03-27 13:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/442/3043d08ac1c84e54b1bb74606e9e15e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5a16c1ba-085f-58d2-9346-37c788ad93d7 with identifier: 1986762
2026-03-27 13:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5a16c1ba-085f-58d2-9346-37c788ad93d7 with identifier: 1986762
2026-03-27 13:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5a16c1ba-085f-58d2-9346-37c788ad93d7 with identifier: 1986762 to the API
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/190/23fcbc3160a84aac96719f01447f568a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5a16c1ba-085f-58d2-9346-37c788ad93d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 83458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a16c1ba-085f-58d2-9346-37c788ad93d7/5a16c1ba-085f-58d2-9346-37c788ad93d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/190/23fcbc3160a84aac96719f01447f568a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986762%27 HTTP/1.1" 200 None
2026-03-27 13:32:32 [ayvens.es] INFO: Saving data for 1986762: {'created_time': 1774618352.344291, 'last_price_update_time': 1774618352.344302, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986762') HTTP/1.1" 204 0
2026-03-27 13:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295744210>
2026-03-27 13:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5b7422-53f8-5a18-8074-b88e9a465f74/9d5b7422-53f8-5a18-8074-b88e9a465f74_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252Fd714886e2cf04b6c89feec46e00cad87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/d714886e2cf04b6c89feec46e00cad87/images/large/1.jpg saved to cache
2026-03-27 13:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d5b7422-53f8-5a18-8074-b88e9a465f74
2026-03-27 13:32:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d5b7422-53f8-5a18-8074-b88e9a465f74, skipping ID generation
2026-03-27 13:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5b7422-53f8-5a18-8074-b88e9a465f74 with scrape type 1
2026-03-27 13:32:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d5b7422-53f8-5a18-8074-b88e9a465f74 sending to next pipeline
2026-03-27 13:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d5b7422-53f8-5a18-8074-b88e9a465f74, identifier: 1986763
2026-03-27 13:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529611ca90>
2026-03-27 13:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13130dfd-bbfd-52b9-a434-38e047dee08c/13130dfd-bbfd-52b9-a434-38e047dee08c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252F3043d08ac1c84e54b1bb74606e9e15e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/3043d08ac1c84e54b1bb74606e9e15e7/images/large/1.jpg saved to cache
2026-03-27 13:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13130dfd-bbfd-52b9-a434-38e047dee08c
2026-03-27 13:32:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13130dfd-bbfd-52b9-a434-38e047dee08c, skipping ID generation
2026-03-27 13:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13130dfd-bbfd-52b9-a434-38e047dee08c with scrape type 1
2026-03-27 13:32:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13130dfd-bbfd-52b9-a434-38e047dee08c sending to next pipeline
2026-03-27 13:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13130dfd-bbfd-52b9-a434-38e047dee08c, identifier: 1986761
2026-03-27 13:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d5b7422-53f8-5a18-8074-b88e9a465f74 with identifier: 1986763
2026-03-27 13:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d5b7422-53f8-5a18-8074-b88e9a465f74 with identifier: 1986763
2026-03-27 13:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d5b7422-53f8-5a18-8074-b88e9a465f74 with identifier: 1986763 to the API
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/d714886e2cf04b6c89feec46e00cad87/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9d5b7422-53f8-5a18-8074-b88e9a465f74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 61617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b7422-53f8-5a18-8074-b88e9a465f74/9d5b7422-53f8-5a18-8074-b88e9a465f74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/d714886e2cf04b6c89feec46e00cad87/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986763%27 HTTP/1.1" 200 None
2026-03-27 13:32:33 [ayvens.es] INFO: Saving data for 1986763: {'created_time': 1774618353.03644, 'last_price_update_time': 1774618353.03645, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986763') HTTP/1.1" 204 0
2026-03-27 13:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13130dfd-bbfd-52b9-a434-38e047dee08c with identifier: 1986761
2026-03-27 13:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13130dfd-bbfd-52b9-a434-38e047dee08c with identifier: 1986761
2026-03-27 13:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13130dfd-bbfd-52b9-a434-38e047dee08c with identifier: 1986761 to the API
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/442/3043d08ac1c84e54b1bb74606e9e15e7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '13130dfd-bbfd-52b9-a434-38e047dee08c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 130698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13130dfd-bbfd-52b9-a434-38e047dee08c/13130dfd-bbfd-52b9-a434-38e047dee08c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/442/3043d08ac1c84e54b1bb74606e9e15e7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Allure Pack BlueHDi 100 S&S',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 100 S&S',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986761%27 HTTP/1.1" 200 None
2026-03-27 13:32:33 [ayvens.es] INFO: Saving data for 1986761: {'created_time': 1774618353.388545, 'last_price_update_time': 1774618353.388556, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986761') HTTP/1.1" 204 0
2026-03-27 13:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 13:32:33 [ayvens.es] INFO: Found listing with ID: 1986764
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986764%27 HTTP/1.1" 200 None
2026-03-27 13:32:33 [ayvens.es] INFO: Scrape type for 1986764: 1
2026-03-27 13:32:33 [ayvens.es] INFO: Extracting data for car ID: 1986764
2026-03-27 13:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 447f9435-365a-5fbc-a299-9e91cab52b3b with identifier: 1986764
2026-03-27 13:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 447f9435-365a-5fbc-a299-9e91cab52b3b with scrape type 1
2026-03-27 13:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 447f9435-365a-5fbc-a299-9e91cab52b3b
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252Fd054de351c1a408ab81351ae1cc64306%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/d054de351c1a408ab81351ae1cc64306/images/large/1.jpg not downloaded yet
2026-03-27 13:32:33 [ayvens.es] INFO: Found listing with ID: 1986765
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986765%27 HTTP/1.1" 200 None
2026-03-27 13:32:33 [ayvens.es] INFO: Scrape type for 1986765: 1
2026-03-27 13:32:33 [ayvens.es] INFO: Extracting data for car ID: 1986765
2026-03-27 13:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedc4409-132b-59db-8b66-f636eac0847b with identifier: 1986765
2026-03-27 13:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedc4409-132b-59db-8b66-f636eac0847b with scrape type 1
2026-03-27 13:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bedc4409-132b-59db-8b66-f636eac0847b
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252Ff24b37eb4b4644228ca31e025e293857%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/f24b37eb4b4644228ca31e025e293857/images/large/1.jpg not downloaded yet
2026-03-27 13:32:33 [ayvens.es] INFO: Found listing with ID: 1986766
2026-03-27 13:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986766%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986766: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986766
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01d106c-403b-5c49-b263-ad1858a4a4a8 with identifier: 1986766
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01d106c-403b-5c49-b263-ad1858a4a4a8 with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b01d106c-403b-5c49-b263-ad1858a4a4a8
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F176%252F8d5a5c1edd214e6fb00fb875eaee64fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/176/8d5a5c1edd214e6fb00fb875eaee64fd/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986767
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986767%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986767: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986767
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 482ca8c0-a7e5-52f9-9152-6e52b826e11e with identifier: 1986767
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F664%252F8962c5c0d5274608ab7c29de0cc70dbe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/664/8962c5c0d5274608ab7c29de0cc70dbe/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986768
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986768%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986768: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986768
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c207c2-537f-53fe-a9a2-b20fdf625c1f with identifier: 1986768
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F7dd29daa5ed44afa9b785915a748e94a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/7dd29daa5ed44afa9b785915a748e94a/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986769
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986769%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986769: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986769
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3cfd07f-c099-5d4c-bafe-35231e56d553 with identifier: 1986769
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cfd07f-c099-5d4c-bafe-35231e56d553 with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b3cfd07f-c099-5d4c-bafe-35231e56d553
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F84d8e54e782e42de91318a38fae343b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/84d8e54e782e42de91318a38fae343b1/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986770
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986770%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986770: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986770
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3666e0c-5702-51a1-826a-6eedae99f80e with identifier: 1986770
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3666e0c-5702-51a1-826a-6eedae99f80e with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3666e0c-5702-51a1-826a-6eedae99f80e
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252Fb0f1aa546af84a188ffc959edc2a3f44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/b0f1aa546af84a188ffc959edc2a3f44/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986771
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986771%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986771: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986771
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65f88244-e9ab-557d-8740-d10b0511aa5d with identifier: 1986771
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65f88244-e9ab-557d-8740-d10b0511aa5d with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 65f88244-e9ab-557d-8740-d10b0511aa5d
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F5da6e1f7d743497dbd7f65954947c1f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/5da6e1f7d743497dbd7f65954947c1f4/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986772
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986772%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986772: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986772
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49375de9-50da-5dfd-98e4-1562049e5ce4 with identifier: 1986772
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49375de9-50da-5dfd-98e4-1562049e5ce4 with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49375de9-50da-5dfd-98e4-1562049e5ce4
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252Fc59ef78274574fb8ae029f23890ce063%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/c59ef78274574fb8ae029f23890ce063/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986773
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986773%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986773: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986773
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 199744cc-2ef1-511e-a719-c67e6cb784d1 with identifier: 1986773
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199744cc-2ef1-511e-a719-c67e6cb784d1 with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 199744cc-2ef1-511e-a719-c67e6cb784d1
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252Fa7808ce6d36b431ea7c50fdd48f3eeee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/a7808ce6d36b431ea7c50fdd48f3eeee/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986774
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986774%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986774: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986774
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c580f71-6565-54e3-ad78-7822755cd3da with identifier: 1986774
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c580f71-6565-54e3-ad78-7822755cd3da with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9c580f71-6565-54e3-ad78-7822755cd3da
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Fa715760282764dbf8a3d8b9c41b36ed5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/a715760282764dbf8a3d8b9c41b36ed5/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986775
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986775%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986775: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986775
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with identifier: 1986775
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252F0413575fb5bc4117863e1649fc39cb57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/0413575fb5bc4117863e1649fc39cb57/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/664/8962c5c0d5274608ab7c29de0cc70dbe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986776
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986776%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986776: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986776
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with identifier: 1986776
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252F137631e916b948c88dd384109b1cedb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/137631e916b948c88dd384109b1cedb7/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/654/7dd29daa5ed44afa9b785915a748e94a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986777
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986777%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986777: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986777
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38823773-392b-522a-b2a7-e65a8160e2f0 with identifier: 1986777
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38823773-392b-522a-b2a7-e65a8160e2f0 with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 38823773-392b-522a-b2a7-e65a8160e2f0
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F132%252F8eb5ce05400a48d6accad574b956bc05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/132/8eb5ce05400a48d6accad574b956bc05/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/047/f24b37eb4b4644228ca31e025e293857/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986778
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986778%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986778: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986778
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 863b9025-9466-52bd-9980-e713cf406fb5 with identifier: 1986778
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863b9025-9466-52bd-9980-e713cf406fb5 with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 863b9025-9466-52bd-9980-e713cf406fb5
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F515%252F05f2525296a54d2c8430356d8c0ce125%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/515/05f2525296a54d2c8430356d8c0ce125/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/176/8d5a5c1edd214e6fb00fb875eaee64fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/562/84d8e54e782e42de91318a38fae343b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/887/d054de351c1a408ab81351ae1cc64306/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:34 [ayvens.es] INFO: Found listing with ID: 1986779
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986779%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [ayvens.es] INFO: Scrape type for 1986779: 1
2026-03-27 13:32:34 [ayvens.es] INFO: Extracting data for car ID: 1986779
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34758461-cad7-5f80-b2d2-a455258444fa with identifier: 1986779
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34758461-cad7-5f80-b2d2-a455258444fa with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 34758461-cad7-5f80-b2d2-a455258444fa
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F919%252Fd2fc624340b444d0823606f1aa1b8283%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/919/d2fc624340b444d0823606f1aa1b8283/images/large/1.jpg not downloaded yet
2026-03-27 13:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956e8310>
2026-03-27 13:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482ca8c0-a7e5-52f9-9152-6e52b826e11e/482ca8c0-a7e5-52f9-9152-6e52b826e11e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F664%252F8962c5c0d5274608ab7c29de0cc70dbe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/664/8962c5c0d5274608ab7c29de0cc70dbe/images/large/1.jpg saved to cache
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e
2026-03-27 13:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 482ca8c0-a7e5-52f9-9152-6e52b826e11e, skipping ID generation
2026-03-27 13:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e with scrape type 1
2026-03-27 13:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e sending to next pipeline
2026-03-27 13:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 482ca8c0-a7e5-52f9-9152-6e52b826e11e, identifier: 1986767
2026-03-27 13:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4f8d0>
2026-03-27 13:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c207c2-537f-53fe-a9a2-b20fdf625c1f/b5c207c2-537f-53fe-a9a2-b20fdf625c1f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F7dd29daa5ed44afa9b785915a748e94a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/7dd29daa5ed44afa9b785915a748e94a/images/large/1.jpg saved to cache
2026-03-27 13:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f
2026-03-27 13:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5c207c2-537f-53fe-a9a2-b20fdf625c1f, skipping ID generation
2026-03-27 13:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f with scrape type 1
2026-03-27 13:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f sending to next pipeline
2026-03-27 13:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5c207c2-537f-53fe-a9a2-b20fdf625c1f, identifier: 1986768
2026-03-27 13:32:35 [ayvens.es] INFO: Found listing with ID: 1986780
2026-03-27 13:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986780%27 HTTP/1.1" 200 None
2026-03-27 13:32:35 [ayvens.es] INFO: Scrape type for 1986780: 1
2026-03-27 13:32:35 [ayvens.es] INFO: Extracting data for car ID: 1986780
2026-03-27 13:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a040e3-5348-5d21-b1a6-d60f79cfc765 with identifier: 1986780
2026-03-27 13:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a040e3-5348-5d21-b1a6-d60f79cfc765 with scrape type 1
2026-03-27 13:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 65a040e3-5348-5d21-b1a6-d60f79cfc765
2026-03-27 13:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F814%252F64461733b4644ee790fbee0463e7eedd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/814/64461733b4644ee790fbee0463e7eedd/images/large/1.jpg not downloaded yet
2026-03-27 13:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 482ca8c0-a7e5-52f9-9152-6e52b826e11e with identifier: 1986767
2026-03-27 13:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 482ca8c0-a7e5-52f9-9152-6e52b826e11e with identifier: 1986767
2026-03-27 13:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 482ca8c0-a7e5-52f9-9152-6e52b826e11e with identifier: 1986767 to the API
2026-03-27 13:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/664/8962c5c0d5274608ab7c29de0cc70dbe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '482ca8c0-a7e5-52f9-9152-6e52b826e11e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 61075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482ca8c0-a7e5-52f9-9152-6e52b826e11e/482ca8c0-a7e5-52f9-9152-6e52b826e11e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/664/8962c5c0d5274608ab7c29de0cc70dbe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986767%27 HTTP/1.1" 200 None
2026-03-27 13:32:36 [ayvens.es] INFO: Saving data for 1986767: {'created_time': 1774618356.258823, 'last_price_update_time': 1774618356.258833, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986767') HTTP/1.1" 204 0
2026-03-27 13:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5c207c2-537f-53fe-a9a2-b20fdf625c1f with identifier: 1986768
2026-03-27 13:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5c207c2-537f-53fe-a9a2-b20fdf625c1f with identifier: 1986768
2026-03-27 13:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5c207c2-537f-53fe-a9a2-b20fdf625c1f with identifier: 1986768 to the API
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/654/7dd29daa5ed44afa9b785915a748e94a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5c207c2-537f-53fe-a9a2-b20fdf625c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 111130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5c207c2-537f-53fe-a9a2-b20fdf625c1f/b5c207c2-537f-53fe-a9a2-b20fdf625c1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/654/7dd29daa5ed44afa9b785915a748e94a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986768%27 HTTP/1.1" 200 None
2026-03-27 13:32:36 [ayvens.es] INFO: Saving data for 1986768: {'created_time': 1774618356.668131, 'last_price_update_time': 1774618356.668142, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986768') HTTP/1.1" 204 0
2026-03-27 13:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962cb150>
2026-03-27 13:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bedc4409-132b-59db-8b66-f636eac0847b/bedc4409-132b-59db-8b66-f636eac0847b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252Ff24b37eb4b4644228ca31e025e293857%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/f24b37eb4b4644228ca31e025e293857/images/large/1.jpg saved to cache
2026-03-27 13:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bedc4409-132b-59db-8b66-f636eac0847b
2026-03-27 13:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bedc4409-132b-59db-8b66-f636eac0847b, skipping ID generation
2026-03-27 13:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedc4409-132b-59db-8b66-f636eac0847b with scrape type 1
2026-03-27 13:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bedc4409-132b-59db-8b66-f636eac0847b sending to next pipeline
2026-03-27 13:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bedc4409-132b-59db-8b66-f636eac0847b, identifier: 1986765
2026-03-27 13:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/533/c59ef78274574fb8ae029f23890ce063/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:36 [ayvens.es] INFO: Found listing with ID: 1986781
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986781%27 HTTP/1.1" 200 None
2026-03-27 13:32:36 [ayvens.es] INFO: Scrape type for 1986781: 1
2026-03-27 13:32:36 [ayvens.es] INFO: Extracting data for car ID: 1986781
2026-03-27 13:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with identifier: 1986781
2026-03-27 13:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with scrape type 1
2026-03-27 13:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252Fd6403b6a502f4608b077900c1cda571f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/d6403b6a502f4608b077900c1cda571f/images/large/1.jpg not downloaded yet
2026-03-27 13:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bedc4409-132b-59db-8b66-f636eac0847b with identifier: 1986765
2026-03-27 13:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bedc4409-132b-59db-8b66-f636eac0847b with identifier: 1986765
2026-03-27 13:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bedc4409-132b-59db-8b66-f636eac0847b with identifier: 1986765 to the API
2026-03-27 13:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/047/f24b37eb4b4644228ca31e025e293857/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bedc4409-132b-59db-8b66-f636eac0847b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 20451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bedc4409-132b-59db-8b66-f636eac0847b/bedc4409-132b-59db-8b66-f636eac0847b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/047/f24b37eb4b4644228ca31e025e293857/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 BlueHDi 96kW auto. Etoile Alcantara@',
 'transmission': 'manual',
 'trim': 'BlueHDi 96kW auto. Etoile Alcantara@',
 'vin': None,
 'year': 2024}
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986765%27 HTTP/1.1" 200 None
2026-03-27 13:32:37 [ayvens.es] INFO: Saving data for 1986765: {'created_time': 1774618357.197034, 'last_price_update_time': 1774618357.197045, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986765') HTTP/1.1" 204 0
2026-03-27 13:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/5da6e1f7d743497dbd7f65954947c1f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/013/a7808ce6d36b431ea7c50fdd48f3eeee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/763/b0f1aa546af84a188ffc959edc2a3f44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:37 [ayvens.es] INFO: Found listing with ID: 1986782
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986782%27 HTTP/1.1" 200 None
2026-03-27 13:32:37 [ayvens.es] INFO: Scrape type for 1986782: 1
2026-03-27 13:32:37 [ayvens.es] INFO: Extracting data for car ID: 1986782
2026-03-27 13:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27bb782-92d2-5e5b-a62f-649b59376be9 with identifier: 1986782
2026-03-27 13:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27bb782-92d2-5e5b-a62f-649b59376be9 with scrape type 1
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a27bb782-92d2-5e5b-a62f-649b59376be9
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F830%252Ffbea617b73e245219df8261e44d13748%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/830/fbea617b73e245219df8261e44d13748/images/large/1.jpg not downloaded yet
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295be4e50>
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01d106c-403b-5c49-b263-ad1858a4a4a8/b01d106c-403b-5c49-b263-ad1858a4a4a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F176%252F8d5a5c1edd214e6fb00fb875eaee64fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/176/8d5a5c1edd214e6fb00fb875eaee64fd/images/large/1.jpg saved to cache
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b01d106c-403b-5c49-b263-ad1858a4a4a8
2026-03-27 13:32:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b01d106c-403b-5c49-b263-ad1858a4a4a8, skipping ID generation
2026-03-27 13:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01d106c-403b-5c49-b263-ad1858a4a4a8 with scrape type 1
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b01d106c-403b-5c49-b263-ad1858a4a4a8 sending to next pipeline
2026-03-27 13:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b01d106c-403b-5c49-b263-ad1858a4a4a8, identifier: 1986766
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529615e990>
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3cfd07f-c099-5d4c-bafe-35231e56d553/b3cfd07f-c099-5d4c-bafe-35231e56d553_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F84d8e54e782e42de91318a38fae343b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/84d8e54e782e42de91318a38fae343b1/images/large/1.jpg saved to cache
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3cfd07f-c099-5d4c-bafe-35231e56d553
2026-03-27 13:32:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3cfd07f-c099-5d4c-bafe-35231e56d553, skipping ID generation
2026-03-27 13:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cfd07f-c099-5d4c-bafe-35231e56d553 with scrape type 1
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3cfd07f-c099-5d4c-bafe-35231e56d553 sending to next pipeline
2026-03-27 13:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b3cfd07f-c099-5d4c-bafe-35231e56d553, identifier: 1986769
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f30350>
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_447f9435-365a-5fbc-a299-9e91cab52b3b/447f9435-365a-5fbc-a299-9e91cab52b3b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252Fd054de351c1a408ab81351ae1cc64306%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/d054de351c1a408ab81351ae1cc64306/images/large/1.jpg saved to cache
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 447f9435-365a-5fbc-a299-9e91cab52b3b
2026-03-27 13:32:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 447f9435-365a-5fbc-a299-9e91cab52b3b, skipping ID generation
2026-03-27 13:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 447f9435-365a-5fbc-a299-9e91cab52b3b with scrape type 1
2026-03-27 13:32:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 447f9435-365a-5fbc-a299-9e91cab52b3b sending to next pipeline
2026-03-27 13:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 447f9435-365a-5fbc-a299-9e91cab52b3b, identifier: 1986764
2026-03-27 13:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b01d106c-403b-5c49-b263-ad1858a4a4a8 with identifier: 1986766
2026-03-27 13:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b01d106c-403b-5c49-b263-ad1858a4a4a8 with identifier: 1986766
2026-03-27 13:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b01d106c-403b-5c49-b263-ad1858a4a4a8 with identifier: 1986766 to the API
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/176/8d5a5c1edd214e6fb00fb875eaee64fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b01d106c-403b-5c49-b263-ad1858a4a4a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 102232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01d106c-403b-5c49-b263-ad1858a4a4a8/b01d106c-403b-5c49-b263-ad1858a4a4a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/176/8d5a5c1edd214e6fb00fb875eaee64fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986766%27 HTTP/1.1" 200 None
2026-03-27 13:32:38 [ayvens.es] INFO: Saving data for 1986766: {'created_time': 1774618358.081434, 'last_price_update_time': 1774618358.081445, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986766') HTTP/1.1" 204 0
2026-03-27 13:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b3cfd07f-c099-5d4c-bafe-35231e56d553 with identifier: 1986769
2026-03-27 13:32:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b3cfd07f-c099-5d4c-bafe-35231e56d553 with identifier: 1986769
2026-03-27 13:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b3cfd07f-c099-5d4c-bafe-35231e56d553 with identifier: 1986769 to the API
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/562/84d8e54e782e42de91318a38fae343b1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Corporativo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3cfd07f-c099-5d4c-bafe-35231e56d553',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 117432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3cfd07f-c099-5d4c-bafe-35231e56d553/b3cfd07f-c099-5d4c-bafe-35231e56d553_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/562/84d8e54e782e42de91318a38fae343b1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2018}
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986769%27 HTTP/1.1" 200 None
2026-03-27 13:32:38 [ayvens.es] INFO: Saving data for 1986769: {'created_time': 1774618358.425053, 'last_price_update_time': 1774618358.425062, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986769') HTTP/1.1" 204 0
2026-03-27 13:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 447f9435-365a-5fbc-a299-9e91cab52b3b with identifier: 1986764
2026-03-27 13:32:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 447f9435-365a-5fbc-a299-9e91cab52b3b with identifier: 1986764
2026-03-27 13:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 447f9435-365a-5fbc-a299-9e91cab52b3b with identifier: 1986764 to the API
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/887/d054de351c1a408ab81351ae1cc64306/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Enigmatic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '447f9435-365a-5fbc-a299-9e91cab52b3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 48821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_447f9435-365a-5fbc-a299-9e91cab52b3b/447f9435-365a-5fbc-a299-9e91cab52b3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/887/d054de351c1a408ab81351ae1cc64306/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986764%27 HTTP/1.1" 200 None
2026-03-27 13:32:38 [ayvens.es] INFO: Saving data for 1986764: {'created_time': 1774618358.765843, 'last_price_update_time': 1774618358.765857, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986764') HTTP/1.1" 204 0
2026-03-27 13:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/067/137631e916b948c88dd384109b1cedb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/132/8eb5ce05400a48d6accad574b956bc05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:38 [ayvens.es] INFO: Found listing with ID: 1986783
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986783%27 HTTP/1.1" 200 None
2026-03-27 13:32:38 [ayvens.es] INFO: Scrape type for 1986783: 1
2026-03-27 13:32:38 [ayvens.es] INFO: Extracting data for car ID: 1986783
2026-03-27 13:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7dc57b-6600-5d1b-9eb3-2847598672fd with identifier: 1986783
2026-03-27 13:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd with scrape type 1
2026-03-27 13:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F078%252Fea924dd3b2a04f31bfefa3de172867ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/078/ea924dd3b2a04f31bfefa3de172867ce/images/large/1.jpg not downloaded yet
2026-03-27 13:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295741290>
2026-03-27 13:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49375de9-50da-5dfd-98e4-1562049e5ce4/49375de9-50da-5dfd-98e4-1562049e5ce4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252Fc59ef78274574fb8ae029f23890ce063%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/c59ef78274574fb8ae029f23890ce063/images/large/1.jpg saved to cache
2026-03-27 13:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49375de9-50da-5dfd-98e4-1562049e5ce4
2026-03-27 13:32:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49375de9-50da-5dfd-98e4-1562049e5ce4, skipping ID generation
2026-03-27 13:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49375de9-50da-5dfd-98e4-1562049e5ce4 with scrape type 1
2026-03-27 13:32:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49375de9-50da-5dfd-98e4-1562049e5ce4 sending to next pipeline
2026-03-27 13:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49375de9-50da-5dfd-98e4-1562049e5ce4, identifier: 1986772
2026-03-27 13:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49375de9-50da-5dfd-98e4-1562049e5ce4 with identifier: 1986772
2026-03-27 13:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49375de9-50da-5dfd-98e4-1562049e5ce4 with identifier: 1986772
2026-03-27 13:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49375de9-50da-5dfd-98e4-1562049e5ce4 with identifier: 1986772 to the API
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/533/c59ef78274574fb8ae029f23890ce063/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '49375de9-50da-5dfd-98e4-1562049e5ce4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 95817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49375de9-50da-5dfd-98e4-1562049e5ce4/49375de9-50da-5dfd-98e4-1562049e5ce4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/533/c59ef78274574fb8ae029f23890ce063/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) S/S Expression L',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) S/S Expression L',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986772%27 HTTP/1.1" 200 None
2026-03-27 13:32:39 [ayvens.es] INFO: Saving data for 1986772: {'created_time': 1774618359.383122, 'last_price_update_time': 1774618359.383133, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986772') HTTP/1.1" 204 0
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960a2910>
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65f88244-e9ab-557d-8740-d10b0511aa5d/65f88244-e9ab-557d-8740-d10b0511aa5d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F5da6e1f7d743497dbd7f65954947c1f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/5da6e1f7d743497dbd7f65954947c1f4/images/large/1.jpg saved to cache
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65f88244-e9ab-557d-8740-d10b0511aa5d
2026-03-27 13:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65f88244-e9ab-557d-8740-d10b0511aa5d, skipping ID generation
2026-03-27 13:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65f88244-e9ab-557d-8740-d10b0511aa5d with scrape type 1
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65f88244-e9ab-557d-8740-d10b0511aa5d sending to next pipeline
2026-03-27 13:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 65f88244-e9ab-557d-8740-d10b0511aa5d, identifier: 1986771
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957834d0>
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199744cc-2ef1-511e-a719-c67e6cb784d1/199744cc-2ef1-511e-a719-c67e6cb784d1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252Fa7808ce6d36b431ea7c50fdd48f3eeee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/a7808ce6d36b431ea7c50fdd48f3eeee/images/large/1.jpg saved to cache
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 199744cc-2ef1-511e-a719-c67e6cb784d1
2026-03-27 13:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 199744cc-2ef1-511e-a719-c67e6cb784d1, skipping ID generation
2026-03-27 13:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199744cc-2ef1-511e-a719-c67e6cb784d1 with scrape type 1
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 199744cc-2ef1-511e-a719-c67e6cb784d1 sending to next pipeline
2026-03-27 13:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 199744cc-2ef1-511e-a719-c67e6cb784d1, identifier: 1986773
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956d6110>
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3666e0c-5702-51a1-826a-6eedae99f80e/c3666e0c-5702-51a1-826a-6eedae99f80e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252Fb0f1aa546af84a188ffc959edc2a3f44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/b0f1aa546af84a188ffc959edc2a3f44/images/large/1.jpg saved to cache
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3666e0c-5702-51a1-826a-6eedae99f80e
2026-03-27 13:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3666e0c-5702-51a1-826a-6eedae99f80e, skipping ID generation
2026-03-27 13:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3666e0c-5702-51a1-826a-6eedae99f80e with scrape type 1
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3666e0c-5702-51a1-826a-6eedae99f80e sending to next pipeline
2026-03-27 13:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3666e0c-5702-51a1-826a-6eedae99f80e, identifier: 1986770
2026-03-27 13:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/420/0413575fb5bc4117863e1649fc39cb57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:39 [ayvens.es] INFO: Found listing with ID: 1986784
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986784%27 HTTP/1.1" 200 None
2026-03-27 13:32:39 [ayvens.es] INFO: Scrape type for 1986784: 1
2026-03-27 13:32:39 [ayvens.es] INFO: Extracting data for car ID: 1986784
2026-03-27 13:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with identifier: 1986784
2026-03-27 13:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with scrape type 1
2026-03-27 13:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F539%252F190372575a5645ac882d9b6070b105a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/539/190372575a5645ac882d9b6070b105a0/images/large/1.jpg not downloaded yet
2026-03-27 13:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 65f88244-e9ab-557d-8740-d10b0511aa5d with identifier: 1986771
2026-03-27 13:32:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 65f88244-e9ab-557d-8740-d10b0511aa5d with identifier: 1986771
2026-03-27 13:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 65f88244-e9ab-557d-8740-d10b0511aa5d with identifier: 1986771 to the API
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/5da6e1f7d743497dbd7f65954947c1f4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Cyber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '65f88244-e9ab-557d-8740-d10b0511aa5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 115463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65f88244-e9ab-557d-8740-d10b0511aa5d/65f88244-e9ab-557d-8740-d10b0511aa5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/5da6e1f7d743497dbd7f65954947c1f4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Klass DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Klass DCT',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986771%27 HTTP/1.1" 200 None
2026-03-27 13:32:40 [ayvens.es] INFO: Saving data for 1986771: {'created_time': 1774618360.341497, 'last_price_update_time': 1774618360.341507, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986771') HTTP/1.1" 204 0
2026-03-27 13:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 199744cc-2ef1-511e-a719-c67e6cb784d1 with identifier: 1986773
2026-03-27 13:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 199744cc-2ef1-511e-a719-c67e6cb784d1 with identifier: 1986773
2026-03-27 13:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 199744cc-2ef1-511e-a719-c67e6cb784d1 with identifier: 1986773 to the API
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/013/a7808ce6d36b431ea7c50fdd48f3eeee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '199744cc-2ef1-511e-a719-c67e6cb784d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 234263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199744cc-2ef1-511e-a719-c67e6cb784d1/199744cc-2ef1-511e-a719-c67e6cb784d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/013/a7808ce6d36b431ea7c50fdd48f3eeee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Zen Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Zen Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2017}
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986773%27 HTTP/1.1" 200 None
2026-03-27 13:32:40 [ayvens.es] INFO: Saving data for 1986773: {'created_time': 1774618360.68594, 'last_price_update_time': 1774618360.68595, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986773') HTTP/1.1" 204 0
2026-03-27 13:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3666e0c-5702-51a1-826a-6eedae99f80e with identifier: 1986770
2026-03-27 13:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3666e0c-5702-51a1-826a-6eedae99f80e with identifier: 1986770
2026-03-27 13:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3666e0c-5702-51a1-826a-6eedae99f80e with identifier: 1986770 to the API
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/763/b0f1aa546af84a188ffc959edc2a3f44/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c3666e0c-5702-51a1-826a-6eedae99f80e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 162045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3666e0c-5702-51a1-826a-6eedae99f80e/c3666e0c-5702-51a1-826a-6eedae99f80e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/763/b0f1aa546af84a188ffc959edc2a3f44/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': '(O) Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986770%27 HTTP/1.1" 200 None
2026-03-27 13:32:41 [ayvens.es] INFO: Saving data for 1986770: {'created_time': 1774618361.015417, 'last_price_update_time': 1774618361.015428, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986770') HTTP/1.1" 204 0
2026-03-27 13:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/365/a715760282764dbf8a3d8b9c41b36ed5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bd71d0>
2026-03-27 13:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1c9f2f-4411-57bd-a171-02822d7c7a1d/0b1c9f2f-4411-57bd-a171-02822d7c7a1d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252F137631e916b948c88dd384109b1cedb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/137631e916b948c88dd384109b1cedb7/images/large/1.jpg saved to cache
2026-03-27 13:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d
2026-03-27 13:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d, skipping ID generation
2026-03-27 13:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with scrape type 1
2026-03-27 13:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b1c9f2f-4411-57bd-a171-02822d7c7a1d sending to next pipeline
2026-03-27 13:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d, identifier: 1986776
2026-03-27 13:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957b5590>
2026-03-27 13:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38823773-392b-522a-b2a7-e65a8160e2f0/38823773-392b-522a-b2a7-e65a8160e2f0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F132%252F8eb5ce05400a48d6accad574b956bc05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/132/8eb5ce05400a48d6accad574b956bc05/images/large/1.jpg saved to cache
2026-03-27 13:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38823773-392b-522a-b2a7-e65a8160e2f0
2026-03-27 13:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38823773-392b-522a-b2a7-e65a8160e2f0, skipping ID generation
2026-03-27 13:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38823773-392b-522a-b2a7-e65a8160e2f0 with scrape type 1
2026-03-27 13:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38823773-392b-522a-b2a7-e65a8160e2f0 sending to next pipeline
2026-03-27 13:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 38823773-392b-522a-b2a7-e65a8160e2f0, identifier: 1986777
2026-03-27 13:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/515/05f2525296a54d2c8430356d8c0ce125/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:41 [ayvens.es] INFO: Found listing with ID: 1986785
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986785%27 HTTP/1.1" 200 None
2026-03-27 13:32:41 [ayvens.es] INFO: Scrape type for 1986785: 1
2026-03-27 13:32:41 [ayvens.es] INFO: Extracting data for car ID: 1986785
2026-03-27 13:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with identifier: 1986785
2026-03-27 13:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with scrape type 1
2026-03-27 13:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252F74aaf01ed8774b9db86cf1004b3c44ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/74aaf01ed8774b9db86cf1004b3c44ee/images/large/1.jpg not downloaded yet
2026-03-27 13:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with identifier: 1986776
2026-03-27 13:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with identifier: 1986776
2026-03-27 13:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0b1c9f2f-4411-57bd-a171-02822d7c7a1d with identifier: 1986776 to the API
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/067/137631e916b948c88dd384109b1cedb7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0b1c9f2f-4411-57bd-a171-02822d7c7a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 114903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1c9f2f-4411-57bd-a171-02822d7c7a1d/0b1c9f2f-4411-57bd-a171-02822d7c7a1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/067/137631e916b948c88dd384109b1cedb7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986776%27 HTTP/1.1" 200 None
2026-03-27 13:32:41 [ayvens.es] INFO: Saving data for 1986776: {'created_time': 1774618361.693241, 'last_price_update_time': 1774618361.693253, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986776') HTTP/1.1" 204 0
2026-03-27 13:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 38823773-392b-522a-b2a7-e65a8160e2f0 with identifier: 1986777
2026-03-27 13:32:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 38823773-392b-522a-b2a7-e65a8160e2f0 with identifier: 1986777
2026-03-27 13:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 38823773-392b-522a-b2a7-e65a8160e2f0 with identifier: 1986777 to the API
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/132/8eb5ce05400a48d6accad574b956bc05/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Sapporo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '38823773-392b-522a-b2a7-e65a8160e2f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 69898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38823773-392b-522a-b2a7-e65a8160e2f0/38823773-392b-522a-b2a7-e65a8160e2f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/132/8eb5ce05400a48d6accad574b956bc05/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986777%27 HTTP/1.1" 200 None
2026-03-27 13:32:42 [ayvens.es] INFO: Saving data for 1986777: {'created_time': 1774618362.04126, 'last_price_update_time': 1774618362.04127, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986777') HTTP/1.1" 204 0
2026-03-27 13:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960d8850>
2026-03-27 13:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9d4a3-5be8-5889-87a0-f4cc46146c4d/d5f9d4a3-5be8-5889-87a0-f4cc46146c4d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252F0413575fb5bc4117863e1649fc39cb57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/0413575fb5bc4117863e1649fc39cb57/images/large/1.jpg saved to cache
2026-03-27 13:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d
2026-03-27 13:32:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d, skipping ID generation
2026-03-27 13:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with scrape type 1
2026-03-27 13:32:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5f9d4a3-5be8-5889-87a0-f4cc46146c4d sending to next pipeline
2026-03-27 13:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d, identifier: 1986775
2026-03-27 13:32:42 [ayvens.es] INFO: Found listing with ID: 1986786
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986786%27 HTTP/1.1" 200 None
2026-03-27 13:32:42 [ayvens.es] INFO: Scrape type for 1986786: 1
2026-03-27 13:32:42 [ayvens.es] INFO: Extracting data for car ID: 1986786
2026-03-27 13:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76d9125d-b909-5e6e-a357-68956fa13bfe with identifier: 1986786
2026-03-27 13:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d9125d-b909-5e6e-a357-68956fa13bfe with scrape type 1
2026-03-27 13:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 76d9125d-b909-5e6e-a357-68956fa13bfe
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F451%252Ff39b0b8a231840c387e55ed9abbc6343%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/451/f39b0b8a231840c387e55ed9abbc6343/images/large/1.jpg not downloaded yet
2026-03-27 13:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with identifier: 1986775
2026-03-27 13:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with identifier: 1986775
2026-03-27 13:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d5f9d4a3-5be8-5889-87a0-f4cc46146c4d with identifier: 1986775 to the API
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/420/0413575fb5bc4117863e1649fc39cb57/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Cristal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd5f9d4a3-5be8-5889-87a0-f4cc46146c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 111543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9d4a3-5be8-5889-87a0-f4cc46146c4d/d5f9d4a3-5be8-5889-87a0-f4cc46146c4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/420/0413575fb5bc4117863e1649fc39cb57/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986775%27 HTTP/1.1" 200 None
2026-03-27 13:32:42 [ayvens.es] INFO: Saving data for 1986775: {'created_time': 1774618362.665086, 'last_price_update_time': 1774618362.665097, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986775') HTTP/1.1" 204 0
2026-03-27 13:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963cc4d0>
2026-03-27 13:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c580f71-6565-54e3-ad78-7822755cd3da/9c580f71-6565-54e3-ad78-7822755cd3da_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Fa715760282764dbf8a3d8b9c41b36ed5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/a715760282764dbf8a3d8b9c41b36ed5/images/large/1.jpg saved to cache
2026-03-27 13:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c580f71-6565-54e3-ad78-7822755cd3da
2026-03-27 13:32:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c580f71-6565-54e3-ad78-7822755cd3da, skipping ID generation
2026-03-27 13:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c580f71-6565-54e3-ad78-7822755cd3da with scrape type 1
2026-03-27 13:32:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c580f71-6565-54e3-ad78-7822755cd3da sending to next pipeline
2026-03-27 13:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9c580f71-6565-54e3-ad78-7822755cd3da, identifier: 1986774
2026-03-27 13:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9c580f71-6565-54e3-ad78-7822755cd3da with identifier: 1986774
2026-03-27 13:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9c580f71-6565-54e3-ad78-7822755cd3da with identifier: 1986774
2026-03-27 13:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9c580f71-6565-54e3-ad78-7822755cd3da with identifier: 1986774 to the API
2026-03-27 13:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/365/a715760282764dbf8a3d8b9c41b36ed5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9c580f71-6565-54e3-ad78-7822755cd3da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 21250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c580f71-6565-54e3-ad78-7822755cd3da/9c580f71-6565-54e3-ad78-7822755cd3da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/365/a715760282764dbf8a3d8b9c41b36ed5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986774%27 HTTP/1.1" 200 None
2026-03-27 13:32:43 [ayvens.es] INFO: Saving data for 1986774: {'created_time': 1774618363.158111, 'last_price_update_time': 1774618363.158121, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986774') HTTP/1.1" 204 0
2026-03-27 13:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296084090>
2026-03-27 13:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863b9025-9466-52bd-9980-e713cf406fb5/863b9025-9466-52bd-9980-e713cf406fb5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F515%252F05f2525296a54d2c8430356d8c0ce125%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/515/05f2525296a54d2c8430356d8c0ce125/images/large/1.jpg saved to cache
2026-03-27 13:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 863b9025-9466-52bd-9980-e713cf406fb5
2026-03-27 13:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 863b9025-9466-52bd-9980-e713cf406fb5, skipping ID generation
2026-03-27 13:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863b9025-9466-52bd-9980-e713cf406fb5 with scrape type 1
2026-03-27 13:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 863b9025-9466-52bd-9980-e713cf406fb5 sending to next pipeline
2026-03-27 13:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 863b9025-9466-52bd-9980-e713cf406fb5, identifier: 1986778
2026-03-27 13:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/814/64461733b4644ee790fbee0463e7eedd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/919/d2fc624340b444d0823606f1aa1b8283/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/d6403b6a502f4608b077900c1cda571f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/830/fbea617b73e245219df8261e44d13748/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:43 [ayvens.es] INFO: Found listing with ID: 1986787
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986787%27 HTTP/1.1" 200 None
2026-03-27 13:32:43 [ayvens.es] INFO: Scrape type for 1986787: 1
2026-03-27 13:32:43 [ayvens.es] INFO: Extracting data for car ID: 1986787
2026-03-27 13:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with identifier: 1986787
2026-03-27 13:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with scrape type 1
2026-03-27 13:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F205%252Fb0722142ef24411a9adf342b135a6fa2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/205/b0722142ef24411a9adf342b135a6fa2/images/large/1.jpg not downloaded yet
2026-03-27 13:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 863b9025-9466-52bd-9980-e713cf406fb5 with identifier: 1986778
2026-03-27 13:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 863b9025-9466-52bd-9980-e713cf406fb5 with identifier: 1986778
2026-03-27 13:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 863b9025-9466-52bd-9980-e713cf406fb5 with identifier: 1986778 to the API
2026-03-27 13:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/515/05f2525296a54d2c8430356d8c0ce125/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '863b9025-9466-52bd-9980-e713cf406fb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 37939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_863b9025-9466-52bd-9980-e713cf406fb5/863b9025-9466-52bd-9980-e713cf406fb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/515/05f2525296a54d2c8430356d8c0ce125/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986778%27 HTTP/1.1" 200 None
2026-03-27 13:32:44 [ayvens.es] INFO: Saving data for 1986778: {'created_time': 1774618364.263368, 'last_price_update_time': 1774618364.263378, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986778') HTTP/1.1" 204 0
2026-03-27 13:32:44 [ayvens.es] INFO: Found listing with ID: 1986788
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986788%27 HTTP/1.1" 200 None
2026-03-27 13:32:44 [ayvens.es] INFO: Scrape type for 1986788: 1
2026-03-27 13:32:44 [ayvens.es] INFO: Extracting data for car ID: 1986788
2026-03-27 13:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aca777c-5ddd-5076-8a1a-8bd036e55969 with identifier: 1986788
2026-03-27 13:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aca777c-5ddd-5076-8a1a-8bd036e55969 with scrape type 1
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8aca777c-5ddd-5076-8a1a-8bd036e55969
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252F208c110fb766472bbac1c7185fb4c9e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/208c110fb766472bbac1c7185fb4c9e1/images/large/1.jpg not downloaded yet
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529640ab10>
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a040e3-5348-5d21-b1a6-d60f79cfc765/65a040e3-5348-5d21-b1a6-d60f79cfc765_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F814%252F64461733b4644ee790fbee0463e7eedd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/814/64461733b4644ee790fbee0463e7eedd/images/large/1.jpg saved to cache
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65a040e3-5348-5d21-b1a6-d60f79cfc765
2026-03-27 13:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65a040e3-5348-5d21-b1a6-d60f79cfc765, skipping ID generation
2026-03-27 13:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a040e3-5348-5d21-b1a6-d60f79cfc765 with scrape type 1
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65a040e3-5348-5d21-b1a6-d60f79cfc765 sending to next pipeline
2026-03-27 13:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 65a040e3-5348-5d21-b1a6-d60f79cfc765, identifier: 1986780
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b2f50>
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34758461-cad7-5f80-b2d2-a455258444fa/34758461-cad7-5f80-b2d2-a455258444fa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F919%252Fd2fc624340b444d0823606f1aa1b8283%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/919/d2fc624340b444d0823606f1aa1b8283/images/large/1.jpg saved to cache
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34758461-cad7-5f80-b2d2-a455258444fa
2026-03-27 13:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34758461-cad7-5f80-b2d2-a455258444fa, skipping ID generation
2026-03-27 13:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34758461-cad7-5f80-b2d2-a455258444fa with scrape type 1
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34758461-cad7-5f80-b2d2-a455258444fa sending to next pipeline
2026-03-27 13:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 34758461-cad7-5f80-b2d2-a455258444fa, identifier: 1986779
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b3390>
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3335a93-d1f6-53bd-b70c-b9fa24fb20bf/f3335a93-d1f6-53bd-b70c-b9fa24fb20bf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252Fd6403b6a502f4608b077900c1cda571f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/d6403b6a502f4608b077900c1cda571f/images/large/1.jpg saved to cache
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf
2026-03-27 13:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf, skipping ID generation
2026-03-27 13:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with scrape type 1
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3335a93-d1f6-53bd-b70c-b9fa24fb20bf sending to next pipeline
2026-03-27 13:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf, identifier: 1986781
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960a0090>
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27bb782-92d2-5e5b-a62f-649b59376be9/a27bb782-92d2-5e5b-a62f-649b59376be9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F830%252Ffbea617b73e245219df8261e44d13748%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/830/fbea617b73e245219df8261e44d13748/images/large/1.jpg saved to cache
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a27bb782-92d2-5e5b-a62f-649b59376be9
2026-03-27 13:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a27bb782-92d2-5e5b-a62f-649b59376be9, skipping ID generation
2026-03-27 13:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27bb782-92d2-5e5b-a62f-649b59376be9 with scrape type 1
2026-03-27 13:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a27bb782-92d2-5e5b-a62f-649b59376be9 sending to next pipeline
2026-03-27 13:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a27bb782-92d2-5e5b-a62f-649b59376be9, identifier: 1986782
2026-03-27 13:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/078/ea924dd3b2a04f31bfefa3de172867ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:44 [ayvens.es] INFO: Found listing with ID: 1986789
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986789%27 HTTP/1.1" 200 None
2026-03-27 13:32:45 [ayvens.es] INFO: Scrape type for 1986789: 1
2026-03-27 13:32:45 [ayvens.es] INFO: Extracting data for car ID: 1986789
2026-03-27 13:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18689087-3471-5b79-a623-8ad6e541a9bf with identifier: 1986789
2026-03-27 13:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18689087-3471-5b79-a623-8ad6e541a9bf with scrape type 1
2026-03-27 13:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 18689087-3471-5b79-a623-8ad6e541a9bf
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252Fceda1539c13b44ad8c6b3d3c708d270f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/ceda1539c13b44ad8c6b3d3c708d270f/images/large/1.jpg not downloaded yet
2026-03-27 13:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 65a040e3-5348-5d21-b1a6-d60f79cfc765 with identifier: 1986780
2026-03-27 13:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 65a040e3-5348-5d21-b1a6-d60f79cfc765 with identifier: 1986780
2026-03-27 13:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 65a040e3-5348-5d21-b1a6-d60f79cfc765 with identifier: 1986780 to the API
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/814/64461733b4644ee790fbee0463e7eedd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '65a040e3-5348-5d21-b1a6-d60f79cfc765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA X',
 'odometer': 171038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a040e3-5348-5d21-b1a6-d60f79cfc765/65a040e3-5348-5d21-b1a6-d60f79cfc765_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/814/64461733b4644ee790fbee0463e7eedd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA X 1.6 CDTi 100kW 4X4 S&S Selective',
 'transmission': 'manual',
 'trim': '1.6 CDTi 100kW 4X4 S&S Selective',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986780%27 HTTP/1.1" 200 None
2026-03-27 13:32:45 [ayvens.es] INFO: Saving data for 1986780: {'created_time': 1774618365.34651, 'last_price_update_time': 1774618365.346521, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986780') HTTP/1.1" 204 0
2026-03-27 13:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 34758461-cad7-5f80-b2d2-a455258444fa with identifier: 1986779
2026-03-27 13:32:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 34758461-cad7-5f80-b2d2-a455258444fa with identifier: 1986779
2026-03-27 13:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 34758461-cad7-5f80-b2d2-a455258444fa with identifier: 1986779 to the API
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/919/d2fc624340b444d0823606f1aa1b8283/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Bronce',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '34758461-cad7-5f80-b2d2-a455258444fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 113431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34758461-cad7-5f80-b2d2-a455258444fa/34758461-cad7-5f80-b2d2-a455258444fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/919/d2fc624340b444d0823606f1aa1b8283/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 81 kW (110 CV) N-CONNECTA',
 'transmission': 'manual',
 'trim': 'dCi 81 kW (110 CV) N-CONNECTA',
 'vin': None,
 'year': 2017}
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986779%27 HTTP/1.1" 200 None
2026-03-27 13:32:45 [ayvens.es] INFO: Saving data for 1986779: {'created_time': 1774618365.72415, 'last_price_update_time': 1774618365.724163, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986779') HTTP/1.1" 204 0
2026-03-27 13:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with identifier: 1986781
2026-03-27 13:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with identifier: 1986781
2026-03-27 13:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f3335a93-d1f6-53bd-b70c-b9fa24fb20bf with identifier: 1986781 to the API
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/d6403b6a502f4608b077900c1cda571f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f3335a93-d1f6-53bd-b70c-b9fa24fb20bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 140234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3335a93-d1f6-53bd-b70c-b9fa24fb20bf/f3335a93-d1f6-53bd-b70c-b9fa24fb20bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/d6403b6a502f4608b077900c1cda571f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986781%27 HTTP/1.1" 200 None
2026-03-27 13:32:46 [ayvens.es] INFO: Saving data for 1986781: {'created_time': 1774618366.095133, 'last_price_update_time': 1774618366.095144, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986781') HTTP/1.1" 204 0
2026-03-27 13:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a27bb782-92d2-5e5b-a62f-649b59376be9 with identifier: 1986782
2026-03-27 13:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a27bb782-92d2-5e5b-a62f-649b59376be9 with identifier: 1986782
2026-03-27 13:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a27bb782-92d2-5e5b-a62f-649b59376be9 with identifier: 1986782 to the API
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/830/fbea617b73e245219df8261e44d13748/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Sapporo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a27bb782-92d2-5e5b-a62f-649b59376be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 77528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27bb782-92d2-5e5b-a62f-649b59376be9/a27bb782-92d2-5e5b-a62f-649b59376be9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/830/fbea617b73e245219df8261e44d13748/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986782%27 HTTP/1.1" 200 None
2026-03-27 13:32:46 [ayvens.es] INFO: Saving data for 1986782: {'created_time': 1774618366.40215, 'last_price_update_time': 1774618366.40216, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986782') HTTP/1.1" 204 0
2026-03-27 13:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/539/190372575a5645ac882d9b6070b105a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:46 [ayvens.es] INFO: Found listing with ID: 1986790
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986790%27 HTTP/1.1" 200 None
2026-03-27 13:32:46 [ayvens.es] INFO: Scrape type for 1986790: 1
2026-03-27 13:32:46 [ayvens.es] INFO: Extracting data for car ID: 1986790
2026-03-27 13:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19b17ef6-81bf-5681-adbf-2b0da70da089 with identifier: 1986790
2026-03-27 13:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19b17ef6-81bf-5681-adbf-2b0da70da089 with scrape type 1
2026-03-27 13:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 19b17ef6-81bf-5681-adbf-2b0da70da089
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F858%252Fc5017c5104f74b71805133c890e8f4dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/858/c5017c5104f74b71805133c890e8f4dc/images/large/1.jpg not downloaded yet
2026-03-27 13:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945ca9d0>
2026-03-27 13:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d7dc57b-6600-5d1b-9eb3-2847598672fd/9d7dc57b-6600-5d1b-9eb3-2847598672fd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F078%252Fea924dd3b2a04f31bfefa3de172867ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/078/ea924dd3b2a04f31bfefa3de172867ce/images/large/1.jpg saved to cache
2026-03-27 13:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd
2026-03-27 13:32:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d7dc57b-6600-5d1b-9eb3-2847598672fd, skipping ID generation
2026-03-27 13:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd with scrape type 1
2026-03-27 13:32:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d7dc57b-6600-5d1b-9eb3-2847598672fd sending to next pipeline
2026-03-27 13:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d7dc57b-6600-5d1b-9eb3-2847598672fd, identifier: 1986783
2026-03-27 13:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/128/74aaf01ed8774b9db86cf1004b3c44ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:46 [ayvens.es] INFO: Found listing with ID: 1986791
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986791%27 HTTP/1.1" 200 None
2026-03-27 13:32:46 [ayvens.es] INFO: Scrape type for 1986791: 1
2026-03-27 13:32:46 [ayvens.es] INFO: Extracting data for car ID: 1986791
2026-03-27 13:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with identifier: 1986791
2026-03-27 13:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with scrape type 1
2026-03-27 13:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F734%252Facf8137ab45a4c1eafda3c27b0ed209c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/734/acf8137ab45a4c1eafda3c27b0ed209c/images/large/1.jpg not downloaded yet
2026-03-27 13:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d7dc57b-6600-5d1b-9eb3-2847598672fd with identifier: 1986783
2026-03-27 13:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d7dc57b-6600-5d1b-9eb3-2847598672fd with identifier: 1986783
2026-03-27 13:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d7dc57b-6600-5d1b-9eb3-2847598672fd with identifier: 1986783 to the API
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/078/ea924dd3b2a04f31bfefa3de172867ce/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9d7dc57b-6600-5d1b-9eb3-2847598672fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 131432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d7dc57b-6600-5d1b-9eb3-2847598672fd/9d7dc57b-6600-5d1b-9eb3-2847598672fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/078/ea924dd3b2a04f31bfefa3de172867ce/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 75',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 75',
 'vin': None,
 'year': 2018}
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986783%27 HTTP/1.1" 200 None
2026-03-27 13:32:47 [ayvens.es] INFO: Saving data for 1986783: {'created_time': 1774618367.045865, 'last_price_update_time': 1774618367.045876, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986783') HTTP/1.1" 204 0
2026-03-27 13:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/451/f39b0b8a231840c387e55ed9abbc6343/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:47 [ayvens.es] INFO: Found listing with ID: 1986792
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986792%27 HTTP/1.1" 200 None
2026-03-27 13:32:47 [ayvens.es] INFO: Scrape type for 1986792: 1
2026-03-27 13:32:47 [ayvens.es] INFO: Extracting data for car ID: 1986792
2026-03-27 13:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4a37647-1fcc-503e-8e3e-51d31c78fc8b with identifier: 1986792
2026-03-27 13:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b with scrape type 1
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F430%252Fb2bf4f7ad54345b1b35d995f70014b00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/430/b2bf4f7ad54345b1b35d995f70014b00/images/large/1.jpg not downloaded yet
2026-03-27 13:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/205/b0722142ef24411a9adf342b135a6fa2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295eb2b10>
2026-03-27 13:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a8c785d-d277-5452-b1f4-10dcbbd009b2/1a8c785d-d277-5452-b1f4-10dcbbd009b2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F539%252F190372575a5645ac882d9b6070b105a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/539/190372575a5645ac882d9b6070b105a0/images/large/1.jpg saved to cache
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2
2026-03-27 13:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a8c785d-d277-5452-b1f4-10dcbbd009b2, skipping ID generation
2026-03-27 13:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with scrape type 1
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a8c785d-d277-5452-b1f4-10dcbbd009b2 sending to next pipeline
2026-03-27 13:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1a8c785d-d277-5452-b1f4-10dcbbd009b2, identifier: 1986784
2026-03-27 13:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f78d10>
2026-03-27 13:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a54a8af-6854-5b4f-b1f5-1a96c165f867/4a54a8af-6854-5b4f-b1f5-1a96c165f867_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252F74aaf01ed8774b9db86cf1004b3c44ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/74aaf01ed8774b9db86cf1004b3c44ee/images/large/1.jpg saved to cache
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867
2026-03-27 13:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a54a8af-6854-5b4f-b1f5-1a96c165f867, skipping ID generation
2026-03-27 13:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with scrape type 1
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a54a8af-6854-5b4f-b1f5-1a96c165f867 sending to next pipeline
2026-03-27 13:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4a54a8af-6854-5b4f-b1f5-1a96c165f867, identifier: 1986785
2026-03-27 13:32:47 [ayvens.es] INFO: Found listing with ID: 1986793
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986793%27 HTTP/1.1" 200 None
2026-03-27 13:32:47 [ayvens.es] INFO: Scrape type for 1986793: 1
2026-03-27 13:32:47 [ayvens.es] INFO: Extracting data for car ID: 1986793
2026-03-27 13:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with identifier: 1986793
2026-03-27 13:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with scrape type 1
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F965%252Fa3d77277da834dc29faa3d5870289129%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/965/a3d77277da834dc29faa3d5870289129/images/large/1.jpg not downloaded yet
2026-03-27 13:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with identifier: 1986784
2026-03-27 13:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with identifier: 1986784
2026-03-27 13:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1a8c785d-d277-5452-b1f4-10dcbbd009b2 with identifier: 1986784 to the API
2026-03-27 13:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/539/190372575a5645ac882d9b6070b105a0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '1a8c785d-d277-5452-b1f4-10dcbbd009b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 30530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a8c785d-d277-5452-b1f4-10dcbbd009b2/1a8c785d-d277-5452-b1f4-10dcbbd009b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/539/190372575a5645ac882d9b6070b105a0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986784%27 HTTP/1.1" 200 None
2026-03-27 13:32:48 [ayvens.es] INFO: Saving data for 1986784: {'created_time': 1774618368.658129, 'last_price_update_time': 1774618368.658141, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986784') HTTP/1.1" 204 0
2026-03-27 13:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with identifier: 1986785
2026-03-27 13:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with identifier: 1986785
2026-03-27 13:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4a54a8af-6854-5b4f-b1f5-1a96c165f867 with identifier: 1986785 to the API
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/128/74aaf01ed8774b9db86cf1004b3c44ee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Mineral',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4a54a8af-6854-5b4f-b1f5-1a96c165f867',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 140446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a54a8af-6854-5b4f-b1f5-1a96c165f867/4a54a8af-6854-5b4f-b1f5-1a96c165f867_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/128/74aaf01ed8774b9db86cf1004b3c44ee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986785%27 HTTP/1.1" 200 None
2026-03-27 13:32:48 [ayvens.es] INFO: Saving data for 1986785: {'created_time': 1774618368.976208, 'last_price_update_time': 1774618368.976218, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986785') HTTP/1.1" 204 0
2026-03-27 13:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/724/208c110fb766472bbac1c7185fb4c9e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:48 [ayvens.es] INFO: Found listing with ID: 1986794
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986794%27 HTTP/1.1" 200 None
2026-03-27 13:32:49 [ayvens.es] INFO: Scrape type for 1986794: 1
2026-03-27 13:32:49 [ayvens.es] INFO: Extracting data for car ID: 1986794
2026-03-27 13:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90104017-583a-5852-be20-52f6ff148376 with identifier: 1986794
2026-03-27 13:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90104017-583a-5852-be20-52f6ff148376 with scrape type 1
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 90104017-583a-5852-be20-52f6ff148376
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F552%252Fa589a43e8570426bbad4b0aef683963a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/552/a589a43e8570426bbad4b0aef683963a/images/large/1.jpg not downloaded yet
2026-03-27 13:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961a8d10>
2026-03-27 13:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76d9125d-b909-5e6e-a357-68956fa13bfe/76d9125d-b909-5e6e-a357-68956fa13bfe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F451%252Ff39b0b8a231840c387e55ed9abbc6343%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/451/f39b0b8a231840c387e55ed9abbc6343/images/large/1.jpg saved to cache
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76d9125d-b909-5e6e-a357-68956fa13bfe
2026-03-27 13:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76d9125d-b909-5e6e-a357-68956fa13bfe, skipping ID generation
2026-03-27 13:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d9125d-b909-5e6e-a357-68956fa13bfe with scrape type 1
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76d9125d-b909-5e6e-a357-68956fa13bfe sending to next pipeline
2026-03-27 13:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 76d9125d-b909-5e6e-a357-68956fa13bfe, identifier: 1986786
2026-03-27 13:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962fa990>
2026-03-27 13:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c693f85-3342-58a6-a6e9-60bf2ec0b561/0c693f85-3342-58a6-a6e9-60bf2ec0b561_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F205%252Fb0722142ef24411a9adf342b135a6fa2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/205/b0722142ef24411a9adf342b135a6fa2/images/large/1.jpg saved to cache
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561
2026-03-27 13:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c693f85-3342-58a6-a6e9-60bf2ec0b561, skipping ID generation
2026-03-27 13:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with scrape type 1
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561 sending to next pipeline
2026-03-27 13:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c693f85-3342-58a6-a6e9-60bf2ec0b561, identifier: 1986787
2026-03-27 13:32:49 [ayvens.es] INFO: Found listing with ID: 1986795
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986795%27 HTTP/1.1" 200 None
2026-03-27 13:32:49 [ayvens.es] INFO: Scrape type for 1986795: 1
2026-03-27 13:32:49 [ayvens.es] INFO: Extracting data for car ID: 1986795
2026-03-27 13:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a3efc9-acfe-564c-941d-eddd6fba42ae with identifier: 1986795
2026-03-27 13:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a3efc9-acfe-564c-941d-eddd6fba42ae with scrape type 1
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29a3efc9-acfe-564c-941d-eddd6fba42ae
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F973%252F71faffb283214acea4703ca14a7333ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/973/71faffb283214acea4703ca14a7333ac/images/large/1.jpg not downloaded yet
2026-03-27 13:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 76d9125d-b909-5e6e-a357-68956fa13bfe with identifier: 1986786
2026-03-27 13:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 76d9125d-b909-5e6e-a357-68956fa13bfe with identifier: 1986786
2026-03-27 13:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 76d9125d-b909-5e6e-a357-68956fa13bfe with identifier: 1986786 to the API
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/451/f39b0b8a231840c387e55ed9abbc6343/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '76d9125d-b909-5e6e-a357-68956fa13bfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 76318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76d9125d-b909-5e6e-a357-68956fa13bfe/76d9125d-b909-5e6e-a357-68956fa13bfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/451/f39b0b8a231840c387e55ed9abbc6343/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW (150CV) Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW (150CV) Trend',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986786%27 HTTP/1.1" 200 None
2026-03-27 13:32:49 [ayvens.es] INFO: Saving data for 1986786: {'created_time': 1774618369.720952, 'last_price_update_time': 1774618369.720963, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986786') HTTP/1.1" 204 0
2026-03-27 13:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with identifier: 1986787
2026-03-27 13:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with identifier: 1986787
2026-03-27 13:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with identifier: 1986787 to the API
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/205/b0722142ef24411a9adf342b135a6fa2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c693f85-3342-58a6-a6e9-60bf2ec0b561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 95500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c693f85-3342-58a6-a6e9-60bf2ec0b561/0c693f85-3342-58a6-a6e9-60bf2ec0b561_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/205/b0722142ef24411a9adf342b135a6fa2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER Active Pack Standard BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Active Pack Standard BlueHDi 73kW',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986787%27 HTTP/1.1" 200 None
2026-03-27 13:32:50 [ayvens.es] INFO: Saving data for 1986787: {'created_time': 1774618370.044223, 'last_price_update_time': 1774618370.044233, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986787') HTTP/1.1" 204 0
2026-03-27 13:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/688/ceda1539c13b44ad8c6b3d3c708d270f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/858/c5017c5104f74b71805133c890e8f4dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:50 [ayvens.es] INFO: Found listing with ID: 1986796
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986796%27 HTTP/1.1" 200 None
2026-03-27 13:32:50 [ayvens.es] INFO: Scrape type for 1986796: 1
2026-03-27 13:32:50 [ayvens.es] INFO: Extracting data for car ID: 1986796
2026-03-27 13:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with identifier: 1986796
2026-03-27 13:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with scrape type 1
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252F8e1ad5da2f8f4dd4adbcd7e9d1bd4a2f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/8e1ad5da2f8f4dd4adbcd7e9d1bd4a2f/images/large/1.jpg not downloaded yet
2026-03-27 13:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ed5290>
2026-03-27 13:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aca777c-5ddd-5076-8a1a-8bd036e55969/8aca777c-5ddd-5076-8a1a-8bd036e55969_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252F208c110fb766472bbac1c7185fb4c9e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/208c110fb766472bbac1c7185fb4c9e1/images/large/1.jpg saved to cache
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8aca777c-5ddd-5076-8a1a-8bd036e55969
2026-03-27 13:32:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8aca777c-5ddd-5076-8a1a-8bd036e55969, skipping ID generation
2026-03-27 13:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aca777c-5ddd-5076-8a1a-8bd036e55969 with scrape type 1
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8aca777c-5ddd-5076-8a1a-8bd036e55969 sending to next pipeline
2026-03-27 13:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8aca777c-5ddd-5076-8a1a-8bd036e55969, identifier: 1986788
2026-03-27 13:32:50 [ayvens.es] INFO: Found listing with ID: 1986797
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986797%27 HTTP/1.1" 200 None
2026-03-27 13:32:50 [ayvens.es] INFO: Scrape type for 1986797: 1
2026-03-27 13:32:50 [ayvens.es] INFO: Extracting data for car ID: 1986797
2026-03-27 13:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d697d28d-5691-5cc5-9317-c75a6012f52a with identifier: 1986797
2026-03-27 13:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d697d28d-5691-5cc5-9317-c75a6012f52a with scrape type 1
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d697d28d-5691-5cc5-9317-c75a6012f52a
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F41a48d7ad65245ceb08662e09303f91e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/41a48d7ad65245ceb08662e09303f91e/images/large/1.jpg not downloaded yet
2026-03-27 13:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8aca777c-5ddd-5076-8a1a-8bd036e55969 with identifier: 1986788
2026-03-27 13:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8aca777c-5ddd-5076-8a1a-8bd036e55969 with identifier: 1986788
2026-03-27 13:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8aca777c-5ddd-5076-8a1a-8bd036e55969 with identifier: 1986788 to the API
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/724/208c110fb766472bbac1c7185fb4c9e1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8aca777c-5ddd-5076-8a1a-8bd036e55969',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 274568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aca777c-5ddd-5076-8a1a-8bd036e55969/8aca777c-5ddd-5076-8a1a-8bd036e55969_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/724/208c110fb766472bbac1c7185fb4c9e1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO BlueHDi 55KW (75CV)',
 'transmission': 'manual',
 'trim': 'BlueHDi 55KW (75CV)',
 'vin': None,
 'year': 2018}
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986788%27 HTTP/1.1" 200 None
2026-03-27 13:32:50 [ayvens.es] INFO: Saving data for 1986788: {'created_time': 1774618370.716417, 'last_price_update_time': 1774618370.716428, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986788') HTTP/1.1" 204 0
2026-03-27 13:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/430/b2bf4f7ad54345b1b35d995f70014b00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:50 [ayvens.es] INFO: Found listing with ID: 1986798
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986798%27 HTTP/1.1" 200 None
2026-03-27 13:32:50 [ayvens.es] INFO: Scrape type for 1986798: 1
2026-03-27 13:32:50 [ayvens.es] INFO: Extracting data for car ID: 1986798
2026-03-27 13:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db3f53d-bbca-57bb-9d37-ea03df808da7 with identifier: 1986798
2026-03-27 13:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db3f53d-bbca-57bb-9d37-ea03df808da7 with scrape type 1
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6db3f53d-bbca-57bb-9d37-ea03df808da7
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F666%252Fb4f02b5fc41f4dc6aeaaab0644285ee6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/666/b4f02b5fc41f4dc6aeaaab0644285ee6/images/large/1.jpg not downloaded yet
2026-03-27 13:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bd7d90>
2026-03-27 13:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18689087-3471-5b79-a623-8ad6e541a9bf/18689087-3471-5b79-a623-8ad6e541a9bf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252Fceda1539c13b44ad8c6b3d3c708d270f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/ceda1539c13b44ad8c6b3d3c708d270f/images/large/1.jpg saved to cache
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18689087-3471-5b79-a623-8ad6e541a9bf
2026-03-27 13:32:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18689087-3471-5b79-a623-8ad6e541a9bf, skipping ID generation
2026-03-27 13:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18689087-3471-5b79-a623-8ad6e541a9bf with scrape type 1
2026-03-27 13:32:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18689087-3471-5b79-a623-8ad6e541a9bf sending to next pipeline
2026-03-27 13:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 18689087-3471-5b79-a623-8ad6e541a9bf, identifier: 1986789
2026-03-27 13:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960a0e90>
2026-03-27 13:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19b17ef6-81bf-5681-adbf-2b0da70da089/19b17ef6-81bf-5681-adbf-2b0da70da089_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F858%252Fc5017c5104f74b71805133c890e8f4dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/858/c5017c5104f74b71805133c890e8f4dc/images/large/1.jpg saved to cache
2026-03-27 13:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19b17ef6-81bf-5681-adbf-2b0da70da089
2026-03-27 13:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19b17ef6-81bf-5681-adbf-2b0da70da089, skipping ID generation
2026-03-27 13:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19b17ef6-81bf-5681-adbf-2b0da70da089 with scrape type 1
2026-03-27 13:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19b17ef6-81bf-5681-adbf-2b0da70da089 sending to next pipeline
2026-03-27 13:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 19b17ef6-81bf-5681-adbf-2b0da70da089, identifier: 1986790
2026-03-27 13:32:51 [ayvens.es] INFO: Found listing with ID: 1986799
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986799%27 HTTP/1.1" 200 None
2026-03-27 13:32:51 [ayvens.es] INFO: Scrape type for 1986799: 1
2026-03-27 13:32:51 [ayvens.es] INFO: Extracting data for car ID: 1986799
2026-03-27 13:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ceaec1-6605-523c-9a8a-bb963dbe0468 with identifier: 1986799
2026-03-27 13:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ceaec1-6605-523c-9a8a-bb963dbe0468 with scrape type 1
2026-03-27 13:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 66ceaec1-6605-523c-9a8a-bb963dbe0468
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F701%252F7c824fe961374ca6ad15de99b200496b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/701/7c824fe961374ca6ad15de99b200496b/images/large/1.jpg not downloaded yet
2026-03-27 13:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 18689087-3471-5b79-a623-8ad6e541a9bf with identifier: 1986789
2026-03-27 13:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 18689087-3471-5b79-a623-8ad6e541a9bf with identifier: 1986789
2026-03-27 13:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 18689087-3471-5b79-a623-8ad6e541a9bf with identifier: 1986789 to the API
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/688/ceda1539c13b44ad8c6b3d3c708d270f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '18689087-3471-5b79-a623-8ad6e541a9bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 174260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18689087-3471-5b79-a623-8ad6e541a9bf/18689087-3471-5b79-a623-8ad6e541a9bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/688/ceda1539c13b44ad8c6b3d3c708d270f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986789%27 HTTP/1.1" 200 None
2026-03-27 13:32:51 [ayvens.es] INFO: Saving data for 1986789: {'created_time': 1774618371.532757, 'last_price_update_time': 1774618371.53277, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986789') HTTP/1.1" 204 0
2026-03-27 13:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 19b17ef6-81bf-5681-adbf-2b0da70da089 with identifier: 1986790
2026-03-27 13:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 19b17ef6-81bf-5681-adbf-2b0da70da089 with identifier: 1986790
2026-03-27 13:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 19b17ef6-81bf-5681-adbf-2b0da70da089 with identifier: 1986790 to the API
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/858/c5017c5104f74b71805133c890e8f4dc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '19b17ef6-81bf-5681-adbf-2b0da70da089',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 151912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19b17ef6-81bf-5681-adbf-2b0da70da089/19b17ef6-81bf-5681-adbf-2b0da70da089_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/858/c5017c5104f74b71805133c890e8f4dc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986790%27 HTTP/1.1" 200 None
2026-03-27 13:32:51 [ayvens.es] INFO: Saving data for 1986790: {'created_time': 1774618371.891837, 'last_price_update_time': 1774618371.891847, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986790') HTTP/1.1" 204 0
2026-03-27 13:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/734/acf8137ab45a4c1eafda3c27b0ed209c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/965/a3d77277da834dc29faa3d5870289129/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/552/a589a43e8570426bbad4b0aef683963a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:51 [ayvens.es] INFO: Found listing with ID: 1986800
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986800%27 HTTP/1.1" 200 None
2026-03-27 13:32:51 [ayvens.es] INFO: Scrape type for 1986800: 1
2026-03-27 13:32:51 [ayvens.es] INFO: Extracting data for car ID: 1986800
2026-03-27 13:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4929c8a-adf9-5dfb-a57f-34c99131f798 with identifier: 1986800
2026-03-27 13:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4929c8a-adf9-5dfb-a57f-34c99131f798 with scrape type 1
2026-03-27 13:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e4929c8a-adf9-5dfb-a57f-34c99131f798
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252F48826fda24054d8eb001176f178f471f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/48826fda24054d8eb001176f178f471f/images/large/1.jpg not downloaded yet
2026-03-27 13:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957b4f50>
2026-03-27 13:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a37647-1fcc-503e-8e3e-51d31c78fc8b/f4a37647-1fcc-503e-8e3e-51d31c78fc8b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F430%252Fb2bf4f7ad54345b1b35d995f70014b00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/430/b2bf4f7ad54345b1b35d995f70014b00/images/large/1.jpg saved to cache
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b
2026-03-27 13:32:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4a37647-1fcc-503e-8e3e-51d31c78fc8b, skipping ID generation
2026-03-27 13:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b with scrape type 1
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b sending to next pipeline
2026-03-27 13:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f4a37647-1fcc-503e-8e3e-51d31c78fc8b, identifier: 1986792
2026-03-27 13:32:52 [ayvens.es] INFO: Found listing with ID: 1986801
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986801%27 HTTP/1.1" 200 None
2026-03-27 13:32:52 [ayvens.es] INFO: Scrape type for 1986801: 1
2026-03-27 13:32:52 [ayvens.es] INFO: Extracting data for car ID: 1986801
2026-03-27 13:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0efe4f-949a-575d-933c-08d3db671cdb with identifier: 1986801
2026-03-27 13:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0efe4f-949a-575d-933c-08d3db671cdb with scrape type 1
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5b0efe4f-949a-575d-933c-08d3db671cdb
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252Fe2188eece0b94809a2d5ab96dc9bfe42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/e2188eece0b94809a2d5ab96dc9bfe42/images/large/1.jpg not downloaded yet
2026-03-27 13:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f4a37647-1fcc-503e-8e3e-51d31c78fc8b with identifier: 1986792
2026-03-27 13:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f4a37647-1fcc-503e-8e3e-51d31c78fc8b with identifier: 1986792
2026-03-27 13:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f4a37647-1fcc-503e-8e3e-51d31c78fc8b with identifier: 1986792 to the API
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/430/b2bf4f7ad54345b1b35d995f70014b00/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f4a37647-1fcc-503e-8e3e-51d31c78fc8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 70496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a37647-1fcc-503e-8e3e-51d31c78fc8b/f4a37647-1fcc-503e-8e3e-51d31c78fc8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/430/b2bf4f7ad54345b1b35d995f70014b00/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986792%27 HTTP/1.1" 200 None
2026-03-27 13:32:52 [ayvens.es] INFO: Saving data for 1986792: {'created_time': 1774618372.478612, 'last_price_update_time': 1774618372.478623, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986792') HTTP/1.1" 204 0
2026-03-27 13:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/973/71faffb283214acea4703ca14a7333ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/724/8e1ad5da2f8f4dd4adbcd7e9d1bd4a2f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:52 [ayvens.es] INFO: Found listing with ID: 1986802
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986802%27 HTTP/1.1" 200 None
2026-03-27 13:32:52 [ayvens.es] INFO: Scrape type for 1986802: 1
2026-03-27 13:32:52 [ayvens.es] INFO: Extracting data for car ID: 1986802
2026-03-27 13:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e044a03-4925-54f9-b1fb-2b18baf84fb8 with identifier: 1986802
2026-03-27 13:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e044a03-4925-54f9-b1fb-2b18baf84fb8 with scrape type 1
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7e044a03-4925-54f9-b1fb-2b18baf84fb8
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F968%252F87f8514736504162b11112462cf0a68b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/968/87f8514736504162b11112462cf0a68b/images/large/1.jpg not downloaded yet
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bff450>
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ccf973-2e79-58b6-84ec-b9ea9dc32431/06ccf973-2e79-58b6-84ec-b9ea9dc32431_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F734%252Facf8137ab45a4c1eafda3c27b0ed209c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/734/acf8137ab45a4c1eafda3c27b0ed209c/images/large/1.jpg saved to cache
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431
2026-03-27 13:32:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06ccf973-2e79-58b6-84ec-b9ea9dc32431, skipping ID generation
2026-03-27 13:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with scrape type 1
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431 sending to next pipeline
2026-03-27 13:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 06ccf973-2e79-58b6-84ec-b9ea9dc32431, identifier: 1986791
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960d8a90>
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a2b8a6-72ed-51ba-a552-a67dfa4dc313/d1a2b8a6-72ed-51ba-a552-a67dfa4dc313_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F965%252Fa3d77277da834dc29faa3d5870289129%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/965/a3d77277da834dc29faa3d5870289129/images/large/1.jpg saved to cache
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313
2026-03-27 13:32:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313, skipping ID generation
2026-03-27 13:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with scrape type 1
2026-03-27 13:32:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 sending to next pipeline
2026-03-27 13:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313, identifier: 1986793
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bdeb50>
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90104017-583a-5852-be20-52f6ff148376/90104017-583a-5852-be20-52f6ff148376_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F552%252Fa589a43e8570426bbad4b0aef683963a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/552/a589a43e8570426bbad4b0aef683963a/images/large/1.jpg saved to cache
2026-03-27 13:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90104017-583a-5852-be20-52f6ff148376
2026-03-27 13:32:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90104017-583a-5852-be20-52f6ff148376, skipping ID generation
2026-03-27 13:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90104017-583a-5852-be20-52f6ff148376 with scrape type 1
2026-03-27 13:32:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90104017-583a-5852-be20-52f6ff148376 sending to next pipeline
2026-03-27 13:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 90104017-583a-5852-be20-52f6ff148376, identifier: 1986794
2026-03-27 13:32:53 [ayvens.es] INFO: Found listing with ID: 1986803
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986803%27 HTTP/1.1" 200 None
2026-03-27 13:32:53 [ayvens.es] INFO: Scrape type for 1986803: 1
2026-03-27 13:32:53 [ayvens.es] INFO: Extracting data for car ID: 1986803
2026-03-27 13:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0551ad0b-2989-5227-9a62-5ffc1e520779 with identifier: 1986803
2026-03-27 13:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0551ad0b-2989-5227-9a62-5ffc1e520779 with scrape type 1
2026-03-27 13:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0551ad0b-2989-5227-9a62-5ffc1e520779
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F799%252F4a0a6eefc3f14ba4ad87c695c8e370de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/799/4a0a6eefc3f14ba4ad87c695c8e370de/images/large/1.jpg not downloaded yet
2026-03-27 13:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with identifier: 1986791
2026-03-27 13:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with identifier: 1986791
2026-03-27 13:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with identifier: 1986791 to the API
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/734/acf8137ab45a4c1eafda3c27b0ed209c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '06ccf973-2e79-58b6-84ec-b9ea9dc32431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 168699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ccf973-2e79-58b6-84ec-b9ea9dc32431/06ccf973-2e79-58b6-84ec-b9ea9dc32431_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/734/acf8137ab45a4c1eafda3c27b0ed209c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986791%27 HTTP/1.1" 200 None
2026-03-27 13:32:53 [ayvens.es] INFO: Saving data for 1986791: {'created_time': 1774618373.557421, 'last_price_update_time': 1774618373.557436, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986791') HTTP/1.1" 204 0
2026-03-27 13:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with identifier: 1986793
2026-03-27 13:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with identifier: 1986793
2026-03-27 13:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with identifier: 1986793 to the API
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/965/a3d77277da834dc29faa3d5870289129/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd1a2b8a6-72ed-51ba-a552-a67dfa4dc313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 142342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a2b8a6-72ed-51ba-a552-a67dfa4dc313/d1a2b8a6-72ed-51ba-a552-a67dfa4dc313_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/965/a3d77277da834dc29faa3d5870289129/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 81 kW (110 CV) ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 81 kW (110 CV) ACENTA',
 'vin': None,
 'year': 2018}
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986793%27 HTTP/1.1" 200 None
2026-03-27 13:32:53 [ayvens.es] INFO: Saving data for 1986793: {'created_time': 1774618373.991556, 'last_price_update_time': 1774618373.991566, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986793') HTTP/1.1" 204 0
2026-03-27 13:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 90104017-583a-5852-be20-52f6ff148376 with identifier: 1986794
2026-03-27 13:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 90104017-583a-5852-be20-52f6ff148376 with identifier: 1986794
2026-03-27 13:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 90104017-583a-5852-be20-52f6ff148376 with identifier: 1986794 to the API
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/552/a589a43e8570426bbad4b0aef683963a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '90104017-583a-5852-be20-52f6ff148376',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 115474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90104017-583a-5852-be20-52f6ff148376/90104017-583a-5852-be20-52f6ff148376_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/552/a589a43e8570426bbad4b0aef683963a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986794%27 HTTP/1.1" 200 None
2026-03-27 13:32:54 [ayvens.es] INFO: Saving data for 1986794: {'created_time': 1774618374.316241, 'last_price_update_time': 1774618374.316253, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986794') HTTP/1.1" 204 0
2026-03-27 13:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/666/b4f02b5fc41f4dc6aeaaab0644285ee6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:54 [ayvens.es] INFO: Found listing with ID: 1986804
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986804%27 HTTP/1.1" 200 None
2026-03-27 13:32:54 [ayvens.es] INFO: Scrape type for 1986804: 1
2026-03-27 13:32:54 [ayvens.es] INFO: Extracting data for car ID: 1986804
2026-03-27 13:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1673796e-03dc-521c-9a39-574bd6b6616b with identifier: 1986804
2026-03-27 13:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1673796e-03dc-521c-9a39-574bd6b6616b with scrape type 1
2026-03-27 13:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1673796e-03dc-521c-9a39-574bd6b6616b
2026-03-27 13:32:54 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1673796e-03dc-521c-9a39-574bd6b6616b
2026-03-27 13:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1673796e-03dc-521c-9a39-574bd6b6616b, identifier: 1986804
2026-03-27 13:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1673796e-03dc-521c-9a39-574bd6b6616b with identifier: 1986804
2026-03-27 13:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1673796e-03dc-521c-9a39-574bd6b6616b with identifier: 1986804
2026-03-27 13:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1673796e-03dc-521c-9a39-574bd6b6616b with identifier: 1986804 to the API
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '1673796e-03dc-521c-9a39-574bd6b6616b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 105157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986804%27 HTTP/1.1" 200 None
2026-03-27 13:32:54 [ayvens.es] INFO: Saving data for 1986804: {'created_time': 1774618374.735042, 'last_price_update_time': 1774618374.735053, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986804') HTTP/1.1" 204 0
2026-03-27 13:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fb1950>
2026-03-27 13:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a3efc9-acfe-564c-941d-eddd6fba42ae/29a3efc9-acfe-564c-941d-eddd6fba42ae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F973%252F71faffb283214acea4703ca14a7333ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/973/71faffb283214acea4703ca14a7333ac/images/large/1.jpg saved to cache
2026-03-27 13:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29a3efc9-acfe-564c-941d-eddd6fba42ae
2026-03-27 13:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29a3efc9-acfe-564c-941d-eddd6fba42ae, skipping ID generation
2026-03-27 13:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a3efc9-acfe-564c-941d-eddd6fba42ae with scrape type 1
2026-03-27 13:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29a3efc9-acfe-564c-941d-eddd6fba42ae sending to next pipeline
2026-03-27 13:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29a3efc9-acfe-564c-941d-eddd6fba42ae, identifier: 1986795
2026-03-27 13:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529618f190>
2026-03-27 13:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb9e1ea-698e-5b32-bb74-f1c52f9d5661/ecb9e1ea-698e-5b32-bb74-f1c52f9d5661_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252F8e1ad5da2f8f4dd4adbcd7e9d1bd4a2f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/8e1ad5da2f8f4dd4adbcd7e9d1bd4a2f/images/large/1.jpg saved to cache
2026-03-27 13:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661
2026-03-27 13:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661, skipping ID generation
2026-03-27 13:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with scrape type 1
2026-03-27 13:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 sending to next pipeline
2026-03-27 13:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661, identifier: 1986796
2026-03-27 13:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/41a48d7ad65245ceb08662e09303f91e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:55 [ayvens.es] INFO: Found listing with ID: 1986805
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986805%27 HTTP/1.1" 200 None
2026-03-27 13:32:55 [ayvens.es] INFO: Scrape type for 1986805: 1
2026-03-27 13:32:55 [ayvens.es] INFO: Extracting data for car ID: 1986805
2026-03-27 13:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7 with identifier: 1986805
2026-03-27 13:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7 with scrape type 1
2026-03-27 13:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F636%252F46628145b04547408f8f37944f6b829d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/636/46628145b04547408f8f37944f6b829d/images/large/1.jpg not downloaded yet
2026-03-27 13:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29a3efc9-acfe-564c-941d-eddd6fba42ae with identifier: 1986795
2026-03-27 13:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29a3efc9-acfe-564c-941d-eddd6fba42ae with identifier: 1986795
2026-03-27 13:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29a3efc9-acfe-564c-941d-eddd6fba42ae with identifier: 1986795 to the API
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/973/71faffb283214acea4703ca14a7333ac/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '29a3efc9-acfe-564c-941d-eddd6fba42ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 117168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a3efc9-acfe-564c-941d-eddd6fba42ae/29a3efc9-acfe-564c-941d-eddd6fba42ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/973/71faffb283214acea4703ca14a7333ac/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986795%27 HTTP/1.1" 200 None
2026-03-27 13:32:55 [ayvens.es] INFO: Saving data for 1986795: {'created_time': 1774618375.420954, 'last_price_update_time': 1774618375.420965, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986795') HTTP/1.1" 204 0
2026-03-27 13:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with identifier: 1986796
2026-03-27 13:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with identifier: 1986796
2026-03-27 13:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with identifier: 1986796 to the API
2026-03-27 13:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/724/8e1ad5da2f8f4dd4adbcd7e9d1bd4a2f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ecb9e1ea-698e-5b32-bb74-f1c52f9d5661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 240966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb9e1ea-698e-5b32-bb74-f1c52f9d5661/ecb9e1ea-698e-5b32-bb74-f1c52f9d5661_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/724/8e1ad5da2f8f4dd4adbcd7e9d1bd4a2f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S FEEL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S FEEL',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986796%27 HTTP/1.1" 200 None
2026-03-27 13:32:56 [ayvens.es] INFO: Saving data for 1986796: {'created_time': 1774618376.240525, 'last_price_update_time': 1774618376.240535, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986796') HTTP/1.1" 204 0
2026-03-27 13:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/701/7c824fe961374ca6ad15de99b200496b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/595/48826fda24054d8eb001176f178f471f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:56 [ayvens.es] INFO: Found listing with ID: 1986806
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986806%27 HTTP/1.1" 200 None
2026-03-27 13:32:56 [ayvens.es] INFO: Scrape type for 1986806: 1
2026-03-27 13:32:56 [ayvens.es] INFO: Extracting data for car ID: 1986806
2026-03-27 13:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfeee60f-6570-55c0-a147-8f11ca837787 with identifier: 1986806
2026-03-27 13:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfeee60f-6570-55c0-a147-8f11ca837787 with scrape type 1
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dfeee60f-6570-55c0-a147-8f11ca837787
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F090%252F2a7d438c29a74d8dbe97178d2828b174%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/090/2a7d438c29a74d8dbe97178d2828b174/images/large/1.jpg not downloaded yet
2026-03-27 13:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945cba10>
2026-03-27 13:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db3f53d-bbca-57bb-9d37-ea03df808da7/6db3f53d-bbca-57bb-9d37-ea03df808da7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F666%252Fb4f02b5fc41f4dc6aeaaab0644285ee6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/666/b4f02b5fc41f4dc6aeaaab0644285ee6/images/large/1.jpg saved to cache
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6db3f53d-bbca-57bb-9d37-ea03df808da7
2026-03-27 13:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6db3f53d-bbca-57bb-9d37-ea03df808da7, skipping ID generation
2026-03-27 13:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db3f53d-bbca-57bb-9d37-ea03df808da7 with scrape type 1
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6db3f53d-bbca-57bb-9d37-ea03df808da7 sending to next pipeline
2026-03-27 13:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6db3f53d-bbca-57bb-9d37-ea03df808da7, identifier: 1986798
2026-03-27 13:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6db3f53d-bbca-57bb-9d37-ea03df808da7 with identifier: 1986798
2026-03-27 13:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6db3f53d-bbca-57bb-9d37-ea03df808da7 with identifier: 1986798
2026-03-27 13:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6db3f53d-bbca-57bb-9d37-ea03df808da7 with identifier: 1986798 to the API
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/666/b4f02b5fc41f4dc6aeaaab0644285ee6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6db3f53d-bbca-57bb-9d37-ea03df808da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 147791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db3f53d-bbca-57bb-9d37-ea03df808da7/6db3f53d-bbca-57bb-9d37-ea03df808da7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/666/b4f02b5fc41f4dc6aeaaab0644285ee6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986798%27 HTTP/1.1" 200 None
2026-03-27 13:32:56 [ayvens.es] INFO: Saving data for 1986798: {'created_time': 1774618376.826562, 'last_price_update_time': 1774618376.826575, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986798') HTTP/1.1" 204 0
2026-03-27 13:32:56 [ayvens.es] INFO: Found listing with ID: 1986807
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986807%27 HTTP/1.1" 200 None
2026-03-27 13:32:56 [ayvens.es] INFO: Scrape type for 1986807: 1
2026-03-27 13:32:56 [ayvens.es] INFO: Extracting data for car ID: 1986807
2026-03-27 13:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f728c96e-97f2-5657-bce0-d4c9c0087f98 with identifier: 1986807
2026-03-27 13:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f728c96e-97f2-5657-bce0-d4c9c0087f98 with scrape type 1
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f728c96e-97f2-5657-bce0-d4c9c0087f98
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F708%252F0cc8567446e44069849e2e5b7683d0f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/708/0cc8567446e44069849e2e5b7683d0f4/images/large/1.jpg not downloaded yet
2026-03-27 13:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529601a210>
2026-03-27 13:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d697d28d-5691-5cc5-9317-c75a6012f52a/d697d28d-5691-5cc5-9317-c75a6012f52a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F41a48d7ad65245ceb08662e09303f91e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/41a48d7ad65245ceb08662e09303f91e/images/large/1.jpg saved to cache
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d697d28d-5691-5cc5-9317-c75a6012f52a
2026-03-27 13:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d697d28d-5691-5cc5-9317-c75a6012f52a, skipping ID generation
2026-03-27 13:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d697d28d-5691-5cc5-9317-c75a6012f52a with scrape type 1
2026-03-27 13:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d697d28d-5691-5cc5-9317-c75a6012f52a sending to next pipeline
2026-03-27 13:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d697d28d-5691-5cc5-9317-c75a6012f52a, identifier: 1986797
2026-03-27 13:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d697d28d-5691-5cc5-9317-c75a6012f52a with identifier: 1986797
2026-03-27 13:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d697d28d-5691-5cc5-9317-c75a6012f52a with identifier: 1986797
2026-03-27 13:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d697d28d-5691-5cc5-9317-c75a6012f52a with identifier: 1986797 to the API
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/41a48d7ad65245ceb08662e09303f91e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd697d28d-5691-5cc5-9317-c75a6012f52a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 130943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d697d28d-5691-5cc5-9317-c75a6012f52a/d697d28d-5691-5cc5-9317-c75a6012f52a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/41a48d7ad65245ceb08662e09303f91e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.5 TDCi 63kW Trend 5p',
 'transmission': 'manual',
 'trim': '1.5 TDCi 63kW Trend 5p',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986797%27 HTTP/1.1" 200 None
2026-03-27 13:32:57 [ayvens.es] INFO: Saving data for 1986797: {'created_time': 1774618377.389826, 'last_price_update_time': 1774618377.38984, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986797') HTTP/1.1" 204 0
2026-03-27 13:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295782dd0>
2026-03-27 13:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ceaec1-6605-523c-9a8a-bb963dbe0468/66ceaec1-6605-523c-9a8a-bb963dbe0468_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F701%252F7c824fe961374ca6ad15de99b200496b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/701/7c824fe961374ca6ad15de99b200496b/images/large/1.jpg saved to cache
2026-03-27 13:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66ceaec1-6605-523c-9a8a-bb963dbe0468
2026-03-27 13:32:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66ceaec1-6605-523c-9a8a-bb963dbe0468, skipping ID generation
2026-03-27 13:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ceaec1-6605-523c-9a8a-bb963dbe0468 with scrape type 1
2026-03-27 13:32:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66ceaec1-6605-523c-9a8a-bb963dbe0468 sending to next pipeline
2026-03-27 13:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 66ceaec1-6605-523c-9a8a-bb963dbe0468, identifier: 1986799
2026-03-27 13:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4ffd0>
2026-03-27 13:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4929c8a-adf9-5dfb-a57f-34c99131f798/e4929c8a-adf9-5dfb-a57f-34c99131f798_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252F48826fda24054d8eb001176f178f471f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/48826fda24054d8eb001176f178f471f/images/large/1.jpg saved to cache
2026-03-27 13:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4929c8a-adf9-5dfb-a57f-34c99131f798
2026-03-27 13:32:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4929c8a-adf9-5dfb-a57f-34c99131f798, skipping ID generation
2026-03-27 13:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4929c8a-adf9-5dfb-a57f-34c99131f798 with scrape type 1
2026-03-27 13:32:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4929c8a-adf9-5dfb-a57f-34c99131f798 sending to next pipeline
2026-03-27 13:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e4929c8a-adf9-5dfb-a57f-34c99131f798, identifier: 1986800
2026-03-27 13:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/021/e2188eece0b94809a2d5ab96dc9bfe42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/968/87f8514736504162b11112462cf0a68b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:57 [ayvens.es] INFO: Found listing with ID: 1986808
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986808%27 HTTP/1.1" 200 None
2026-03-27 13:32:57 [ayvens.es] INFO: Scrape type for 1986808: 1
2026-03-27 13:32:57 [ayvens.es] INFO: Extracting data for car ID: 1986808
2026-03-27 13:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cd584a2-74e6-55fe-8697-21f736967174 with identifier: 1986808
2026-03-27 13:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cd584a2-74e6-55fe-8697-21f736967174 with scrape type 1
2026-03-27 13:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7cd584a2-74e6-55fe-8697-21f736967174
2026-03-27 13:32:57 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7cd584a2-74e6-55fe-8697-21f736967174
2026-03-27 13:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7cd584a2-74e6-55fe-8697-21f736967174, identifier: 1986808
2026-03-27 13:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 66ceaec1-6605-523c-9a8a-bb963dbe0468 with identifier: 1986799
2026-03-27 13:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 66ceaec1-6605-523c-9a8a-bb963dbe0468 with identifier: 1986799
2026-03-27 13:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 66ceaec1-6605-523c-9a8a-bb963dbe0468 with identifier: 1986799 to the API
2026-03-27 13:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/701/7c824fe961374ca6ad15de99b200496b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '66ceaec1-6605-523c-9a8a-bb963dbe0468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA X',
 'odometer': 125997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ceaec1-6605-523c-9a8a-bb963dbe0468/66ceaec1-6605-523c-9a8a-bb963dbe0468_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/701/7c824fe961374ca6ad15de99b200496b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA X 1.6 CDTi 100kW 4X4 S&S Selective',
 'transmission': 'manual',
 'trim': '1.6 CDTi 100kW 4X4 S&S Selective',
 'vin': None,
 'year': 2019}
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986799%27 HTTP/1.1" 200 None
2026-03-27 13:32:58 [ayvens.es] INFO: Saving data for 1986799: {'created_time': 1774618378.684312, 'last_price_update_time': 1774618378.684324, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986799') HTTP/1.1" 204 0
2026-03-27 13:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e4929c8a-adf9-5dfb-a57f-34c99131f798 with identifier: 1986800
2026-03-27 13:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e4929c8a-adf9-5dfb-a57f-34c99131f798 with identifier: 1986800
2026-03-27 13:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e4929c8a-adf9-5dfb-a57f-34c99131f798 with identifier: 1986800 to the API
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/595/48826fda24054d8eb001176f178f471f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e4929c8a-adf9-5dfb-a57f-34c99131f798',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 143053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4929c8a-adf9-5dfb-a57f-34c99131f798/e4929c8a-adf9-5dfb-a57f-34c99131f798_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/595/48826fda24054d8eb001176f178f471f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Pro 1.5 BlueHDi 120 S&S Standard',
 'transmission': 'manual',
 'trim': 'Furgon Pro 1.5 BlueHDi 120 S&S Standard',
 'vin': None,
 'year': 2021}
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986800%27 HTTP/1.1" 200 None
2026-03-27 13:32:58 [ayvens.es] INFO: Saving data for 1986800: {'created_time': 1774618378.989887, 'last_price_update_time': 1774618378.989897, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986800') HTTP/1.1" 204 0
2026-03-27 13:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7cd584a2-74e6-55fe-8697-21f736967174 with identifier: 1986808
2026-03-27 13:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7cd584a2-74e6-55fe-8697-21f736967174 with identifier: 1986808
2026-03-27 13:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7cd584a2-74e6-55fe-8697-21f736967174 with identifier: 1986808 to the API
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7cd584a2-74e6-55fe-8697-21f736967174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 71223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seats_number': 8,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Passenger Energy Blue dCi 88 kW (120 CV)',
 'transmission': 'manual',
 'trim': 'Passenger Energy Blue dCi 88 kW (120 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986808%27 HTTP/1.1" 200 None
2026-03-27 13:32:59 [ayvens.es] INFO: Saving data for 1986808: {'created_time': 1774618379.308038, 'last_price_update_time': 1774618379.30805, 'auction_closing_time': 1774868400.0}
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986808') HTTP/1.1" 204 0
2026-03-27 13:32:59 [ayvens.es] INFO: Found listing with ID: 1986809
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986809%27 HTTP/1.1" 200 None
2026-03-27 13:32:59 [ayvens.es] INFO: Scrape type for 1986809: 1
2026-03-27 13:32:59 [ayvens.es] INFO: Extracting data for car ID: 1986809
2026-03-27 13:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0989303d-f009-5008-b7b0-0a03f720f5d6 with identifier: 1986809
2026-03-27 13:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0989303d-f009-5008-b7b0-0a03f720f5d6 with scrape type 1
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0989303d-f009-5008-b7b0-0a03f720f5d6
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F66a7872fdb7247bea1cb252b04c1dff8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/66a7872fdb7247bea1cb252b04c1dff8/images/large/1.jpg not downloaded yet
2026-03-27 13:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/799/4a0a6eefc3f14ba4ad87c695c8e370de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f78510>
2026-03-27 13:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0efe4f-949a-575d-933c-08d3db671cdb/5b0efe4f-949a-575d-933c-08d3db671cdb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252Fe2188eece0b94809a2d5ab96dc9bfe42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/e2188eece0b94809a2d5ab96dc9bfe42/images/large/1.jpg saved to cache
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b0efe4f-949a-575d-933c-08d3db671cdb
2026-03-27 13:32:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b0efe4f-949a-575d-933c-08d3db671cdb, skipping ID generation
2026-03-27 13:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0efe4f-949a-575d-933c-08d3db671cdb with scrape type 1
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b0efe4f-949a-575d-933c-08d3db671cdb sending to next pipeline
2026-03-27 13:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5b0efe4f-949a-575d-933c-08d3db671cdb, identifier: 1986801
2026-03-27 13:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529575fa10>
2026-03-27 13:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e044a03-4925-54f9-b1fb-2b18baf84fb8/7e044a03-4925-54f9-b1fb-2b18baf84fb8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F968%252F87f8514736504162b11112462cf0a68b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/968/87f8514736504162b11112462cf0a68b/images/large/1.jpg saved to cache
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e044a03-4925-54f9-b1fb-2b18baf84fb8
2026-03-27 13:32:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e044a03-4925-54f9-b1fb-2b18baf84fb8, skipping ID generation
2026-03-27 13:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e044a03-4925-54f9-b1fb-2b18baf84fb8 with scrape type 1
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e044a03-4925-54f9-b1fb-2b18baf84fb8 sending to next pipeline
2026-03-27 13:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7e044a03-4925-54f9-b1fb-2b18baf84fb8, identifier: 1986802
2026-03-27 13:32:59 [ayvens.es] INFO: Found listing with ID: 1986810
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986810%27 HTTP/1.1" 200 None
2026-03-27 13:32:59 [ayvens.es] INFO: Scrape type for 1986810: 1
2026-03-27 13:32:59 [ayvens.es] INFO: Extracting data for car ID: 1986810
2026-03-27 13:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b2825e3-0109-546f-97d6-022759060fcf with identifier: 1986810
2026-03-27 13:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b2825e3-0109-546f-97d6-022759060fcf with scrape type 1
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5b2825e3-0109-546f-97d6-022759060fcf
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F761%252F61085ef2f83446519deafcf78e053bfb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/761/61085ef2f83446519deafcf78e053bfb/images/large/1.jpg not downloaded yet
2026-03-27 13:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5b0efe4f-949a-575d-933c-08d3db671cdb with identifier: 1986801
2026-03-27 13:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5b0efe4f-949a-575d-933c-08d3db671cdb with identifier: 1986801
2026-03-27 13:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5b0efe4f-949a-575d-933c-08d3db671cdb with identifier: 1986801 to the API
2026-03-27 13:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/021/e2188eece0b94809a2d5ab96dc9bfe42/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5b0efe4f-949a-575d-933c-08d3db671cdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 133726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0efe4f-949a-575d-933c-08d3db671cdb/5b0efe4f-949a-575d-933c-08d3db671cdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/021/e2188eece0b94809a2d5ab96dc9bfe42/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Variant Business 2.0 TDI 90kW (122CV) DS',
 'transmission': 'manual',
 'trim': 'Variant Business 2.0 TDI 90kW (122CV) DS',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986801%27 HTTP/1.1" 200 None
2026-03-27 13:33:00 [ayvens.es] INFO: Saving data for 1986801: {'created_time': 1774618380.746112, 'last_price_update_time': 1774618380.746123, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986801') HTTP/1.1" 204 0
2026-03-27 13:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7e044a03-4925-54f9-b1fb-2b18baf84fb8 with identifier: 1986802
2026-03-27 13:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7e044a03-4925-54f9-b1fb-2b18baf84fb8 with identifier: 1986802
2026-03-27 13:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7e044a03-4925-54f9-b1fb-2b18baf84fb8 with identifier: 1986802 to the API
2026-03-27 13:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/968/87f8514736504162b11112462cf0a68b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'gas',
 'id': '7e044a03-4925-54f9-b1fb-2b18baf84fb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 97196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e044a03-4925-54f9-b1fb-2b18baf84fb8/7e044a03-4925-54f9-b1fb-2b18baf84fb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/968/87f8514736504162b11112462cf0a68b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.5 TGI 96kW (130CV) S&S Style Visio Ed',
 'transmission': 'manual',
 'trim': '1.5 TGI 96kW (130CV) S&S Style Visio Ed',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986802%27 HTTP/1.1" 200 None
2026-03-27 13:33:01 [ayvens.es] INFO: Saving data for 1986802: {'created_time': 1774618381.169842, 'last_price_update_time': 1774618381.169852, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986802') HTTP/1.1" 204 0
2026-03-27 13:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/090/2a7d438c29a74d8dbe97178d2828b174/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:01 [ayvens.es] INFO: Found listing with ID: 1986811
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986811%27 HTTP/1.1" 200 None
2026-03-27 13:33:01 [ayvens.es] INFO: Scrape type for 1986811: 1
2026-03-27 13:33:01 [ayvens.es] INFO: Extracting data for car ID: 1986811
2026-03-27 13:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cece9be-6047-5c2e-b42a-ddddf8acd56f with identifier: 1986811
2026-03-27 13:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f with scrape type 1
2026-03-27 13:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F283599eca3e94ca5a9450a60e3763ea9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/283599eca3e94ca5a9450a60e3763ea9/images/large/1.jpg not downloaded yet
2026-03-27 13:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529579edd0>
2026-03-27 13:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0551ad0b-2989-5227-9a62-5ffc1e520779/0551ad0b-2989-5227-9a62-5ffc1e520779_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F799%252F4a0a6eefc3f14ba4ad87c695c8e370de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/799/4a0a6eefc3f14ba4ad87c695c8e370de/images/large/1.jpg saved to cache
2026-03-27 13:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0551ad0b-2989-5227-9a62-5ffc1e520779
2026-03-27 13:33:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0551ad0b-2989-5227-9a62-5ffc1e520779, skipping ID generation
2026-03-27 13:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0551ad0b-2989-5227-9a62-5ffc1e520779 with scrape type 1
2026-03-27 13:33:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0551ad0b-2989-5227-9a62-5ffc1e520779 sending to next pipeline
2026-03-27 13:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0551ad0b-2989-5227-9a62-5ffc1e520779, identifier: 1986803
2026-03-27 13:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0551ad0b-2989-5227-9a62-5ffc1e520779 with identifier: 1986803
2026-03-27 13:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0551ad0b-2989-5227-9a62-5ffc1e520779 with identifier: 1986803
2026-03-27 13:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0551ad0b-2989-5227-9a62-5ffc1e520779 with identifier: 1986803 to the API
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/799/4a0a6eefc3f14ba4ad87c695c8e370de/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0551ad0b-2989-5227-9a62-5ffc1e520779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 106273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0551ad0b-2989-5227-9a62-5ffc1e520779/0551ad0b-2989-5227-9a62-5ffc1e520779_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/799/4a0a6eefc3f14ba4ad87c695c8e370de/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 2.0 TDI 110kW S&S Xcellence',
 'transmission': 'manual',
 'trim': 'ST 2.0 TDI 110kW S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986803%27 HTTP/1.1" 200 None
2026-03-27 13:33:01 [ayvens.es] INFO: Saving data for 1986803: {'created_time': 1774618381.876571, 'last_price_update_time': 1774618381.876582, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986803') HTTP/1.1" 204 0
2026-03-27 13:33:01 [ayvens.es] INFO: Found listing with ID: 1986812
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986812%27 HTTP/1.1" 200 None
2026-03-27 13:33:01 [ayvens.es] INFO: Scrape type for 1986812: 1
2026-03-27 13:33:01 [ayvens.es] INFO: Extracting data for car ID: 1986812
2026-03-27 13:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with identifier: 1986812
2026-03-27 13:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with scrape type 1
2026-03-27 13:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F1ad16a24153f4e8ebd628e2330a0921d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/1ad16a24153f4e8ebd628e2330a0921d/images/large/1.jpg not downloaded yet
2026-03-27 13:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/636/46628145b04547408f8f37944f6b829d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296086a90>
2026-03-27 13:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfeee60f-6570-55c0-a147-8f11ca837787/dfeee60f-6570-55c0-a147-8f11ca837787_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F090%252F2a7d438c29a74d8dbe97178d2828b174%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/090/2a7d438c29a74d8dbe97178d2828b174/images/large/1.jpg saved to cache
2026-03-27 13:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfeee60f-6570-55c0-a147-8f11ca837787
2026-03-27 13:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfeee60f-6570-55c0-a147-8f11ca837787, skipping ID generation
2026-03-27 13:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfeee60f-6570-55c0-a147-8f11ca837787 with scrape type 1
2026-03-27 13:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfeee60f-6570-55c0-a147-8f11ca837787 sending to next pipeline
2026-03-27 13:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dfeee60f-6570-55c0-a147-8f11ca837787, identifier: 1986806
2026-03-27 13:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/708/0cc8567446e44069849e2e5b7683d0f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:02 [ayvens.es] INFO: Found listing with ID: 1986813
2026-03-27 13:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986813%27 HTTP/1.1" 200 None
2026-03-27 13:33:02 [ayvens.es] INFO: Scrape type for 1986813: 1
2026-03-27 13:33:02 [ayvens.es] INFO: Extracting data for car ID: 1986813
2026-03-27 13:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35705818-60a6-5729-95b3-94a5b53e2ba7 with identifier: 1986813
2026-03-27 13:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35705818-60a6-5729-95b3-94a5b53e2ba7 with scrape type 1
2026-03-27 13:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35705818-60a6-5729-95b3-94a5b53e2ba7
2026-03-27 13:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F091%252F9de8ae3af0f444069edc863b5942122a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/091/9de8ae3af0f444069edc863b5942122a/images/large/1.jpg not downloaded yet
2026-03-27 13:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dfeee60f-6570-55c0-a147-8f11ca837787 with identifier: 1986806
2026-03-27 13:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dfeee60f-6570-55c0-a147-8f11ca837787 with identifier: 1986806
2026-03-27 13:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dfeee60f-6570-55c0-a147-8f11ca837787 with identifier: 1986806 to the API
2026-03-27 13:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/090/2a7d438c29a74d8dbe97178d2828b174/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dfeee60f-6570-55c0-a147-8f11ca837787',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 95851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfeee60f-6570-55c0-a147-8f11ca837787/dfeee60f-6570-55c0-a147-8f11ca837787_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/090/2a7d438c29a74d8dbe97178d2828b174/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Sencilla GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Sencilla GX',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986806%27 HTTP/1.1" 200 None
2026-03-27 13:33:04 [ayvens.es] INFO: Saving data for 1986806: {'created_time': 1774618384.146632, 'last_price_update_time': 1774618384.146642, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986806') HTTP/1.1" 204 0
2026-03-27 13:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/499/66a7872fdb7247bea1cb252b04c1dff8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:04 [ayvens.es] INFO: Found listing with ID: 1986814
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986814%27 HTTP/1.1" 200 None
2026-03-27 13:33:04 [ayvens.es] INFO: Scrape type for 1986814: 1
2026-03-27 13:33:04 [ayvens.es] INFO: Extracting data for car ID: 1986814
2026-03-27 13:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6595c968-3508-594e-ad76-045bf5ce51e9 with identifier: 1986814
2026-03-27 13:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6595c968-3508-594e-ad76-045bf5ce51e9 with scrape type 1
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6595c968-3508-594e-ad76-045bf5ce51e9
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F759%252Fd6f040c63b48432a86a62c04c85c48c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/759/d6f040c63b48432a86a62c04c85c48c2/images/large/1.jpg not downloaded yet
2026-03-27 13:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f8fdd0>
2026-03-27 13:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7147f72c-1fe1-57ee-a9c6-81bdc138e5f7/7147f72c-1fe1-57ee-a9c6-81bdc138e5f7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F636%252F46628145b04547408f8f37944f6b829d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/636/46628145b04547408f8f37944f6b829d/images/large/1.jpg saved to cache
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7
2026-03-27 13:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7, skipping ID generation
2026-03-27 13:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7 with scrape type 1
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7 sending to next pipeline
2026-03-27 13:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7, identifier: 1986805
2026-03-27 13:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f71b90>
2026-03-27 13:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f728c96e-97f2-5657-bce0-d4c9c0087f98/f728c96e-97f2-5657-bce0-d4c9c0087f98_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F708%252F0cc8567446e44069849e2e5b7683d0f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/708/0cc8567446e44069849e2e5b7683d0f4/images/large/1.jpg saved to cache
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f728c96e-97f2-5657-bce0-d4c9c0087f98
2026-03-27 13:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f728c96e-97f2-5657-bce0-d4c9c0087f98, skipping ID generation
2026-03-27 13:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f728c96e-97f2-5657-bce0-d4c9c0087f98 with scrape type 1
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f728c96e-97f2-5657-bce0-d4c9c0087f98 sending to next pipeline
2026-03-27 13:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f728c96e-97f2-5657-bce0-d4c9c0087f98, identifier: 1986807
2026-03-27 13:33:04 [ayvens.es] INFO: Found listing with ID: 1986815
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986815%27 HTTP/1.1" 200 None
2026-03-27 13:33:04 [ayvens.es] INFO: Scrape type for 1986815: 1
2026-03-27 13:33:04 [ayvens.es] INFO: Extracting data for car ID: 1986815
2026-03-27 13:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e1e89a-4f12-5a14-81e6-84083a3b0b01 with identifier: 1986815
2026-03-27 13:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e1e89a-4f12-5a14-81e6-84083a3b0b01 with scrape type 1
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45e1e89a-4f12-5a14-81e6-84083a3b0b01
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F75664aee90e140eebb0afd3dfbce3b0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/75664aee90e140eebb0afd3dfbce3b0d/images/large/1.jpg not downloaded yet
2026-03-27 13:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7 with identifier: 1986805
2026-03-27 13:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7 with identifier: 1986805
2026-03-27 13:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7147f72c-1fe1-57ee-a9c6-81bdc138e5f7 with identifier: 1986805 to the API
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/636/46628145b04547408f8f37944f6b829d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '7147f72c-1fe1-57ee-a9c6-81bdc138e5f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 92860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7147f72c-1fe1-57ee-a9c6-81bdc138e5f7/7147f72c-1fe1-57ee-a9c6-81bdc138e5f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/636/46628145b04547408f8f37944f6b829d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TSI 140kW DSG 4Drive St&Sp FR',
 'transmission': 'manual',
 'trim': '2.0 TSI 140kW DSG 4Drive St&Sp FR',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986805%27 HTTP/1.1" 200 None
2026-03-27 13:33:04 [ayvens.es] INFO: Saving data for 1986805: {'created_time': 1774618384.95807, 'last_price_update_time': 1774618384.958081, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986805') HTTP/1.1" 204 0
2026-03-27 13:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f728c96e-97f2-5657-bce0-d4c9c0087f98 with identifier: 1986807
2026-03-27 13:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f728c96e-97f2-5657-bce0-d4c9c0087f98 with identifier: 1986807
2026-03-27 13:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f728c96e-97f2-5657-bce0-d4c9c0087f98 with identifier: 1986807 to the API
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/708/0cc8567446e44069849e2e5b7683d0f4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f728c96e-97f2-5657-bce0-d4c9c0087f98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 33284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f728c96e-97f2-5657-bce0-d4c9c0087f98/f728c96e-97f2-5657-bce0-d4c9c0087f98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/708/0cc8567446e44069849e2e5b7683d0f4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986807%27 HTTP/1.1" 200 None
2026-03-27 13:33:05 [ayvens.es] INFO: Saving data for 1986807: {'created_time': 1774618385.374059, 'last_price_update_time': 1774618385.37407, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986807') HTTP/1.1" 204 0
2026-03-27 13:33:05 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 0 pages/min), scraped 245 items (at 93 items/min)
2026-03-27 13:33:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-27 13:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/761/61085ef2f83446519deafcf78e053bfb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:05 [ayvens.es] INFO: Found listing with ID: 1986816
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986816%27 HTTP/1.1" 200 None
2026-03-27 13:33:05 [ayvens.es] INFO: Scrape type for 1986816: 1
2026-03-27 13:33:05 [ayvens.es] INFO: Extracting data for car ID: 1986816
2026-03-27 13:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab505f16-ca93-5308-924b-957be45c9bce with identifier: 1986816
2026-03-27 13:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab505f16-ca93-5308-924b-957be45c9bce with scrape type 1
2026-03-27 13:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab505f16-ca93-5308-924b-957be45c9bce
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F981%252Fc8f06b74e93c4cfe967cc4faa3f31b20%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/981/c8f06b74e93c4cfe967cc4faa3f31b20/images/large/1.jpg not downloaded yet
2026-03-27 13:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bdee90>
2026-03-27 13:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0989303d-f009-5008-b7b0-0a03f720f5d6/0989303d-f009-5008-b7b0-0a03f720f5d6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F66a7872fdb7247bea1cb252b04c1dff8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/66a7872fdb7247bea1cb252b04c1dff8/images/large/1.jpg saved to cache
2026-03-27 13:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0989303d-f009-5008-b7b0-0a03f720f5d6
2026-03-27 13:33:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0989303d-f009-5008-b7b0-0a03f720f5d6, skipping ID generation
2026-03-27 13:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0989303d-f009-5008-b7b0-0a03f720f5d6 with scrape type 1
2026-03-27 13:33:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0989303d-f009-5008-b7b0-0a03f720f5d6 sending to next pipeline
2026-03-27 13:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0989303d-f009-5008-b7b0-0a03f720f5d6, identifier: 1986809
2026-03-27 13:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0989303d-f009-5008-b7b0-0a03f720f5d6 with identifier: 1986809
2026-03-27 13:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0989303d-f009-5008-b7b0-0a03f720f5d6 with identifier: 1986809
2026-03-27 13:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0989303d-f009-5008-b7b0-0a03f720f5d6 with identifier: 1986809 to the API
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/499/66a7872fdb7247bea1cb252b04c1dff8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0989303d-f009-5008-b7b0-0a03f720f5d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 74589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0989303d-f009-5008-b7b0-0a03f720f5d6/0989303d-f009-5008-b7b0-0a03f720f5d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/499/66a7872fdb7247bea1cb252b04c1dff8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Ecomotive',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Ecomotive',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986809%27 HTTP/1.1" 200 None
2026-03-27 13:33:05 [ayvens.es] INFO: Saving data for 1986809: {'created_time': 1774618385.930896, 'last_price_update_time': 1774618385.930907, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986809') HTTP/1.1" 204 0
2026-03-27 13:33:05 [ayvens.es] INFO: Found listing with ID: 1986817
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986817%27 HTTP/1.1" 200 None
2026-03-27 13:33:05 [ayvens.es] INFO: Scrape type for 1986817: 1
2026-03-27 13:33:05 [ayvens.es] INFO: Extracting data for car ID: 1986817
2026-03-27 13:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99a55ee-bcc2-5541-8388-5fcb9c032098 with identifier: 1986817
2026-03-27 13:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a55ee-bcc2-5541-8388-5fcb9c032098 with scrape type 1
2026-03-27 13:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c99a55ee-bcc2-5541-8388-5fcb9c032098
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F843%252F5671ba1f735541b998ff5546b7288aa2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/843/5671ba1f735541b998ff5546b7288aa2/images/large/1.jpg not downloaded yet
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956fef50>
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b2825e3-0109-546f-97d6-022759060fcf/5b2825e3-0109-546f-97d6-022759060fcf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F761%252F61085ef2f83446519deafcf78e053bfb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/761/61085ef2f83446519deafcf78e053bfb/images/large/1.jpg saved to cache
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b2825e3-0109-546f-97d6-022759060fcf
2026-03-27 13:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b2825e3-0109-546f-97d6-022759060fcf, skipping ID generation
2026-03-27 13:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b2825e3-0109-546f-97d6-022759060fcf with scrape type 1
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b2825e3-0109-546f-97d6-022759060fcf sending to next pipeline
2026-03-27 13:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5b2825e3-0109-546f-97d6-022759060fcf, identifier: 1986810
2026-03-27 13:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/057/283599eca3e94ca5a9450a60e3763ea9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/993/1ad16a24153f4e8ebd628e2330a0921d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:06 [ayvens.es] INFO: Found listing with ID: 1986818
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986818%27 HTTP/1.1" 200 None
2026-03-27 13:33:06 [ayvens.es] INFO: Scrape type for 1986818: 1
2026-03-27 13:33:06 [ayvens.es] INFO: Extracting data for car ID: 1986818
2026-03-27 13:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with identifier: 1986818
2026-03-27 13:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with scrape type 1
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Ff3c02d5ebf1a49b7aacbf07237c1edb3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/f3c02d5ebf1a49b7aacbf07237c1edb3/images/large/1.jpg not downloaded yet
2026-03-27 13:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5b2825e3-0109-546f-97d6-022759060fcf with identifier: 1986810
2026-03-27 13:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5b2825e3-0109-546f-97d6-022759060fcf with identifier: 1986810
2026-03-27 13:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5b2825e3-0109-546f-97d6-022759060fcf with identifier: 1986810 to the API
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/761/61085ef2f83446519deafcf78e053bfb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5b2825e3-0109-546f-97d6-022759060fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 50760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b2825e3-0109-546f-97d6-022759060fcf/5b2825e3-0109-546f-97d6-022759060fcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/761/61085ef2f83446519deafcf78e053bfb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE (O) Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': '(O) Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986810%27 HTTP/1.1" 200 None
2026-03-27 13:33:06 [ayvens.es] INFO: Saving data for 1986810: {'created_time': 1774618386.61529, 'last_price_update_time': 1774618386.615301, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986810') HTTP/1.1" 204 0
2026-03-27 13:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/091/9de8ae3af0f444069edc863b5942122a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:06 [ayvens.es] INFO: Found listing with ID: 1986819
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986819%27 HTTP/1.1" 200 None
2026-03-27 13:33:06 [ayvens.es] INFO: Scrape type for 1986819: 1
2026-03-27 13:33:06 [ayvens.es] INFO: Extracting data for car ID: 1986819
2026-03-27 13:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0091f576-c44c-56be-a2e1-669cdba797f2 with identifier: 1986819
2026-03-27 13:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0091f576-c44c-56be-a2e1-669cdba797f2 with scrape type 1
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0091f576-c44c-56be-a2e1-669cdba797f2
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F995%252F64b165c6aa8649dc9a0c3fb47a9dc39d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/995/64b165c6aa8649dc9a0c3fb47a9dc39d/images/large/1.jpg not downloaded yet
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956ffd50>
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cece9be-6047-5c2e-b42a-ddddf8acd56f/5cece9be-6047-5c2e-b42a-ddddf8acd56f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F283599eca3e94ca5a9450a60e3763ea9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/283599eca3e94ca5a9450a60e3763ea9/images/large/1.jpg saved to cache
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f
2026-03-27 13:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cece9be-6047-5c2e-b42a-ddddf8acd56f, skipping ID generation
2026-03-27 13:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f with scrape type 1
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cece9be-6047-5c2e-b42a-ddddf8acd56f sending to next pipeline
2026-03-27 13:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5cece9be-6047-5c2e-b42a-ddddf8acd56f, identifier: 1986811
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945e1dd0>
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ba062c-67a7-5ba5-ac0f-3889f8cb7395/87ba062c-67a7-5ba5-ac0f-3889f8cb7395_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F1ad16a24153f4e8ebd628e2330a0921d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/1ad16a24153f4e8ebd628e2330a0921d/images/large/1.jpg saved to cache
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395
2026-03-27 13:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395, skipping ID generation
2026-03-27 13:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with scrape type 1
2026-03-27 13:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 sending to next pipeline
2026-03-27 13:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395, identifier: 1986812
2026-03-27 13:33:07 [ayvens.es] INFO: Found listing with ID: 1986820
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986820%27 HTTP/1.1" 200 None
2026-03-27 13:33:07 [ayvens.es] INFO: Scrape type for 1986820: 1
2026-03-27 13:33:07 [ayvens.es] INFO: Extracting data for car ID: 1986820
2026-03-27 13:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e41d825d-8617-5875-afe1-3c8c529cb3ec with identifier: 1986820
2026-03-27 13:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e41d825d-8617-5875-afe1-3c8c529cb3ec with scrape type 1
2026-03-27 13:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e41d825d-8617-5875-afe1-3c8c529cb3ec
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F611%252Ffcc5eb63c44540ccb65d4f956ba40073%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/611/fcc5eb63c44540ccb65d4f956ba40073/images/large/1.jpg not downloaded yet
2026-03-27 13:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5cece9be-6047-5c2e-b42a-ddddf8acd56f with identifier: 1986811
2026-03-27 13:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5cece9be-6047-5c2e-b42a-ddddf8acd56f with identifier: 1986811
2026-03-27 13:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5cece9be-6047-5c2e-b42a-ddddf8acd56f with identifier: 1986811 to the API
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/057/283599eca3e94ca5a9450a60e3763ea9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5cece9be-6047-5c2e-b42a-ddddf8acd56f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 86693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cece9be-6047-5c2e-b42a-ddddf8acd56f/5cece9be-6047-5c2e-b42a-ddddf8acd56f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/057/283599eca3e94ca5a9450a60e3763ea9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986811%27 HTTP/1.1" 200 None
2026-03-27 13:33:07 [ayvens.es] INFO: Saving data for 1986811: {'created_time': 1774618387.371804, 'last_price_update_time': 1774618387.371817, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986811') HTTP/1.1" 204 0
2026-03-27 13:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with identifier: 1986812
2026-03-27 13:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with identifier: 1986812
2026-03-27 13:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with identifier: 1986812 to the API
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/993/1ad16a24153f4e8ebd628e2330a0921d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '87ba062c-67a7-5ba5-ac0f-3889f8cb7395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 187164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ba062c-67a7-5ba5-ac0f-3889f8cb7395/87ba062c-67a7-5ba5-ac0f-3889f8cb7395_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/993/1ad16a24153f4e8ebd628e2330a0921d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986812%27 HTTP/1.1" 200 None
2026-03-27 13:33:07 [ayvens.es] INFO: Saving data for 1986812: {'created_time': 1774618387.712116, 'last_price_update_time': 1774618387.712127, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986812') HTTP/1.1" 204 0
2026-03-27 13:33:07 [ayvens.es] INFO: Found listing with ID: 1986821
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986821%27 HTTP/1.1" 200 None
2026-03-27 13:33:07 [ayvens.es] INFO: Scrape type for 1986821: 1
2026-03-27 13:33:07 [ayvens.es] INFO: Extracting data for car ID: 1986821
2026-03-27 13:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e3a2d0-1846-59f9-8c8f-ea42f3104925 with identifier: 1986821
2026-03-27 13:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e3a2d0-1846-59f9-8c8f-ea42f3104925 with scrape type 1
2026-03-27 13:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1e3a2d0-1846-59f9-8c8f-ea42f3104925
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252F3393d930d49d45eaa6c453a53a651529%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/3393d930d49d45eaa6c453a53a651529/images/large/1.jpg not downloaded yet
2026-03-27 13:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/759/d6f040c63b48432a86a62c04c85c48c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/993/75664aee90e140eebb0afd3dfbce3b0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961aa650>
2026-03-27 13:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35705818-60a6-5729-95b3-94a5b53e2ba7/35705818-60a6-5729-95b3-94a5b53e2ba7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F091%252F9de8ae3af0f444069edc863b5942122a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/091/9de8ae3af0f444069edc863b5942122a/images/large/1.jpg saved to cache
2026-03-27 13:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35705818-60a6-5729-95b3-94a5b53e2ba7
2026-03-27 13:33:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35705818-60a6-5729-95b3-94a5b53e2ba7, skipping ID generation
2026-03-27 13:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35705818-60a6-5729-95b3-94a5b53e2ba7 with scrape type 1
2026-03-27 13:33:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35705818-60a6-5729-95b3-94a5b53e2ba7 sending to next pipeline
2026-03-27 13:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 35705818-60a6-5729-95b3-94a5b53e2ba7, identifier: 1986813
2026-03-27 13:33:08 [ayvens.es] INFO: Found listing with ID: 1986822
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986822%27 HTTP/1.1" 200 None
2026-03-27 13:33:08 [ayvens.es] INFO: Scrape type for 1986822: 1
2026-03-27 13:33:08 [ayvens.es] INFO: Extracting data for car ID: 1986822
2026-03-27 13:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf22be2-2b13-5dc8-8090-83dae83a68bc with identifier: 1986822
2026-03-27 13:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf22be2-2b13-5dc8-8090-83dae83a68bc with scrape type 1
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fdf22be2-2b13-5dc8-8090-83dae83a68bc
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F207%252F8777e706028949158ea7fd9a03777b46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/207/8777e706028949158ea7fd9a03777b46/images/large/1.jpg not downloaded yet
2026-03-27 13:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 35705818-60a6-5729-95b3-94a5b53e2ba7 with identifier: 1986813
2026-03-27 13:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 35705818-60a6-5729-95b3-94a5b53e2ba7 with identifier: 1986813
2026-03-27 13:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 35705818-60a6-5729-95b3-94a5b53e2ba7 with identifier: 1986813 to the API
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/091/9de8ae3af0f444069edc863b5942122a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '35705818-60a6-5729-95b3-94a5b53e2ba7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 152228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35705818-60a6-5729-95b3-94a5b53e2ba7/35705818-60a6-5729-95b3-94a5b53e2ba7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/091/9de8ae3af0f444069edc863b5942122a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Intens Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Intens Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986813%27 HTTP/1.1" 200 None
2026-03-27 13:33:08 [ayvens.es] INFO: Saving data for 1986813: {'created_time': 1774618388.465799, 'last_price_update_time': 1774618388.465809, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986813') HTTP/1.1" 204 0
2026-03-27 13:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/843/5671ba1f735541b998ff5546b7288aa2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:08 [ayvens.es] INFO: Found listing with ID: 1986823
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986823%27 HTTP/1.1" 200 None
2026-03-27 13:33:08 [ayvens.es] INFO: Scrape type for 1986823: 1
2026-03-27 13:33:08 [ayvens.es] INFO: Extracting data for car ID: 1986823
2026-03-27 13:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee040410-ebc4-5963-b54b-825b669082e2 with identifier: 1986823
2026-03-27 13:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee040410-ebc4-5963-b54b-825b669082e2 with scrape type 1
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee040410-ebc4-5963-b54b-825b669082e2
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F521%252F6ac0a5ffd80a487ca471b662033e8c37%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/521/6ac0a5ffd80a487ca471b662033e8c37/images/large/1.jpg not downloaded yet
2026-03-27 13:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/981/c8f06b74e93c4cfe967cc4faa3f31b20/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960da310>
2026-03-27 13:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6595c968-3508-594e-ad76-045bf5ce51e9/6595c968-3508-594e-ad76-045bf5ce51e9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F759%252Fd6f040c63b48432a86a62c04c85c48c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/759/d6f040c63b48432a86a62c04c85c48c2/images/large/1.jpg saved to cache
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6595c968-3508-594e-ad76-045bf5ce51e9
2026-03-27 13:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6595c968-3508-594e-ad76-045bf5ce51e9, skipping ID generation
2026-03-27 13:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6595c968-3508-594e-ad76-045bf5ce51e9 with scrape type 1
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6595c968-3508-594e-ad76-045bf5ce51e9 sending to next pipeline
2026-03-27 13:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6595c968-3508-594e-ad76-045bf5ce51e9, identifier: 1986814
2026-03-27 13:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945ead10>
2026-03-27 13:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e1e89a-4f12-5a14-81e6-84083a3b0b01/45e1e89a-4f12-5a14-81e6-84083a3b0b01_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F75664aee90e140eebb0afd3dfbce3b0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/75664aee90e140eebb0afd3dfbce3b0d/images/large/1.jpg saved to cache
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45e1e89a-4f12-5a14-81e6-84083a3b0b01
2026-03-27 13:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45e1e89a-4f12-5a14-81e6-84083a3b0b01, skipping ID generation
2026-03-27 13:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e1e89a-4f12-5a14-81e6-84083a3b0b01 with scrape type 1
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45e1e89a-4f12-5a14-81e6-84083a3b0b01 sending to next pipeline
2026-03-27 13:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45e1e89a-4f12-5a14-81e6-84083a3b0b01, identifier: 1986815
2026-03-27 13:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/365/f3c02d5ebf1a49b7aacbf07237c1edb3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:08 [ayvens.es] INFO: Found listing with ID: 1986824
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986824%27 HTTP/1.1" 200 None
2026-03-27 13:33:08 [ayvens.es] INFO: Scrape type for 1986824: 1
2026-03-27 13:33:08 [ayvens.es] INFO: Extracting data for car ID: 1986824
2026-03-27 13:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with identifier: 1986824
2026-03-27 13:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with scrape type 1
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252Fd83b5b6b13e1421191ec5f1b2d7028de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/d83b5b6b13e1421191ec5f1b2d7028de/images/large/1.jpg not downloaded yet
2026-03-27 13:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6595c968-3508-594e-ad76-045bf5ce51e9 with identifier: 1986814
2026-03-27 13:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6595c968-3508-594e-ad76-045bf5ce51e9 with identifier: 1986814
2026-03-27 13:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6595c968-3508-594e-ad76-045bf5ce51e9 with identifier: 1986814 to the API
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/759/d6f040c63b48432a86a62c04c85c48c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Mineral',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6595c968-3508-594e-ad76-045bf5ce51e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 107666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6595c968-3508-594e-ad76-045bf5ce51e9/6595c968-3508-594e-ad76-045bf5ce51e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/759/d6f040c63b48432a86a62c04c85c48c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986814%27 HTTP/1.1" 200 None
2026-03-27 13:33:09 [ayvens.es] INFO: Saving data for 1986814: {'created_time': 1774618389.465234, 'last_price_update_time': 1774618389.465246, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986814') HTTP/1.1" 204 0
2026-03-27 13:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45e1e89a-4f12-5a14-81e6-84083a3b0b01 with identifier: 1986815
2026-03-27 13:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45e1e89a-4f12-5a14-81e6-84083a3b0b01 with identifier: 1986815
2026-03-27 13:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45e1e89a-4f12-5a14-81e6-84083a3b0b01 with identifier: 1986815 to the API
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/993/75664aee90e140eebb0afd3dfbce3b0d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '45e1e89a-4f12-5a14-81e6-84083a3b0b01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 108732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e1e89a-4f12-5a14-81e6-84083a3b0b01/45e1e89a-4f12-5a14-81e6-84083a3b0b01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/993/75664aee90e140eebb0afd3dfbce3b0d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986815%27 HTTP/1.1" 200 None
2026-03-27 13:33:09 [ayvens.es] INFO: Saving data for 1986815: {'created_time': 1774618389.802703, 'last_price_update_time': 1774618389.802715, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986815') HTTP/1.1" 204 0
2026-03-27 13:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/995/64b165c6aa8649dc9a0c3fb47a9dc39d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:09 [ayvens.es] INFO: Found listing with ID: 1986825
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986825%27 HTTP/1.1" 200 None
2026-03-27 13:33:09 [ayvens.es] INFO: Scrape type for 1986825: 1
2026-03-27 13:33:09 [ayvens.es] INFO: Extracting data for car ID: 1986825
2026-03-27 13:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 847b96a4-1246-5d72-b440-338ad21be5cd with identifier: 1986825
2026-03-27 13:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 847b96a4-1246-5d72-b440-338ad21be5cd with scrape type 1
2026-03-27 13:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 847b96a4-1246-5d72-b440-338ad21be5cd
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F943%252F8082d12f39f8409690b5ce4989542818%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/943/8082d12f39f8409690b5ce4989542818/images/large/1.jpg not downloaded yet
2026-03-27 13:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f80b10>
2026-03-27 13:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a55ee-bcc2-5541-8388-5fcb9c032098/c99a55ee-bcc2-5541-8388-5fcb9c032098_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F843%252F5671ba1f735541b998ff5546b7288aa2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/843/5671ba1f735541b998ff5546b7288aa2/images/large/1.jpg saved to cache
2026-03-27 13:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c99a55ee-bcc2-5541-8388-5fcb9c032098
2026-03-27 13:33:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c99a55ee-bcc2-5541-8388-5fcb9c032098, skipping ID generation
2026-03-27 13:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a55ee-bcc2-5541-8388-5fcb9c032098 with scrape type 1
2026-03-27 13:33:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c99a55ee-bcc2-5541-8388-5fcb9c032098 sending to next pipeline
2026-03-27 13:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c99a55ee-bcc2-5541-8388-5fcb9c032098, identifier: 1986817
2026-03-27 13:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b0c90>
2026-03-27 13:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab505f16-ca93-5308-924b-957be45c9bce/ab505f16-ca93-5308-924b-957be45c9bce_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F981%252Fc8f06b74e93c4cfe967cc4faa3f31b20%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/981/c8f06b74e93c4cfe967cc4faa3f31b20/images/large/1.jpg saved to cache
2026-03-27 13:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab505f16-ca93-5308-924b-957be45c9bce
2026-03-27 13:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab505f16-ca93-5308-924b-957be45c9bce, skipping ID generation
2026-03-27 13:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab505f16-ca93-5308-924b-957be45c9bce with scrape type 1
2026-03-27 13:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab505f16-ca93-5308-924b-957be45c9bce sending to next pipeline
2026-03-27 13:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab505f16-ca93-5308-924b-957be45c9bce, identifier: 1986816
2026-03-27 13:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529579d2d0>
2026-03-27 13:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8026b17b-426e-5d9c-a3dc-b3987bb60d1e/8026b17b-426e-5d9c-a3dc-b3987bb60d1e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Ff3c02d5ebf1a49b7aacbf07237c1edb3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/f3c02d5ebf1a49b7aacbf07237c1edb3/images/large/1.jpg saved to cache
2026-03-27 13:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e
2026-03-27 13:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e, skipping ID generation
2026-03-27 13:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with scrape type 1
2026-03-27 13:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e sending to next pipeline
2026-03-27 13:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e, identifier: 1986818
2026-03-27 13:33:10 [ayvens.es] INFO: Found listing with ID: 1986826
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986826%27 HTTP/1.1" 200 None
2026-03-27 13:33:10 [ayvens.es] INFO: Scrape type for 1986826: 1
2026-03-27 13:33:10 [ayvens.es] INFO: Extracting data for car ID: 1986826
2026-03-27 13:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef59955e-f231-54f1-8312-58ba9a57b1e7 with identifier: 1986826
2026-03-27 13:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef59955e-f231-54f1-8312-58ba9a57b1e7 with scrape type 1
2026-03-27 13:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef59955e-f231-54f1-8312-58ba9a57b1e7
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F992%252Fd37338dbf01f490d8dc2768d6c7b7927%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/992/d37338dbf01f490d8dc2768d6c7b7927/images/large/1.jpg not downloaded yet
2026-03-27 13:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c99a55ee-bcc2-5541-8388-5fcb9c032098 with identifier: 1986817
2026-03-27 13:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c99a55ee-bcc2-5541-8388-5fcb9c032098 with identifier: 1986817
2026-03-27 13:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c99a55ee-bcc2-5541-8388-5fcb9c032098 with identifier: 1986817 to the API
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/843/5671ba1f735541b998ff5546b7288aa2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c99a55ee-bcc2-5541-8388-5fcb9c032098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 4359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a55ee-bcc2-5541-8388-5fcb9c032098/c99a55ee-bcc2-5541-8388-5fcb9c032098_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/843/5671ba1f735541b998ff5546b7288aa2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Advance 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986817%27 HTTP/1.1" 200 None
2026-03-27 13:33:10 [ayvens.es] INFO: Saving data for 1986817: {'created_time': 1774618390.784771, 'last_price_update_time': 1774618390.784784, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986817') HTTP/1.1" 204 0
2026-03-27 13:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab505f16-ca93-5308-924b-957be45c9bce with identifier: 1986816
2026-03-27 13:33:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab505f16-ca93-5308-924b-957be45c9bce with identifier: 1986816
2026-03-27 13:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab505f16-ca93-5308-924b-957be45c9bce with identifier: 1986816 to the API
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/981/c8f06b74e93c4cfe967cc4faa3f31b20/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab505f16-ca93-5308-924b-957be45c9bce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 154694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab505f16-ca93-5308-924b-957be45c9bce/ab505f16-ca93-5308-924b-957be45c9bce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/981/c8f06b74e93c4cfe967cc4faa3f31b20/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Advance 2.0 TDI 110kW(150CV) DSG Variant',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW(150CV) DSG Variant',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986816%27 HTTP/1.1" 200 None
2026-03-27 13:33:11 [ayvens.es] INFO: Saving data for 1986816: {'created_time': 1774618391.229878, 'last_price_update_time': 1774618391.229889, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986816') HTTP/1.1" 204 0
2026-03-27 13:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with identifier: 1986818
2026-03-27 13:33:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with identifier: 1986818
2026-03-27 13:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with identifier: 1986818 to the API
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/365/f3c02d5ebf1a49b7aacbf07237c1edb3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'electric',
 'id': '8026b17b-426e-5d9c-a3dc-b3987bb60d1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 108441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8026b17b-426e-5d9c-a3dc-b3987bb60d1e/8026b17b-426e-5d9c-a3dc-b3987bb60d1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/365/f3c02d5ebf1a49b7aacbf07237c1edb3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF (O) e-Golf ePower 100 kW (136CV)',
 'transmission': 'manual',
 'trim': '(O) e-Golf ePower 100 kW (136CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986818%27 HTTP/1.1" 200 None
2026-03-27 13:33:11 [ayvens.es] INFO: Saving data for 1986818: {'created_time': 1774618391.567796, 'last_price_update_time': 1774618391.567808, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986818') HTTP/1.1" 204 0
2026-03-27 13:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/611/fcc5eb63c44540ccb65d4f956ba40073/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/824/3393d930d49d45eaa6c453a53a651529/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:11 [ayvens.es] INFO: Found listing with ID: 1986827
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986827%27 HTTP/1.1" 200 None
2026-03-27 13:33:11 [ayvens.es] INFO: Scrape type for 1986827: 1
2026-03-27 13:33:11 [ayvens.es] INFO: Extracting data for car ID: 1986827
2026-03-27 13:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with identifier: 1986827
2026-03-27 13:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with scrape type 1
2026-03-27 13:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F017%252Fdb651f6acc2143ca82fc03911589fe43%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/017/db651f6acc2143ca82fc03911589fe43/images/large/1.jpg not downloaded yet
2026-03-27 13:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297d3c1d0>
2026-03-27 13:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0091f576-c44c-56be-a2e1-669cdba797f2/0091f576-c44c-56be-a2e1-669cdba797f2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F995%252F64b165c6aa8649dc9a0c3fb47a9dc39d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/995/64b165c6aa8649dc9a0c3fb47a9dc39d/images/large/1.jpg saved to cache
2026-03-27 13:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0091f576-c44c-56be-a2e1-669cdba797f2
2026-03-27 13:33:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0091f576-c44c-56be-a2e1-669cdba797f2, skipping ID generation
2026-03-27 13:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0091f576-c44c-56be-a2e1-669cdba797f2 with scrape type 1
2026-03-27 13:33:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0091f576-c44c-56be-a2e1-669cdba797f2 sending to next pipeline
2026-03-27 13:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0091f576-c44c-56be-a2e1-669cdba797f2, identifier: 1986819
2026-03-27 13:33:11 [ayvens.es] INFO: Found listing with ID: 1986828
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986828%27 HTTP/1.1" 200 None
2026-03-27 13:33:11 [ayvens.es] INFO: Scrape type for 1986828: 1
2026-03-27 13:33:11 [ayvens.es] INFO: Extracting data for car ID: 1986828
2026-03-27 13:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6927b026-774e-5a12-bfb7-023d3d156e6b with identifier: 1986828
2026-03-27 13:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6927b026-774e-5a12-bfb7-023d3d156e6b with scrape type 1
2026-03-27 13:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6927b026-774e-5a12-bfb7-023d3d156e6b
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F468%252F2f0fabab25fe4182afd2350f3df58634%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/468/2f0fabab25fe4182afd2350f3df58634/images/large/1.jpg not downloaded yet
2026-03-27 13:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0091f576-c44c-56be-a2e1-669cdba797f2 with identifier: 1986819
2026-03-27 13:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0091f576-c44c-56be-a2e1-669cdba797f2 with identifier: 1986819
2026-03-27 13:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0091f576-c44c-56be-a2e1-669cdba797f2 with identifier: 1986819 to the API
2026-03-27 13:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/995/64b165c6aa8649dc9a0c3fb47a9dc39d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0091f576-c44c-56be-a2e1-669cdba797f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 124182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0091f576-c44c-56be-a2e1-669cdba797f2/0091f576-c44c-56be-a2e1-669cdba797f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/995/64b165c6aa8649dc9a0c3fb47a9dc39d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986819%27 HTTP/1.1" 200 None
2026-03-27 13:33:12 [ayvens.es] INFO: Saving data for 1986819: {'created_time': 1774618392.748571, 'last_price_update_time': 1774618392.748582, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986819') HTTP/1.1" 204 0
2026-03-27 13:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/521/6ac0a5ffd80a487ca471b662033e8c37/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:12 [ayvens.es] INFO: Found listing with ID: 1986829
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986829%27 HTTP/1.1" 200 None
2026-03-27 13:33:12 [ayvens.es] INFO: Scrape type for 1986829: 1
2026-03-27 13:33:12 [ayvens.es] INFO: Extracting data for car ID: 1986829
2026-03-27 13:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with identifier: 1986829
2026-03-27 13:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with scrape type 1
2026-03-27 13:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F053%252F9c496d450ba546648bd2a836f1f70113%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/053/9c496d450ba546648bd2a836f1f70113/images/large/1.jpg not downloaded yet
2026-03-27 13:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529618d2d0>
2026-03-27 13:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e41d825d-8617-5875-afe1-3c8c529cb3ec/e41d825d-8617-5875-afe1-3c8c529cb3ec_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F611%252Ffcc5eb63c44540ccb65d4f956ba40073%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/611/fcc5eb63c44540ccb65d4f956ba40073/images/large/1.jpg saved to cache
2026-03-27 13:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e41d825d-8617-5875-afe1-3c8c529cb3ec
2026-03-27 13:33:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e41d825d-8617-5875-afe1-3c8c529cb3ec, skipping ID generation
2026-03-27 13:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e41d825d-8617-5875-afe1-3c8c529cb3ec with scrape type 1
2026-03-27 13:33:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e41d825d-8617-5875-afe1-3c8c529cb3ec sending to next pipeline
2026-03-27 13:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e41d825d-8617-5875-afe1-3c8c529cb3ec, identifier: 1986820
2026-03-27 13:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295752f50>
2026-03-27 13:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e3a2d0-1846-59f9-8c8f-ea42f3104925/b1e3a2d0-1846-59f9-8c8f-ea42f3104925_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252F3393d930d49d45eaa6c453a53a651529%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/3393d930d49d45eaa6c453a53a651529/images/large/1.jpg saved to cache
2026-03-27 13:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1e3a2d0-1846-59f9-8c8f-ea42f3104925
2026-03-27 13:33:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1e3a2d0-1846-59f9-8c8f-ea42f3104925, skipping ID generation
2026-03-27 13:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e3a2d0-1846-59f9-8c8f-ea42f3104925 with scrape type 1
2026-03-27 13:33:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1e3a2d0-1846-59f9-8c8f-ea42f3104925 sending to next pipeline
2026-03-27 13:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1e3a2d0-1846-59f9-8c8f-ea42f3104925, identifier: 1986821
2026-03-27 13:33:13 [ayvens.es] INFO: Found listing with ID: 1986830
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986830%27 HTTP/1.1" 200 None
2026-03-27 13:33:13 [ayvens.es] INFO: Scrape type for 1986830: 1
2026-03-27 13:33:13 [ayvens.es] INFO: Extracting data for car ID: 1986830
2026-03-27 13:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc82c61a-d593-5d45-b4c4-e4a793225e4e with identifier: 1986830
2026-03-27 13:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc82c61a-d593-5d45-b4c4-e4a793225e4e with scrape type 1
2026-03-27 13:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc82c61a-d593-5d45-b4c4-e4a793225e4e
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252F6d5b9e8e44b44124b2e794d68d6eacbf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/6d5b9e8e44b44124b2e794d68d6eacbf/images/large/1.jpg not downloaded yet
2026-03-27 13:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e41d825d-8617-5875-afe1-3c8c529cb3ec with identifier: 1986820
2026-03-27 13:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e41d825d-8617-5875-afe1-3c8c529cb3ec with identifier: 1986820
2026-03-27 13:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e41d825d-8617-5875-afe1-3c8c529cb3ec with identifier: 1986820 to the API
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/611/fcc5eb63c44540ccb65d4f956ba40073/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e41d825d-8617-5875-afe1-3c8c529cb3ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 188790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e41d825d-8617-5875-afe1-3c8c529cb3ec/e41d825d-8617-5875-afe1-3c8c529cb3ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/611/fcc5eb63c44540ccb65d4f956ba40073/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986820%27 HTTP/1.1" 200 None
2026-03-27 13:33:13 [ayvens.es] INFO: Saving data for 1986820: {'created_time': 1774618393.694724, 'last_price_update_time': 1774618393.694735, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986820') HTTP/1.1" 204 0
2026-03-27 13:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1e3a2d0-1846-59f9-8c8f-ea42f3104925 with identifier: 1986821
2026-03-27 13:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1e3a2d0-1846-59f9-8c8f-ea42f3104925 with identifier: 1986821
2026-03-27 13:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1e3a2d0-1846-59f9-8c8f-ea42f3104925 with identifier: 1986821 to the API
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/824/3393d930d49d45eaa6c453a53a651529/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b1e3a2d0-1846-59f9-8c8f-ea42f3104925',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 96004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e3a2d0-1846-59f9-8c8f-ea42f3104925/b1e3a2d0-1846-59f9-8c8f-ea42f3104925_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/824/3393d930d49d45eaa6c453a53a651529/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986821%27 HTTP/1.1" 200 None
2026-03-27 13:33:14 [ayvens.es] INFO: Saving data for 1986821: {'created_time': 1774618394.032021, 'last_price_update_time': 1774618394.032033, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986821') HTTP/1.1" 204 0
2026-03-27 13:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/207/8777e706028949158ea7fd9a03777b46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/943/8082d12f39f8409690b5ce4989542818/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:14 [ayvens.es] INFO: Found listing with ID: 1986831
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986831%27 HTTP/1.1" 200 None
2026-03-27 13:33:14 [ayvens.es] INFO: Scrape type for 1986831: 1
2026-03-27 13:33:14 [ayvens.es] INFO: Extracting data for car ID: 1986831
2026-03-27 13:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8ab4bba-a59f-5f4b-8704-eebd0504fe10 with identifier: 1986831
2026-03-27 13:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8ab4bba-a59f-5f4b-8704-eebd0504fe10 with scrape type 1
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a8ab4bba-a59f-5f4b-8704-eebd0504fe10
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252F2465118b9f834a75b9c28714b456447d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/2465118b9f834a75b9c28714b456447d/images/large/1.jpg not downloaded yet
2026-03-27 13:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/d83b5b6b13e1421191ec5f1b2d7028de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296055f50>
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee040410-ebc4-5963-b54b-825b669082e2/ee040410-ebc4-5963-b54b-825b669082e2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F521%252F6ac0a5ffd80a487ca471b662033e8c37%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/521/6ac0a5ffd80a487ca471b662033e8c37/images/large/1.jpg saved to cache
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee040410-ebc4-5963-b54b-825b669082e2
2026-03-27 13:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee040410-ebc4-5963-b54b-825b669082e2, skipping ID generation
2026-03-27 13:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee040410-ebc4-5963-b54b-825b669082e2 with scrape type 1
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee040410-ebc4-5963-b54b-825b669082e2 sending to next pipeline
2026-03-27 13:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee040410-ebc4-5963-b54b-825b669082e2, identifier: 1986823
2026-03-27 13:33:14 [ayvens.es] INFO: Found listing with ID: 1986832
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986832%27 HTTP/1.1" 200 None
2026-03-27 13:33:14 [ayvens.es] INFO: Scrape type for 1986832: 1
2026-03-27 13:33:14 [ayvens.es] INFO: Extracting data for car ID: 1986832
2026-03-27 13:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8843392-10fb-5ef7-92fa-010a4ce10933 with identifier: 1986832
2026-03-27 13:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8843392-10fb-5ef7-92fa-010a4ce10933 with scrape type 1
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8843392-10fb-5ef7-92fa-010a4ce10933
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F112%252F07ee110a6a36461395126b40d17065ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/112/07ee110a6a36461395126b40d17065ee/images/large/1.jpg not downloaded yet
2026-03-27 13:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee040410-ebc4-5963-b54b-825b669082e2 with identifier: 1986823
2026-03-27 13:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee040410-ebc4-5963-b54b-825b669082e2 with identifier: 1986823
2026-03-27 13:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee040410-ebc4-5963-b54b-825b669082e2 with identifier: 1986823 to the API
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/521/6ac0a5ffd80a487ca471b662033e8c37/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ee040410-ebc4-5963-b54b-825b669082e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 84089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee040410-ebc4-5963-b54b-825b669082e2/ee040410-ebc4-5963-b54b-825b669082e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/521/6ac0a5ffd80a487ca471b662033e8c37/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986823%27 HTTP/1.1" 200 None
2026-03-27 13:33:14 [ayvens.es] INFO: Saving data for 1986823: {'created_time': 1774618394.673329, 'last_price_update_time': 1774618394.673341, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986823') HTTP/1.1" 204 0
2026-03-27 13:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/992/d37338dbf01f490d8dc2768d6c7b7927/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/017/db651f6acc2143ca82fc03911589fe43/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:14 [ayvens.es] INFO: Found listing with ID: 1986833
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986833%27 HTTP/1.1" 200 None
2026-03-27 13:33:14 [ayvens.es] INFO: Scrape type for 1986833: 1
2026-03-27 13:33:14 [ayvens.es] INFO: Extracting data for car ID: 1986833
2026-03-27 13:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with identifier: 1986833
2026-03-27 13:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with scrape type 1
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252F90cd5653467647e4b9d07131e470600a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/90cd5653467647e4b9d07131e470600a/images/large/1.jpg not downloaded yet
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295717dd0>
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdf22be2-2b13-5dc8-8090-83dae83a68bc/fdf22be2-2b13-5dc8-8090-83dae83a68bc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F207%252F8777e706028949158ea7fd9a03777b46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/207/8777e706028949158ea7fd9a03777b46/images/large/1.jpg saved to cache
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdf22be2-2b13-5dc8-8090-83dae83a68bc
2026-03-27 13:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdf22be2-2b13-5dc8-8090-83dae83a68bc, skipping ID generation
2026-03-27 13:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf22be2-2b13-5dc8-8090-83dae83a68bc with scrape type 1
2026-03-27 13:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdf22be2-2b13-5dc8-8090-83dae83a68bc sending to next pipeline
2026-03-27 13:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fdf22be2-2b13-5dc8-8090-83dae83a68bc, identifier: 1986822
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296702290>
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_847b96a4-1246-5d72-b440-338ad21be5cd/847b96a4-1246-5d72-b440-338ad21be5cd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F943%252F8082d12f39f8409690b5ce4989542818%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/943/8082d12f39f8409690b5ce4989542818/images/large/1.jpg saved to cache
2026-03-27 13:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 847b96a4-1246-5d72-b440-338ad21be5cd
2026-03-27 13:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 847b96a4-1246-5d72-b440-338ad21be5cd, skipping ID generation
2026-03-27 13:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 847b96a4-1246-5d72-b440-338ad21be5cd with scrape type 1
2026-03-27 13:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 847b96a4-1246-5d72-b440-338ad21be5cd sending to next pipeline
2026-03-27 13:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 847b96a4-1246-5d72-b440-338ad21be5cd, identifier: 1986825
2026-03-27 13:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296084090>
2026-03-27 13:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c50e3fa5-f539-5efc-aac6-20ae6ed274d8/c50e3fa5-f539-5efc-aac6-20ae6ed274d8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252Fd83b5b6b13e1421191ec5f1b2d7028de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/d83b5b6b13e1421191ec5f1b2d7028de/images/large/1.jpg saved to cache
2026-03-27 13:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8
2026-03-27 13:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c50e3fa5-f539-5efc-aac6-20ae6ed274d8, skipping ID generation
2026-03-27 13:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with scrape type 1
2026-03-27 13:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c50e3fa5-f539-5efc-aac6-20ae6ed274d8 sending to next pipeline
2026-03-27 13:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c50e3fa5-f539-5efc-aac6-20ae6ed274d8, identifier: 1986824
2026-03-27 13:33:15 [ayvens.es] INFO: Found listing with ID: 1986834
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986834%27 HTTP/1.1" 200 None
2026-03-27 13:33:15 [ayvens.es] INFO: Scrape type for 1986834: 1
2026-03-27 13:33:15 [ayvens.es] INFO: Extracting data for car ID: 1986834
2026-03-27 13:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d218ab-4e2f-5e23-94fd-14159e6ca65b with identifier: 1986834
2026-03-27 13:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b with scrape type 1
2026-03-27 13:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252Fad01d1ed0348475ebbc3c983fef28a33%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/ad01d1ed0348475ebbc3c983fef28a33/images/large/1.jpg not downloaded yet
2026-03-27 13:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fdf22be2-2b13-5dc8-8090-83dae83a68bc with identifier: 1986822
2026-03-27 13:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fdf22be2-2b13-5dc8-8090-83dae83a68bc with identifier: 1986822
2026-03-27 13:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fdf22be2-2b13-5dc8-8090-83dae83a68bc with identifier: 1986822 to the API
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/207/8777e706028949158ea7fd9a03777b46/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fdf22be2-2b13-5dc8-8090-83dae83a68bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 80416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdf22be2-2b13-5dc8-8090-83dae83a68bc/fdf22be2-2b13-5dc8-8090-83dae83a68bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/207/8777e706028949158ea7fd9a03777b46/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go2',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go2',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986822%27 HTTP/1.1" 200 None
2026-03-27 13:33:15 [ayvens.es] INFO: Saving data for 1986822: {'created_time': 1774618395.686146, 'last_price_update_time': 1774618395.686157, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986822') HTTP/1.1" 204 0
2026-03-27 13:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 847b96a4-1246-5d72-b440-338ad21be5cd with identifier: 1986825
2026-03-27 13:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 847b96a4-1246-5d72-b440-338ad21be5cd with identifier: 1986825
2026-03-27 13:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 847b96a4-1246-5d72-b440-338ad21be5cd with identifier: 1986825 to the API
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/943/8082d12f39f8409690b5ce4989542818/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '847b96a4-1246-5d72-b440-338ad21be5cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TALISMAN',
 'odometer': 184484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_847b96a4-1246-5d72-b440-338ad21be5cd/847b96a4-1246-5d72-b440-338ad21be5cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/943/8082d12f39f8409690b5ce4989542818/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT TALISMAN S.T. Business Blue dCi 88 kW (120 CV)',
 'transmission': 'manual',
 'trim': 'S.T. Business Blue dCi 88 kW (120 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986825%27 HTTP/1.1" 200 None
2026-03-27 13:33:16 [ayvens.es] INFO: Saving data for 1986825: {'created_time': 1774618396.014568, 'last_price_update_time': 1774618396.014579, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986825') HTTP/1.1" 204 0
2026-03-27 13:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with identifier: 1986824
2026-03-27 13:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with identifier: 1986824
2026-03-27 13:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c50e3fa5-f539-5efc-aac6-20ae6ed274d8 with identifier: 1986824 to the API
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/d83b5b6b13e1421191ec5f1b2d7028de/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c50e3fa5-f539-5efc-aac6-20ae6ed274d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 218645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c50e3fa5-f539-5efc-aac6-20ae6ed274d8/c50e3fa5-f539-5efc-aac6-20ae6ed274d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/d83b5b6b13e1421191ec5f1b2d7028de/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 dCi 88kW (120CV)',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 dCi 88kW (120CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986824%27 HTTP/1.1" 200 None
2026-03-27 13:33:16 [ayvens.es] INFO: Saving data for 1986824: {'created_time': 1774618396.345353, 'last_price_update_time': 1774618396.345363, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986824') HTTP/1.1" 204 0
2026-03-27 13:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/053/9c496d450ba546648bd2a836f1f70113/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/468/2f0fabab25fe4182afd2350f3df58634/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:16 [ayvens.es] INFO: Found listing with ID: 1986835
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986835%27 HTTP/1.1" 200 None
2026-03-27 13:33:16 [ayvens.es] INFO: Scrape type for 1986835: 1
2026-03-27 13:33:16 [ayvens.es] INFO: Extracting data for car ID: 1986835
2026-03-27 13:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with identifier: 1986835
2026-03-27 13:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with scrape type 1
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F240%252Fa89c5ba69e2349e09a7a1123d9cb25fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/240/a89c5ba69e2349e09a7a1123d9cb25fb/images/large/1.jpg not downloaded yet
2026-03-27 13:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f7b750>
2026-03-27 13:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef59955e-f231-54f1-8312-58ba9a57b1e7/ef59955e-f231-54f1-8312-58ba9a57b1e7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F992%252Fd37338dbf01f490d8dc2768d6c7b7927%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/992/d37338dbf01f490d8dc2768d6c7b7927/images/large/1.jpg saved to cache
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef59955e-f231-54f1-8312-58ba9a57b1e7
2026-03-27 13:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef59955e-f231-54f1-8312-58ba9a57b1e7, skipping ID generation
2026-03-27 13:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef59955e-f231-54f1-8312-58ba9a57b1e7 with scrape type 1
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef59955e-f231-54f1-8312-58ba9a57b1e7 sending to next pipeline
2026-03-27 13:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef59955e-f231-54f1-8312-58ba9a57b1e7, identifier: 1986826
2026-03-27 13:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632f110>
2026-03-27 13:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf1f7a9d-f123-57d8-a39c-a4be477d7d63/cf1f7a9d-f123-57d8-a39c-a4be477d7d63_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F017%252Fdb651f6acc2143ca82fc03911589fe43%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/017/db651f6acc2143ca82fc03911589fe43/images/large/1.jpg saved to cache
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63
2026-03-27 13:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf1f7a9d-f123-57d8-a39c-a4be477d7d63, skipping ID generation
2026-03-27 13:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with scrape type 1
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63 sending to next pipeline
2026-03-27 13:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cf1f7a9d-f123-57d8-a39c-a4be477d7d63, identifier: 1986827
2026-03-27 13:33:16 [ayvens.es] INFO: Found listing with ID: 1986836
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986836%27 HTTP/1.1" 200 None
2026-03-27 13:33:16 [ayvens.es] INFO: Scrape type for 1986836: 1
2026-03-27 13:33:16 [ayvens.es] INFO: Extracting data for car ID: 1986836
2026-03-27 13:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a301af07-8f69-50e1-a653-bd80f20e63cf with identifier: 1986836
2026-03-27 13:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a301af07-8f69-50e1-a653-bd80f20e63cf with scrape type 1
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a301af07-8f69-50e1-a653-bd80f20e63cf
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F820%252F84821d475f5945b1a6df595c09491d4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/820/84821d475f5945b1a6df595c09491d4b/images/large/1.jpg not downloaded yet
2026-03-27 13:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef59955e-f231-54f1-8312-58ba9a57b1e7 with identifier: 1986826
2026-03-27 13:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef59955e-f231-54f1-8312-58ba9a57b1e7 with identifier: 1986826
2026-03-27 13:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef59955e-f231-54f1-8312-58ba9a57b1e7 with identifier: 1986826 to the API
2026-03-27 13:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/992/d37338dbf01f490d8dc2768d6c7b7927/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Bronce',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ef59955e-f231-54f1-8312-58ba9a57b1e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'AURIS',
 'odometer': 162477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef59955e-f231-54f1-8312-58ba9a57b1e7/ef59955e-f231-54f1-8312-58ba9a57b1e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/992/d37338dbf01f490d8dc2768d6c7b7927/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA AURIS 130 Active',
 'transmission': 'manual',
 'trim': '130 Active',
 'vin': None,
 'year': 2014}
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986826%27 HTTP/1.1" 200 None
2026-03-27 13:33:17 [ayvens.es] INFO: Saving data for 1986826: {'created_time': 1774618397.119171, 'last_price_update_time': 1774618397.119182, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986826') HTTP/1.1" 204 0
2026-03-27 13:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with identifier: 1986827
2026-03-27 13:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with identifier: 1986827
2026-03-27 13:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with identifier: 1986827 to the API
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/017/db651f6acc2143ca82fc03911589fe43/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cf1f7a9d-f123-57d8-a39c-a4be477d7d63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 114293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1f7a9d-f123-57d8-a39c-a4be477d7d63/cf1f7a9d-f123-57d8-a39c-a4be477d7d63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/017/db651f6acc2143ca82fc03911589fe43/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986827%27 HTTP/1.1" 200 None
2026-03-27 13:33:17 [ayvens.es] INFO: Saving data for 1986827: {'created_time': 1774618397.54306, 'last_price_update_time': 1774618397.543072, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986827') HTTP/1.1" 204 0
2026-03-27 13:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/068/2465118b9f834a75b9c28714b456447d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/828/6d5b9e8e44b44124b2e794d68d6eacbf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:17 [ayvens.es] INFO: Found listing with ID: 1986837
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986837%27 HTTP/1.1" 200 None
2026-03-27 13:33:17 [ayvens.es] INFO: Scrape type for 1986837: 1
2026-03-27 13:33:17 [ayvens.es] INFO: Extracting data for car ID: 1986837
2026-03-27 13:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dda9a4a-03b8-5115-a60e-05286b371793 with identifier: 1986837
2026-03-27 13:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dda9a4a-03b8-5115-a60e-05286b371793 with scrape type 1
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0dda9a4a-03b8-5115-a60e-05286b371793
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252Ffb997423a5e94632b1e9157d47e1b835%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/fb997423a5e94632b1e9157d47e1b835/images/large/1.jpg not downloaded yet
2026-03-27 13:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529640aa10>
2026-03-27 13:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7c5ef4-4054-5fd3-a521-a6eff055f8a4/ef7c5ef4-4054-5fd3-a521-a6eff055f8a4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F053%252F9c496d450ba546648bd2a836f1f70113%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/053/9c496d450ba546648bd2a836f1f70113/images/large/1.jpg saved to cache
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4
2026-03-27 13:33:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4, skipping ID generation
2026-03-27 13:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with scrape type 1
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 sending to next pipeline
2026-03-27 13:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4, identifier: 1986829
2026-03-27 13:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4d3d0>
2026-03-27 13:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6927b026-774e-5a12-bfb7-023d3d156e6b/6927b026-774e-5a12-bfb7-023d3d156e6b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F468%252F2f0fabab25fe4182afd2350f3df58634%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/468/2f0fabab25fe4182afd2350f3df58634/images/large/1.jpg saved to cache
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6927b026-774e-5a12-bfb7-023d3d156e6b
2026-03-27 13:33:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6927b026-774e-5a12-bfb7-023d3d156e6b, skipping ID generation
2026-03-27 13:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6927b026-774e-5a12-bfb7-023d3d156e6b with scrape type 1
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6927b026-774e-5a12-bfb7-023d3d156e6b sending to next pipeline
2026-03-27 13:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6927b026-774e-5a12-bfb7-023d3d156e6b, identifier: 1986828
2026-03-27 13:33:17 [ayvens.es] INFO: Found listing with ID: 1986838
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986838%27 HTTP/1.1" 200 None
2026-03-27 13:33:17 [ayvens.es] INFO: Scrape type for 1986838: 1
2026-03-27 13:33:17 [ayvens.es] INFO: Extracting data for car ID: 1986838
2026-03-27 13:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a7b8b6-5236-5845-b041-990530c1bdb9 with identifier: 1986838
2026-03-27 13:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a7b8b6-5236-5845-b041-990530c1bdb9 with scrape type 1
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 05a7b8b6-5236-5845-b041-990530c1bdb9
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F965%252F1759eb65dce9405db4b4674ba8520535%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/965/1759eb65dce9405db4b4674ba8520535/images/large/1.jpg not downloaded yet
2026-03-27 13:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with identifier: 1986829
2026-03-27 13:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with identifier: 1986829
2026-03-27 13:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef7c5ef4-4054-5fd3-a521-a6eff055f8a4 with identifier: 1986829 to the API
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/053/9c496d450ba546648bd2a836f1f70113/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef7c5ef4-4054-5fd3-a521-a6eff055f8a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'YETI',
 'odometer': 215453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7c5ef4-4054-5fd3-a521-a6eff055f8a4/ef7c5ef4-4054-5fd3-a521-a6eff055f8a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/053/9c496d450ba546648bd2a836f1f70113/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA YETI 2.0 TDI 110cv 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110cv 4x4 Ambition',
 'vin': None,
 'year': 2013}
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986829%27 HTTP/1.1" 200 None
2026-03-27 13:33:18 [ayvens.es] INFO: Saving data for 1986829: {'created_time': 1774618398.304905, 'last_price_update_time': 1774618398.304916, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986829') HTTP/1.1" 204 0
2026-03-27 13:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6927b026-774e-5a12-bfb7-023d3d156e6b with identifier: 1986828
2026-03-27 13:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6927b026-774e-5a12-bfb7-023d3d156e6b with identifier: 1986828
2026-03-27 13:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6927b026-774e-5a12-bfb7-023d3d156e6b with identifier: 1986828 to the API
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/468/2f0fabab25fe4182afd2350f3df58634/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6927b026-774e-5a12-bfb7-023d3d156e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 197418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6927b026-774e-5a12-bfb7-023d3d156e6b/6927b026-774e-5a12-bfb7-023d3d156e6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/468/2f0fabab25fe4182afd2350f3df58634/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 85kW (115CV) St&Sp Reference',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) St&Sp Reference',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986828%27 HTTP/1.1" 200 None
2026-03-27 13:33:18 [ayvens.es] INFO: Saving data for 1986828: {'created_time': 1774618398.721541, 'last_price_update_time': 1774618398.721551, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986828') HTTP/1.1" 204 0
2026-03-27 13:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/112/07ee110a6a36461395126b40d17065ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:18 [ayvens.es] INFO: Found listing with ID: 1986839
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986839%27 HTTP/1.1" 200 None
2026-03-27 13:33:18 [ayvens.es] INFO: Scrape type for 1986839: 1
2026-03-27 13:33:18 [ayvens.es] INFO: Extracting data for car ID: 1986839
2026-03-27 13:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b37f7e97-3e8c-575d-bc8b-a7e4838f144d with identifier: 1986839
2026-03-27 13:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d with scrape type 1
2026-03-27 13:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252Fa7ed3d7ffcc64b5982d2c068a95b0327%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/a7ed3d7ffcc64b5982d2c068a95b0327/images/large/1.jpg not downloaded yet
2026-03-27 13:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529640b5d0>
2026-03-27 13:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8ab4bba-a59f-5f4b-8704-eebd0504fe10/a8ab4bba-a59f-5f4b-8704-eebd0504fe10_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252F2465118b9f834a75b9c28714b456447d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/2465118b9f834a75b9c28714b456447d/images/large/1.jpg saved to cache
2026-03-27 13:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8ab4bba-a59f-5f4b-8704-eebd0504fe10
2026-03-27 13:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8ab4bba-a59f-5f4b-8704-eebd0504fe10, skipping ID generation
2026-03-27 13:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8ab4bba-a59f-5f4b-8704-eebd0504fe10 with scrape type 1
2026-03-27 13:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8ab4bba-a59f-5f4b-8704-eebd0504fe10 sending to next pipeline
2026-03-27 13:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a8ab4bba-a59f-5f4b-8704-eebd0504fe10, identifier: 1986831
2026-03-27 13:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295781d50>
2026-03-27 13:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc82c61a-d593-5d45-b4c4-e4a793225e4e/cc82c61a-d593-5d45-b4c4-e4a793225e4e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252F6d5b9e8e44b44124b2e794d68d6eacbf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/6d5b9e8e44b44124b2e794d68d6eacbf/images/large/1.jpg saved to cache
2026-03-27 13:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc82c61a-d593-5d45-b4c4-e4a793225e4e
2026-03-27 13:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc82c61a-d593-5d45-b4c4-e4a793225e4e, skipping ID generation
2026-03-27 13:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc82c61a-d593-5d45-b4c4-e4a793225e4e with scrape type 1
2026-03-27 13:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc82c61a-d593-5d45-b4c4-e4a793225e4e sending to next pipeline
2026-03-27 13:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cc82c61a-d593-5d45-b4c4-e4a793225e4e, identifier: 1986830
2026-03-27 13:33:19 [ayvens.es] INFO: Found listing with ID: 1986840
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986840%27 HTTP/1.1" 200 None
2026-03-27 13:33:19 [ayvens.es] INFO: Scrape type for 1986840: 1
2026-03-27 13:33:19 [ayvens.es] INFO: Extracting data for car ID: 1986840
2026-03-27 13:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a597b4-5222-5681-9d9e-c7d488b2c384 with identifier: 1986840
2026-03-27 13:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a597b4-5222-5681-9d9e-c7d488b2c384 with scrape type 1
2026-03-27 13:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89a597b4-5222-5681-9d9e-c7d488b2c384
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252F68c3d69f60324643bed62587cd4305e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/68c3d69f60324643bed62587cd4305e9/images/large/1.jpg not downloaded yet
2026-03-27 13:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a8ab4bba-a59f-5f4b-8704-eebd0504fe10 with identifier: 1986831
2026-03-27 13:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a8ab4bba-a59f-5f4b-8704-eebd0504fe10 with identifier: 1986831
2026-03-27 13:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a8ab4bba-a59f-5f4b-8704-eebd0504fe10 with identifier: 1986831 to the API
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/068/2465118b9f834a75b9c28714b456447d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a8ab4bba-a59f-5f4b-8704-eebd0504fe10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 151820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8ab4bba-a59f-5f4b-8704-eebd0504fe10/a8ab4bba-a59f-5f4b-8704-eebd0504fe10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/068/2465118b9f834a75b9c28714b456447d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE S.T. Business Blue dCi 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'S.T. Business Blue dCi 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986831%27 HTTP/1.1" 200 None
2026-03-27 13:33:19 [ayvens.es] INFO: Saving data for 1986831: {'created_time': 1774618399.630943, 'last_price_update_time': 1774618399.630956, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986831') HTTP/1.1" 204 0
2026-03-27 13:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cc82c61a-d593-5d45-b4c4-e4a793225e4e with identifier: 1986830
2026-03-27 13:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cc82c61a-d593-5d45-b4c4-e4a793225e4e with identifier: 1986830
2026-03-27 13:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cc82c61a-d593-5d45-b4c4-e4a793225e4e with identifier: 1986830 to the API
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/828/6d5b9e8e44b44124b2e794d68d6eacbf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cc82c61a-d593-5d45-b4c4-e4a793225e4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 164669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc82c61a-d593-5d45-b4c4-e4a793225e4e/cc82c61a-d593-5d45-b4c4-e4a793225e4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/828/6d5b9e8e44b44124b2e794d68d6eacbf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Last Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Last Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986830%27 HTTP/1.1" 200 None
2026-03-27 13:33:19 [ayvens.es] INFO: Saving data for 1986830: {'created_time': 1774618399.956701, 'last_price_update_time': 1774618399.956712, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986830') HTTP/1.1" 204 0
2026-03-27 13:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/021/90cd5653467647e4b9d07131e470600a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/002/ad01d1ed0348475ebbc3c983fef28a33/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/240/a89c5ba69e2349e09a7a1123d9cb25fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:19 [ayvens.es] INFO: Found listing with ID: 1986841
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986841%27 HTTP/1.1" 200 None
2026-03-27 13:33:20 [ayvens.es] INFO: Scrape type for 1986841: 1
2026-03-27 13:33:20 [ayvens.es] INFO: Extracting data for car ID: 1986841
2026-03-27 13:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff2e819-62e6-57ad-a159-bc7536562961 with identifier: 1986841
2026-03-27 13:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff2e819-62e6-57ad-a159-bc7536562961 with scrape type 1
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fff2e819-62e6-57ad-a159-bc7536562961
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F348%252F61caf17cf2ed463b8982a51e15d7f050%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/348/61caf17cf2ed463b8982a51e15d7f050/images/large/1.jpg not downloaded yet
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956cbb90>
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8843392-10fb-5ef7-92fa-010a4ce10933/b8843392-10fb-5ef7-92fa-010a4ce10933_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F112%252F07ee110a6a36461395126b40d17065ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/112/07ee110a6a36461395126b40d17065ee/images/large/1.jpg saved to cache
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8843392-10fb-5ef7-92fa-010a4ce10933
2026-03-27 13:33:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8843392-10fb-5ef7-92fa-010a4ce10933, skipping ID generation
2026-03-27 13:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8843392-10fb-5ef7-92fa-010a4ce10933 with scrape type 1
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8843392-10fb-5ef7-92fa-010a4ce10933 sending to next pipeline
2026-03-27 13:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b8843392-10fb-5ef7-92fa-010a4ce10933, identifier: 1986832
2026-03-27 13:33:20 [ayvens.es] INFO: Found listing with ID: 1986842
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986842%27 HTTP/1.1" 200 None
2026-03-27 13:33:20 [ayvens.es] INFO: Scrape type for 1986842: 1
2026-03-27 13:33:20 [ayvens.es] INFO: Extracting data for car ID: 1986842
2026-03-27 13:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c with identifier: 1986842
2026-03-27 13:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c with scrape type 1
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F756%252Fdfc8ec16b2b94703a9f8da3352c4b9d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/756/dfc8ec16b2b94703a9f8da3352c4b9d7/images/large/1.jpg not downloaded yet
2026-03-27 13:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b8843392-10fb-5ef7-92fa-010a4ce10933 with identifier: 1986832
2026-03-27 13:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b8843392-10fb-5ef7-92fa-010a4ce10933 with identifier: 1986832
2026-03-27 13:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b8843392-10fb-5ef7-92fa-010a4ce10933 with identifier: 1986832 to the API
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/112/07ee110a6a36461395126b40d17065ee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b8843392-10fb-5ef7-92fa-010a4ce10933',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 72366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8843392-10fb-5ef7-92fa-010a4ce10933/b8843392-10fb-5ef7-92fa-010a4ce10933_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/112/07ee110a6a36461395126b40d17065ee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986832%27 HTTP/1.1" 200 None
2026-03-27 13:33:20 [ayvens.es] INFO: Saving data for 1986832: {'created_time': 1774618400.585486, 'last_price_update_time': 1774618400.585498, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986832') HTTP/1.1" 204 0
2026-03-27 13:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/820/84821d475f5945b1a6df595c09491d4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/013/fb997423a5e94632b1e9157d47e1b835/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bddc90>
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f0bf6aa-67ae-5474-b95b-cae7299e8d1f/0f0bf6aa-67ae-5474-b95b-cae7299e8d1f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252F90cd5653467647e4b9d07131e470600a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/90cd5653467647e4b9d07131e470600a/images/large/1.jpg saved to cache
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f
2026-03-27 13:33:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f, skipping ID generation
2026-03-27 13:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with scrape type 1
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f sending to next pipeline
2026-03-27 13:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f, identifier: 1986833
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529615cf10>
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d218ab-4e2f-5e23-94fd-14159e6ca65b/36d218ab-4e2f-5e23-94fd-14159e6ca65b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252Fad01d1ed0348475ebbc3c983fef28a33%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/ad01d1ed0348475ebbc3c983fef28a33/images/large/1.jpg saved to cache
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b
2026-03-27 13:33:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36d218ab-4e2f-5e23-94fd-14159e6ca65b, skipping ID generation
2026-03-27 13:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b with scrape type 1
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36d218ab-4e2f-5e23-94fd-14159e6ca65b sending to next pipeline
2026-03-27 13:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 36d218ab-4e2f-5e23-94fd-14159e6ca65b, identifier: 1986834
2026-03-27 13:33:20 [ayvens.es] INFO: Found listing with ID: 1986843
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986843%27 HTTP/1.1" 200 None
2026-03-27 13:33:20 [ayvens.es] INFO: Scrape type for 1986843: 1
2026-03-27 13:33:20 [ayvens.es] INFO: Extracting data for car ID: 1986843
2026-03-27 13:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e73321-706b-5a65-980c-6a4e8e4bb6ee with identifier: 1986843
2026-03-27 13:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee with scrape type 1
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F229%252Fa84d524beb14426e8c863f32762ebcc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/229/a84d524beb14426e8c863f32762ebcc9/images/large/1.jpg not downloaded yet
2026-03-27 13:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with identifier: 1986833
2026-03-27 13:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with identifier: 1986833
2026-03-27 13:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0f0bf6aa-67ae-5474-b95b-cae7299e8d1f with identifier: 1986833 to the API
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/021/90cd5653467647e4b9d07131e470600a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0f0bf6aa-67ae-5474-b95b-cae7299e8d1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 203865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf6aa-67ae-5474-b95b-cae7299e8d1f/0f0bf6aa-67ae-5474-b95b-cae7299e8d1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/021/90cd5653467647e4b9d07131e470600a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS E-CVT TOURING SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS E-CVT TOURING SPORT',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986833%27 HTTP/1.1" 200 None
2026-03-27 13:33:21 [ayvens.es] INFO: Saving data for 1986833: {'created_time': 1774618401.27826, 'last_price_update_time': 1774618401.27827, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986833') HTTP/1.1" 204 0
2026-03-27 13:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 36d218ab-4e2f-5e23-94fd-14159e6ca65b with identifier: 1986834
2026-03-27 13:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 36d218ab-4e2f-5e23-94fd-14159e6ca65b with identifier: 1986834
2026-03-27 13:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 36d218ab-4e2f-5e23-94fd-14159e6ca65b with identifier: 1986834 to the API
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/002/ad01d1ed0348475ebbc3c983fef28a33/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '36d218ab-4e2f-5e23-94fd-14159e6ca65b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 103809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d218ab-4e2f-5e23-94fd-14159e6ca65b/36d218ab-4e2f-5e23-94fd-14159e6ca65b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/002/ad01d1ed0348475ebbc3c983fef28a33/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS PLUS E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS PLUS E-CVT',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986834%27 HTTP/1.1" 200 None
2026-03-27 13:33:21 [ayvens.es] INFO: Saving data for 1986834: {'created_time': 1774618401.58229, 'last_price_update_time': 1774618401.582301, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986834') HTTP/1.1" 204 0
2026-03-27 13:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296064750>
2026-03-27 13:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8/3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F240%252Fa89c5ba69e2349e09a7a1123d9cb25fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/240/a89c5ba69e2349e09a7a1123d9cb25fb/images/large/1.jpg saved to cache
2026-03-27 13:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8
2026-03-27 13:33:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8, skipping ID generation
2026-03-27 13:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with scrape type 1
2026-03-27 13:33:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 sending to next pipeline
2026-03-27 13:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8, identifier: 1986835
2026-03-27 13:33:21 [ayvens.es] INFO: Found listing with ID: 1986844
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986844%27 HTTP/1.1" 200 None
2026-03-27 13:33:21 [ayvens.es] INFO: Scrape type for 1986844: 1
2026-03-27 13:33:21 [ayvens.es] INFO: Extracting data for car ID: 1986844
2026-03-27 13:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 335d649b-7a33-582f-b16b-21d6f5329660 with identifier: 1986844
2026-03-27 13:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335d649b-7a33-582f-b16b-21d6f5329660 with scrape type 1
2026-03-27 13:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 335d649b-7a33-582f-b16b-21d6f5329660
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F730%252Fef07f1b31b594377aabed62e812ce606%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/730/ef07f1b31b594377aabed62e812ce606/images/large/1.jpg not downloaded yet
2026-03-27 13:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with identifier: 1986835
2026-03-27 13:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with identifier: 1986835
2026-03-27 13:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8 with identifier: 1986835 to the API
2026-03-27 13:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/240/a89c5ba69e2349e09a7a1123d9cb25fb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 133203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8/3bdb6bf5-a1ed-5aa5-bb96-4c3aeb8d5df8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/240/a89c5ba69e2349e09a7a1123d9cb25fb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Business 4WD',
 'transmission': 'manual',
 'trim': '2.5l 220H Business 4WD',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986835%27 HTTP/1.1" 200 None
2026-03-27 13:33:22 [ayvens.es] INFO: Saving data for 1986835: {'created_time': 1774618402.209013, 'last_price_update_time': 1774618402.209024, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986835') HTTP/1.1" 204 0
2026-03-27 13:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295781990>
2026-03-27 13:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a301af07-8f69-50e1-a653-bd80f20e63cf/a301af07-8f69-50e1-a653-bd80f20e63cf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F820%252F84821d475f5945b1a6df595c09491d4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/820/84821d475f5945b1a6df595c09491d4b/images/large/1.jpg saved to cache
2026-03-27 13:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a301af07-8f69-50e1-a653-bd80f20e63cf
2026-03-27 13:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a301af07-8f69-50e1-a653-bd80f20e63cf, skipping ID generation
2026-03-27 13:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a301af07-8f69-50e1-a653-bd80f20e63cf with scrape type 1
2026-03-27 13:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a301af07-8f69-50e1-a653-bd80f20e63cf sending to next pipeline
2026-03-27 13:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a301af07-8f69-50e1-a653-bd80f20e63cf, identifier: 1986836
2026-03-27 13:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296019090>
2026-03-27 13:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dda9a4a-03b8-5115-a60e-05286b371793/0dda9a4a-03b8-5115-a60e-05286b371793_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252Ffb997423a5e94632b1e9157d47e1b835%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/fb997423a5e94632b1e9157d47e1b835/images/large/1.jpg saved to cache
2026-03-27 13:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dda9a4a-03b8-5115-a60e-05286b371793
2026-03-27 13:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dda9a4a-03b8-5115-a60e-05286b371793, skipping ID generation
2026-03-27 13:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dda9a4a-03b8-5115-a60e-05286b371793 with scrape type 1
2026-03-27 13:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dda9a4a-03b8-5115-a60e-05286b371793 sending to next pipeline
2026-03-27 13:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0dda9a4a-03b8-5115-a60e-05286b371793, identifier: 1986837
2026-03-27 13:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/a7ed3d7ffcc64b5982d2c068a95b0327/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:22 [ayvens.es] INFO: Found listing with ID: 1986845
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986845%27 HTTP/1.1" 200 None
2026-03-27 13:33:22 [ayvens.es] INFO: Scrape type for 1986845: 1
2026-03-27 13:33:22 [ayvens.es] INFO: Extracting data for car ID: 1986845
2026-03-27 13:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3afd809-0b3a-59e2-8c9d-b6843022bb13 with identifier: 1986845
2026-03-27 13:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3afd809-0b3a-59e2-8c9d-b6843022bb13 with scrape type 1
2026-03-27 13:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3afd809-0b3a-59e2-8c9d-b6843022bb13
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252Fbdd5ffc8863d41b5b2f561129a93b177%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/bdd5ffc8863d41b5b2f561129a93b177/images/large/1.jpg not downloaded yet
2026-03-27 13:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a301af07-8f69-50e1-a653-bd80f20e63cf with identifier: 1986836
2026-03-27 13:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a301af07-8f69-50e1-a653-bd80f20e63cf with identifier: 1986836
2026-03-27 13:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a301af07-8f69-50e1-a653-bd80f20e63cf with identifier: 1986836 to the API
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/820/84821d475f5945b1a6df595c09491d4b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a301af07-8f69-50e1-a653-bd80f20e63cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 158834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a301af07-8f69-50e1-a653-bd80f20e63cf/a301af07-8f69-50e1-a653-bd80f20e63cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/820/84821d475f5945b1a6df595c09491d4b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986836%27 HTTP/1.1" 200 None
2026-03-27 13:33:22 [ayvens.es] INFO: Saving data for 1986836: {'created_time': 1774618402.948423, 'last_price_update_time': 1774618402.948435, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986836') HTTP/1.1" 204 0
2026-03-27 13:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0dda9a4a-03b8-5115-a60e-05286b371793 with identifier: 1986837
2026-03-27 13:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0dda9a4a-03b8-5115-a60e-05286b371793 with identifier: 1986837
2026-03-27 13:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0dda9a4a-03b8-5115-a60e-05286b371793 with identifier: 1986837 to the API
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/013/fb997423a5e94632b1e9157d47e1b835/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0dda9a4a-03b8-5115-a60e-05286b371793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 39991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dda9a4a-03b8-5115-a60e-05286b371793/0dda9a4a-03b8-5115-a60e-05286b371793_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/013/fb997423a5e94632b1e9157d47e1b835/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 66kW (90CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Profesional dCi 66kW (90CV) Euro 6',
 'vin': None,
 'year': 2018}
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986837%27 HTTP/1.1" 200 None
2026-03-27 13:33:23 [ayvens.es] INFO: Saving data for 1986837: {'created_time': 1774618403.269612, 'last_price_update_time': 1774618403.269623, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986837') HTTP/1.1" 204 0
2026-03-27 13:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/965/1759eb65dce9405db4b4674ba8520535/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/824/68c3d69f60324643bed62587cd4305e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:23 [ayvens.es] INFO: Found listing with ID: 1986846
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986846%27 HTTP/1.1" 200 None
2026-03-27 13:33:23 [ayvens.es] INFO: Scrape type for 1986846: 1
2026-03-27 13:33:23 [ayvens.es] INFO: Extracting data for car ID: 1986846
2026-03-27 13:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e87b5e49-ddb3-528b-9d2f-09ca840a391d with identifier: 1986846
2026-03-27 13:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e87b5e49-ddb3-528b-9d2f-09ca840a391d with scrape type 1
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e87b5e49-ddb3-528b-9d2f-09ca840a391d
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252F84923c859f2948c8abc40d8b6a434755%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/84923c859f2948c8abc40d8b6a434755/images/large/1.jpg not downloaded yet
2026-03-27 13:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/348/61caf17cf2ed463b8982a51e15d7f050/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295793210>
2026-03-27 13:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b37f7e97-3e8c-575d-bc8b-a7e4838f144d/b37f7e97-3e8c-575d-bc8b-a7e4838f144d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252Fa7ed3d7ffcc64b5982d2c068a95b0327%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/a7ed3d7ffcc64b5982d2c068a95b0327/images/large/1.jpg saved to cache
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d
2026-03-27 13:33:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b37f7e97-3e8c-575d-bc8b-a7e4838f144d, skipping ID generation
2026-03-27 13:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d with scrape type 1
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b37f7e97-3e8c-575d-bc8b-a7e4838f144d sending to next pipeline
2026-03-27 13:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b37f7e97-3e8c-575d-bc8b-a7e4838f144d, identifier: 1986839
2026-03-27 13:33:23 [ayvens.es] INFO: Found listing with ID: 1986847
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986847%27 HTTP/1.1" 200 None
2026-03-27 13:33:23 [ayvens.es] INFO: Scrape type for 1986847: 1
2026-03-27 13:33:23 [ayvens.es] INFO: Extracting data for car ID: 1986847
2026-03-27 13:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef58058b-a80c-52bd-96d9-25c4783ef344 with identifier: 1986847
2026-03-27 13:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef58058b-a80c-52bd-96d9-25c4783ef344 with scrape type 1
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef58058b-a80c-52bd-96d9-25c4783ef344
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252F923aea37001348b1b12a6554d7fc2b64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/923aea37001348b1b12a6554d7fc2b64/images/large/1.jpg not downloaded yet
2026-03-27 13:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b37f7e97-3e8c-575d-bc8b-a7e4838f144d with identifier: 1986839
2026-03-27 13:33:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b37f7e97-3e8c-575d-bc8b-a7e4838f144d with identifier: 1986839
2026-03-27 13:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b37f7e97-3e8c-575d-bc8b-a7e4838f144d with identifier: 1986839 to the API
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/a7ed3d7ffcc64b5982d2c068a95b0327/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Amarillo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b37f7e97-3e8c-575d-bc8b-a7e4838f144d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 35487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b37f7e97-3e8c-575d-bc8b-a7e4838f144d/b37f7e97-3e8c-575d-bc8b-a7e4838f144d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/a7ed3d7ffcc64b5982d2c068a95b0327/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986839%27 HTTP/1.1" 200 None
2026-03-27 13:33:23 [ayvens.es] INFO: Saving data for 1986839: {'created_time': 1774618403.892026, 'last_price_update_time': 1774618403.892037, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986839') HTTP/1.1" 204 0
2026-03-27 13:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/756/dfc8ec16b2b94703a9f8da3352c4b9d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:23 [ayvens.es] INFO: Found listing with ID: 1986848
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986848%27 HTTP/1.1" 200 None
2026-03-27 13:33:23 [ayvens.es] INFO: Scrape type for 1986848: 1
2026-03-27 13:33:23 [ayvens.es] INFO: Extracting data for car ID: 1986848
2026-03-27 13:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c7a9a9-9030-5698-a360-82196a8b0eb3 with identifier: 1986848
2026-03-27 13:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c7a9a9-9030-5698-a360-82196a8b0eb3 with scrape type 1
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6c7a9a9-9030-5698-a360-82196a8b0eb3
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F907%252F261536f1700a41ffa18238963238ad85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/907/261536f1700a41ffa18238963238ad85/images/large/1.jpg not downloaded yet
2026-03-27 13:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296010dd0>
2026-03-27 13:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a7b8b6-5236-5845-b041-990530c1bdb9/05a7b8b6-5236-5845-b041-990530c1bdb9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F965%252F1759eb65dce9405db4b4674ba8520535%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/965/1759eb65dce9405db4b4674ba8520535/images/large/1.jpg saved to cache
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05a7b8b6-5236-5845-b041-990530c1bdb9
2026-03-27 13:33:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05a7b8b6-5236-5845-b041-990530c1bdb9, skipping ID generation
2026-03-27 13:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a7b8b6-5236-5845-b041-990530c1bdb9 with scrape type 1
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05a7b8b6-5236-5845-b041-990530c1bdb9 sending to next pipeline
2026-03-27 13:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 05a7b8b6-5236-5845-b041-990530c1bdb9, identifier: 1986838
2026-03-27 13:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f70a50>
2026-03-27 13:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a597b4-5222-5681-9d9e-c7d488b2c384/89a597b4-5222-5681-9d9e-c7d488b2c384_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252F68c3d69f60324643bed62587cd4305e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/68c3d69f60324643bed62587cd4305e9/images/large/1.jpg saved to cache
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89a597b4-5222-5681-9d9e-c7d488b2c384
2026-03-27 13:33:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89a597b4-5222-5681-9d9e-c7d488b2c384, skipping ID generation
2026-03-27 13:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a597b4-5222-5681-9d9e-c7d488b2c384 with scrape type 1
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89a597b4-5222-5681-9d9e-c7d488b2c384 sending to next pipeline
2026-03-27 13:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89a597b4-5222-5681-9d9e-c7d488b2c384, identifier: 1986840
2026-03-27 13:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296011350>
2026-03-27 13:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fff2e819-62e6-57ad-a159-bc7536562961/fff2e819-62e6-57ad-a159-bc7536562961_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F348%252F61caf17cf2ed463b8982a51e15d7f050%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/348/61caf17cf2ed463b8982a51e15d7f050/images/large/1.jpg saved to cache
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fff2e819-62e6-57ad-a159-bc7536562961
2026-03-27 13:33:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fff2e819-62e6-57ad-a159-bc7536562961, skipping ID generation
2026-03-27 13:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff2e819-62e6-57ad-a159-bc7536562961 with scrape type 1
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fff2e819-62e6-57ad-a159-bc7536562961 sending to next pipeline
2026-03-27 13:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fff2e819-62e6-57ad-a159-bc7536562961, identifier: 1986841
2026-03-27 13:33:24 [ayvens.es] INFO: Found listing with ID: 1986849
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986849%27 HTTP/1.1" 200 None
2026-03-27 13:33:24 [ayvens.es] INFO: Scrape type for 1986849: 1
2026-03-27 13:33:24 [ayvens.es] INFO: Extracting data for car ID: 1986849
2026-03-27 13:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977023ea-1da6-5abc-86cb-e6c42e762e20 with identifier: 1986849
2026-03-27 13:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977023ea-1da6-5abc-86cb-e6c42e762e20 with scrape type 1
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 977023ea-1da6-5abc-86cb-e6c42e762e20
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252Fbe574122a9ee4df5acdbf465693057c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/be574122a9ee4df5acdbf465693057c7/images/large/1.jpg not downloaded yet
2026-03-27 13:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 05a7b8b6-5236-5845-b041-990530c1bdb9 with identifier: 1986838
2026-03-27 13:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 05a7b8b6-5236-5845-b041-990530c1bdb9 with identifier: 1986838
2026-03-27 13:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 05a7b8b6-5236-5845-b041-990530c1bdb9 with identifier: 1986838 to the API
2026-03-27 13:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/965/1759eb65dce9405db4b4674ba8520535/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '05a7b8b6-5236-5845-b041-990530c1bdb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 60096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a7b8b6-5236-5845-b041-990530c1bdb9/05a7b8b6-5236-5845-b041-990530c1bdb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/965/1759eb65dce9405db4b4674ba8520535/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 85kW (115CV) S&S Style Go "M"',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) S&S Style Go "M"',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986838%27 HTTP/1.1" 200 None
2026-03-27 13:33:25 [ayvens.es] INFO: Saving data for 1986838: {'created_time': 1774618405.155979, 'last_price_update_time': 1774618405.155993, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986838') HTTP/1.1" 204 0
2026-03-27 13:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89a597b4-5222-5681-9d9e-c7d488b2c384 with identifier: 1986840
2026-03-27 13:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89a597b4-5222-5681-9d9e-c7d488b2c384 with identifier: 1986840
2026-03-27 13:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89a597b4-5222-5681-9d9e-c7d488b2c384 with identifier: 1986840 to the API
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/824/68c3d69f60324643bed62587cd4305e9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '89a597b4-5222-5681-9d9e-c7d488b2c384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 59678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a597b4-5222-5681-9d9e-c7d488b2c384/89a597b4-5222-5681-9d9e-c7d488b2c384_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/824/68c3d69f60324643bed62587cd4305e9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2023}
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986840%27 HTTP/1.1" 200 None
2026-03-27 13:33:25 [ayvens.es] INFO: Saving data for 1986840: {'created_time': 1774618405.581912, 'last_price_update_time': 1774618405.581923, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986840') HTTP/1.1" 204 0
2026-03-27 13:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fff2e819-62e6-57ad-a159-bc7536562961 with identifier: 1986841
2026-03-27 13:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fff2e819-62e6-57ad-a159-bc7536562961 with identifier: 1986841
2026-03-27 13:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fff2e819-62e6-57ad-a159-bc7536562961 with identifier: 1986841 to the API
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/348/61caf17cf2ed463b8982a51e15d7f050/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fff2e819-62e6-57ad-a159-bc7536562961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 67869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fff2e819-62e6-57ad-a159-bc7536562961/fff2e819-62e6-57ad-a159-bc7536562961_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/348/61caf17cf2ed463b8982a51e15d7f050/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON Elegance 2.0 TDI 176kW (240CV) DSG',
 'transmission': 'manual',
 'trim': 'Elegance 2.0 TDI 176kW (240CV) DSG',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986841%27 HTTP/1.1" 200 None
2026-03-27 13:33:25 [ayvens.es] INFO: Saving data for 1986841: {'created_time': 1774618405.892637, 'last_price_update_time': 1774618405.892646, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986841') HTTP/1.1" 204 0
2026-03-27 13:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/229/a84d524beb14426e8c863f32762ebcc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/730/ef07f1b31b594377aabed62e812ce606/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:25 [ayvens.es] INFO: Found listing with ID: 1986850
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986850%27 HTTP/1.1" 200 None
2026-03-27 13:33:25 [ayvens.es] INFO: Scrape type for 1986850: 1
2026-03-27 13:33:25 [ayvens.es] INFO: Extracting data for car ID: 1986850
2026-03-27 13:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e0e7d7-50da-58d1-9505-b736f26aa04a with identifier: 1986850
2026-03-27 13:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e0e7d7-50da-58d1-9505-b736f26aa04a with scrape type 1
2026-03-27 13:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 96e0e7d7-50da-58d1-9505-b736f26aa04a
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F710%252Fec52469af2264361b472906ca8bd9b45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/710/ec52469af2264361b472906ca8bd9b45/images/large/1.jpg not downloaded yet
2026-03-27 13:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945ca910>
2026-03-27 13:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c/16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F756%252Fdfc8ec16b2b94703a9f8da3352c4b9d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/756/dfc8ec16b2b94703a9f8da3352c4b9d7/images/large/1.jpg saved to cache
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c
2026-03-27 13:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c, skipping ID generation
2026-03-27 13:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c with scrape type 1
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c sending to next pipeline
2026-03-27 13:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c, identifier: 1986842
2026-03-27 13:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/142/bdd5ffc8863d41b5b2f561129a93b177/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:26 [ayvens.es] INFO: Found listing with ID: 1986851
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986851%27 HTTP/1.1" 200 None
2026-03-27 13:33:26 [ayvens.es] INFO: Scrape type for 1986851: 1
2026-03-27 13:33:26 [ayvens.es] INFO: Extracting data for car ID: 1986851
2026-03-27 13:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58bc041b-f307-5db5-8464-bbc595301e21 with identifier: 1986851
2026-03-27 13:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bc041b-f307-5db5-8464-bbc595301e21 with scrape type 1
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 58bc041b-f307-5db5-8464-bbc595301e21
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Fb9b6592854c74365ae8f088389b4b528%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/b9b6592854c74365ae8f088389b4b528/images/large/1.jpg not downloaded yet
2026-03-27 13:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c with identifier: 1986842
2026-03-27 13:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c with identifier: 1986842
2026-03-27 13:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c with identifier: 1986842 to the API
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/756/dfc8ec16b2b94703a9f8da3352c4b9d7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 98279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c/16a3eda3-e7b9-5e53-8ddd-2fa0f8b5870c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/756/dfc8ec16b2b94703a9f8da3352c4b9d7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986842%27 HTTP/1.1" 200 None
2026-03-27 13:33:26 [ayvens.es] INFO: Saving data for 1986842: {'created_time': 1774618406.506279, 'last_price_update_time': 1774618406.50629, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986842') HTTP/1.1" 204 0
2026-03-27 13:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/548/84923c859f2948c8abc40d8b6a434755/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:26 [ayvens.es] INFO: Found listing with ID: 1986852
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986852%27 HTTP/1.1" 200 None
2026-03-27 13:33:26 [ayvens.es] INFO: Scrape type for 1986852: 1
2026-03-27 13:33:26 [ayvens.es] INFO: Extracting data for car ID: 1986852
2026-03-27 13:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1599ab7-8d93-5e9a-aaf7-04a96231341e with identifier: 1986852
2026-03-27 13:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1599ab7-8d93-5e9a-aaf7-04a96231341e with scrape type 1
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1599ab7-8d93-5e9a-aaf7-04a96231341e
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F739%252F7715b444a8b1437f8de42b0ac9650a5e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/739/7715b444a8b1437f8de42b0ac9650a5e/images/large/1.jpg not downloaded yet
2026-03-27 13:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/557/923aea37001348b1b12a6554d7fc2b64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c3590>
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e73321-706b-5a65-980c-6a4e8e4bb6ee/c3e73321-706b-5a65-980c-6a4e8e4bb6ee_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F229%252Fa84d524beb14426e8c863f32762ebcc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/229/a84d524beb14426e8c863f32762ebcc9/images/large/1.jpg saved to cache
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee
2026-03-27 13:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3e73321-706b-5a65-980c-6a4e8e4bb6ee, skipping ID generation
2026-03-27 13:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee with scrape type 1
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3e73321-706b-5a65-980c-6a4e8e4bb6ee sending to next pipeline
2026-03-27 13:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3e73321-706b-5a65-980c-6a4e8e4bb6ee, identifier: 1986843
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960be390>
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_335d649b-7a33-582f-b16b-21d6f5329660/335d649b-7a33-582f-b16b-21d6f5329660_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F730%252Fef07f1b31b594377aabed62e812ce606%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/730/ef07f1b31b594377aabed62e812ce606/images/large/1.jpg saved to cache
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 335d649b-7a33-582f-b16b-21d6f5329660
2026-03-27 13:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 335d649b-7a33-582f-b16b-21d6f5329660, skipping ID generation
2026-03-27 13:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335d649b-7a33-582f-b16b-21d6f5329660 with scrape type 1
2026-03-27 13:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 335d649b-7a33-582f-b16b-21d6f5329660 sending to next pipeline
2026-03-27 13:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 335d649b-7a33-582f-b16b-21d6f5329660, identifier: 1986844
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f7acd0>
2026-03-27 13:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3afd809-0b3a-59e2-8c9d-b6843022bb13/c3afd809-0b3a-59e2-8c9d-b6843022bb13_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252Fbdd5ffc8863d41b5b2f561129a93b177%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/bdd5ffc8863d41b5b2f561129a93b177/images/large/1.jpg saved to cache
2026-03-27 13:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3afd809-0b3a-59e2-8c9d-b6843022bb13
2026-03-27 13:33:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3afd809-0b3a-59e2-8c9d-b6843022bb13, skipping ID generation
2026-03-27 13:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3afd809-0b3a-59e2-8c9d-b6843022bb13 with scrape type 1
2026-03-27 13:33:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3afd809-0b3a-59e2-8c9d-b6843022bb13 sending to next pipeline
2026-03-27 13:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3afd809-0b3a-59e2-8c9d-b6843022bb13, identifier: 1986845
2026-03-27 13:33:27 [ayvens.es] INFO: Found listing with ID: 1986853
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986853%27 HTTP/1.1" 200 None
2026-03-27 13:33:27 [ayvens.es] INFO: Scrape type for 1986853: 1
2026-03-27 13:33:27 [ayvens.es] INFO: Extracting data for car ID: 1986853
2026-03-27 13:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93e0f19-d8db-52ce-a378-2dbab0d12488 with identifier: 1986853
2026-03-27 13:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93e0f19-d8db-52ce-a378-2dbab0d12488 with scrape type 1
2026-03-27 13:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d93e0f19-d8db-52ce-a378-2dbab0d12488
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252Ff62c3983244347b9915dda633bed6a83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/f62c3983244347b9915dda633bed6a83/images/large/1.jpg not downloaded yet
2026-03-27 13:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3e73321-706b-5a65-980c-6a4e8e4bb6ee with identifier: 1986843
2026-03-27 13:33:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3e73321-706b-5a65-980c-6a4e8e4bb6ee with identifier: 1986843
2026-03-27 13:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3e73321-706b-5a65-980c-6a4e8e4bb6ee with identifier: 1986843 to the API
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/229/a84d524beb14426e8c863f32762ebcc9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Crystal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c3e73321-706b-5a65-980c-6a4e8e4bb6ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 58651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e73321-706b-5a65-980c-6a4e8e4bb6ee/c3e73321-706b-5a65-980c-6a4e8e4bb6ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/229/a84d524beb14426e8c863f32762ebcc9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 B3 G Plus Dark Auto',
 'transmission': 'manual',
 'trim': '2.0 B3 G Plus Dark Auto',
 'vin': None,
 'year': 2023}
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986843%27 HTTP/1.1" 200 None
2026-03-27 13:33:27 [ayvens.es] INFO: Saving data for 1986843: {'created_time': 1774618407.55527, 'last_price_update_time': 1774618407.555283, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986843') HTTP/1.1" 204 0
2026-03-27 13:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 335d649b-7a33-582f-b16b-21d6f5329660 with identifier: 1986844
2026-03-27 13:33:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 335d649b-7a33-582f-b16b-21d6f5329660 with identifier: 1986844
2026-03-27 13:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 335d649b-7a33-582f-b16b-21d6f5329660 with identifier: 1986844 to the API
2026-03-27 13:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/730/ef07f1b31b594377aabed62e812ce606/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Vivo',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '335d649b-7a33-582f-b16b-21d6f5329660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 201579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_335d649b-7a33-582f-b16b-21d6f5329660/335d649b-7a33-582f-b16b-21d6f5329660_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/730/ef07f1b31b594377aabed62e812ce606/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986844%27 HTTP/1.1" 200 None
2026-03-27 13:33:28 [ayvens.es] INFO: Saving data for 1986844: {'created_time': 1774618408.344137, 'last_price_update_time': 1774618408.344147, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986844') HTTP/1.1" 204 0
2026-03-27 13:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3afd809-0b3a-59e2-8c9d-b6843022bb13 with identifier: 1986845
2026-03-27 13:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3afd809-0b3a-59e2-8c9d-b6843022bb13 with identifier: 1986845
2026-03-27 13:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3afd809-0b3a-59e2-8c9d-b6843022bb13 with identifier: 1986845 to the API
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/142/bdd5ffc8863d41b5b2f561129a93b177/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c3afd809-0b3a-59e2-8c9d-b6843022bb13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY',
 'odometer': 42359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3afd809-0b3a-59e2-8c9d-b6843022bb13/c3afd809-0b3a-59e2-8c9d-b6843022bb13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/142/bdd5ffc8863d41b5b2f561129a93b177/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY 1.5D 75kW (100CV) GX 650kg Media',
 'transmission': 'manual',
 'trim': '1.5D 75kW (100CV) GX 650kg Media',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986845%27 HTTP/1.1" 200 None
2026-03-27 13:33:28 [ayvens.es] INFO: Saving data for 1986845: {'created_time': 1774618408.865471, 'last_price_update_time': 1774618408.865482, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986845') HTTP/1.1" 204 0
2026-03-27 13:33:28 [ayvens.es] INFO: Found listing with ID: 1986854
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986854%27 HTTP/1.1" 200 None
2026-03-27 13:33:28 [ayvens.es] INFO: Scrape type for 1986854: 1
2026-03-27 13:33:28 [ayvens.es] INFO: Extracting data for car ID: 1986854
2026-03-27 13:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with identifier: 1986854
2026-03-27 13:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with scrape type 1
2026-03-27 13:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F623%252Fab8c70e7de8941a4b0f4be747b891947%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/623/ab8c70e7de8941a4b0f4be747b891947/images/large/1.jpg not downloaded yet
2026-03-27 13:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297943d10>
2026-03-27 13:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e87b5e49-ddb3-528b-9d2f-09ca840a391d/e87b5e49-ddb3-528b-9d2f-09ca840a391d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252F84923c859f2948c8abc40d8b6a434755%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/84923c859f2948c8abc40d8b6a434755/images/large/1.jpg saved to cache
2026-03-27 13:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e87b5e49-ddb3-528b-9d2f-09ca840a391d
2026-03-27 13:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e87b5e49-ddb3-528b-9d2f-09ca840a391d, skipping ID generation
2026-03-27 13:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e87b5e49-ddb3-528b-9d2f-09ca840a391d with scrape type 1
2026-03-27 13:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e87b5e49-ddb3-528b-9d2f-09ca840a391d sending to next pipeline
2026-03-27 13:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e87b5e49-ddb3-528b-9d2f-09ca840a391d, identifier: 1986846
2026-03-27 13:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f09950>
2026-03-27 13:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef58058b-a80c-52bd-96d9-25c4783ef344/ef58058b-a80c-52bd-96d9-25c4783ef344_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F557%252F923aea37001348b1b12a6554d7fc2b64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/557/923aea37001348b1b12a6554d7fc2b64/images/large/1.jpg saved to cache
2026-03-27 13:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef58058b-a80c-52bd-96d9-25c4783ef344
2026-03-27 13:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef58058b-a80c-52bd-96d9-25c4783ef344, skipping ID generation
2026-03-27 13:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef58058b-a80c-52bd-96d9-25c4783ef344 with scrape type 1
2026-03-27 13:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef58058b-a80c-52bd-96d9-25c4783ef344 sending to next pipeline
2026-03-27 13:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef58058b-a80c-52bd-96d9-25c4783ef344, identifier: 1986847
2026-03-27 13:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/907/261536f1700a41ffa18238963238ad85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:29 [ayvens.es] INFO: Found listing with ID: 1986855
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986855%27 HTTP/1.1" 200 None
2026-03-27 13:33:29 [ayvens.es] INFO: Scrape type for 1986855: 1
2026-03-27 13:33:29 [ayvens.es] INFO: Extracting data for car ID: 1986855
2026-03-27 13:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 101ae601-de13-5d20-ac7d-5ae40d032fc5 with identifier: 1986855
2026-03-27 13:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101ae601-de13-5d20-ac7d-5ae40d032fc5 with scrape type 1
2026-03-27 13:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 101ae601-de13-5d20-ac7d-5ae40d032fc5
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F781%252F4a84757796e2455d8e95d414b1ce0b53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/781/4a84757796e2455d8e95d414b1ce0b53/images/large/1.jpg not downloaded yet
2026-03-27 13:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e87b5e49-ddb3-528b-9d2f-09ca840a391d with identifier: 1986846
2026-03-27 13:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e87b5e49-ddb3-528b-9d2f-09ca840a391d with identifier: 1986846
2026-03-27 13:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e87b5e49-ddb3-528b-9d2f-09ca840a391d with identifier: 1986846 to the API
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/548/84923c859f2948c8abc40d8b6a434755/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e87b5e49-ddb3-528b-9d2f-09ca840a391d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 100229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e87b5e49-ddb3-528b-9d2f-09ca840a391d/e87b5e49-ddb3-528b-9d2f-09ca840a391d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/548/84923c859f2948c8abc40d8b6a434755/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986846%27 HTTP/1.1" 200 None
2026-03-27 13:33:29 [ayvens.es] INFO: Saving data for 1986846: {'created_time': 1774618409.669885, 'last_price_update_time': 1774618409.669895, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986846') HTTP/1.1" 204 0
2026-03-27 13:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef58058b-a80c-52bd-96d9-25c4783ef344 with identifier: 1986847
2026-03-27 13:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef58058b-a80c-52bd-96d9-25c4783ef344 with identifier: 1986847
2026-03-27 13:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef58058b-a80c-52bd-96d9-25c4783ef344 with identifier: 1986847 to the API
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/557/923aea37001348b1b12a6554d7fc2b64/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef58058b-a80c-52bd-96d9-25c4783ef344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 102588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef58058b-a80c-52bd-96d9-25c4783ef344/ef58058b-a80c-52bd-96d9-25c4783ef344_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/557/923aea37001348b1b12a6554d7fc2b64/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986847%27 HTTP/1.1" 200 None
2026-03-27 13:33:30 [ayvens.es] INFO: Saving data for 1986847: {'created_time': 1774618410.011575, 'last_price_update_time': 1774618410.011585, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986847') HTTP/1.1" 204 0
2026-03-27 13:33:30 [ayvens.es] INFO: Found listing with ID: 1986856
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986856%27 HTTP/1.1" 200 None
2026-03-27 13:33:30 [ayvens.es] INFO: Scrape type for 1986856: 1
2026-03-27 13:33:30 [ayvens.es] INFO: Extracting data for car ID: 1986856
2026-03-27 13:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eea1f09-c08e-5a39-83a6-59729f41dfce with identifier: 1986856
2026-03-27 13:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eea1f09-c08e-5a39-83a6-59729f41dfce with scrape type 1
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0eea1f09-c08e-5a39-83a6-59729f41dfce
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F597%252F87aabe40ca824acdacba5de6ac0ae442%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/597/87aabe40ca824acdacba5de6ac0ae442/images/large/1.jpg not downloaded yet
2026-03-27 13:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529579fc50>
2026-03-27 13:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c7a9a9-9030-5698-a360-82196a8b0eb3/f6c7a9a9-9030-5698-a360-82196a8b0eb3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F907%252F261536f1700a41ffa18238963238ad85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/907/261536f1700a41ffa18238963238ad85/images/large/1.jpg saved to cache
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6c7a9a9-9030-5698-a360-82196a8b0eb3
2026-03-27 13:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6c7a9a9-9030-5698-a360-82196a8b0eb3, skipping ID generation
2026-03-27 13:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c7a9a9-9030-5698-a360-82196a8b0eb3 with scrape type 1
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6c7a9a9-9030-5698-a360-82196a8b0eb3 sending to next pipeline
2026-03-27 13:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6c7a9a9-9030-5698-a360-82196a8b0eb3, identifier: 1986848
2026-03-27 13:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/710/ec52469af2264361b472906ca8bd9b45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:30 [ayvens.es] INFO: Found listing with ID: 1986857
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986857%27 HTTP/1.1" 200 None
2026-03-27 13:33:30 [ayvens.es] INFO: Scrape type for 1986857: 1
2026-03-27 13:33:30 [ayvens.es] INFO: Extracting data for car ID: 1986857
2026-03-27 13:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d3e1e48-30a1-59c6-9958-4f0c385b85b5 with identifier: 1986857
2026-03-27 13:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d3e1e48-30a1-59c6-9958-4f0c385b85b5 with scrape type 1
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0d3e1e48-30a1-59c6-9958-4f0c385b85b5
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F48c524b263574117bf6e6130fedbb3c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/48c524b263574117bf6e6130fedbb3c6/images/large/1.jpg not downloaded yet
2026-03-27 13:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6c7a9a9-9030-5698-a360-82196a8b0eb3 with identifier: 1986848
2026-03-27 13:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6c7a9a9-9030-5698-a360-82196a8b0eb3 with identifier: 1986848
2026-03-27 13:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6c7a9a9-9030-5698-a360-82196a8b0eb3 with identifier: 1986848 to the API
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/907/261536f1700a41ffa18238963238ad85/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f6c7a9a9-9030-5698-a360-82196a8b0eb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 162089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c7a9a9-9030-5698-a360-82196a8b0eb3/f6c7a9a9-9030-5698-a360-82196a8b0eb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/907/261536f1700a41ffa18238963238ad85/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '2.0 180H Advance',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986848%27 HTTP/1.1" 200 None
2026-03-27 13:33:30 [ayvens.es] INFO: Saving data for 1986848: {'created_time': 1774618410.733574, 'last_price_update_time': 1774618410.733583, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986848') HTTP/1.1" 204 0
2026-03-27 13:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/491/be574122a9ee4df5acdbf465693057c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:30 [ayvens.es] INFO: Found listing with ID: 1986943
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986943%27 HTTP/1.1" 200 None
2026-03-27 13:33:30 [ayvens.es] INFO: Scrape type for 1986943: 1
2026-03-27 13:33:30 [ayvens.es] INFO: Extracting data for car ID: 1986943
2026-03-27 13:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dc418ee-136c-589a-9941-99078d2f0e8a with identifier: 1986943
2026-03-27 13:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dc418ee-136c-589a-9941-99078d2f0e8a with scrape type 1
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2dc418ee-136c-589a-9941-99078d2f0e8a
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252Fc0587f6accff4f4daf5b0af60f9dcd2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/c0587f6accff4f4daf5b0af60f9dcd2a/images/large/1.jpg not downloaded yet
2026-03-27 13:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956fb8d0>
2026-03-27 13:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e0e7d7-50da-58d1-9505-b736f26aa04a/96e0e7d7-50da-58d1-9505-b736f26aa04a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F710%252Fec52469af2264361b472906ca8bd9b45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/710/ec52469af2264361b472906ca8bd9b45/images/large/1.jpg saved to cache
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96e0e7d7-50da-58d1-9505-b736f26aa04a
2026-03-27 13:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96e0e7d7-50da-58d1-9505-b736f26aa04a, skipping ID generation
2026-03-27 13:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e0e7d7-50da-58d1-9505-b736f26aa04a with scrape type 1
2026-03-27 13:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96e0e7d7-50da-58d1-9505-b736f26aa04a sending to next pipeline
2026-03-27 13:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 96e0e7d7-50da-58d1-9505-b736f26aa04a, identifier: 1986850
2026-03-27 13:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/b9b6592854c74365ae8f088389b4b528/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/739/7715b444a8b1437f8de42b0ac9650a5e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:31 [ayvens.es] INFO: Found listing with ID: 1986944
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986944%27 HTTP/1.1" 200 None
2026-03-27 13:33:31 [ayvens.es] INFO: Scrape type for 1986944: 1
2026-03-27 13:33:31 [ayvens.es] INFO: Extracting data for car ID: 1986944
2026-03-27 13:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9e8777-f999-5aeb-b707-da654c85dc04 with identifier: 1986944
2026-03-27 13:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9e8777-f999-5aeb-b707-da654c85dc04 with scrape type 1
2026-03-27 13:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de9e8777-f999-5aeb-b707-da654c85dc04
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F143%252Fa3aa07c638c548fa80f592dd040fcb2f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/143/a3aa07c638c548fa80f592dd040fcb2f/images/large/1.jpg not downloaded yet
2026-03-27 13:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 96e0e7d7-50da-58d1-9505-b736f26aa04a with identifier: 1986850
2026-03-27 13:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 96e0e7d7-50da-58d1-9505-b736f26aa04a with identifier: 1986850
2026-03-27 13:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 96e0e7d7-50da-58d1-9505-b736f26aa04a with identifier: 1986850 to the API
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/710/ec52469af2264361b472906ca8bd9b45/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '96e0e7d7-50da-58d1-9505-b736f26aa04a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 71120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e0e7d7-50da-58d1-9505-b736f26aa04a/96e0e7d7-50da-58d1-9505-b736f26aa04a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/710/ec52469af2264361b472906ca8bd9b45/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986850%27 HTTP/1.1" 200 None
2026-03-27 13:33:31 [ayvens.es] INFO: Saving data for 1986850: {'created_time': 1774618411.723134, 'last_price_update_time': 1774618411.723145, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986850') HTTP/1.1" 204 0
2026-03-27 13:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/911/f62c3983244347b9915dda633bed6a83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:31 [ayvens.es] INFO: Found listing with ID: 1986945
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986945%27 HTTP/1.1" 200 None
2026-03-27 13:33:31 [ayvens.es] INFO: Scrape type for 1986945: 1
2026-03-27 13:33:31 [ayvens.es] INFO: Extracting data for car ID: 1986945
2026-03-27 13:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with identifier: 1986945
2026-03-27 13:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with scrape type 1
2026-03-27 13:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252F0b6a48b27b16453aaaeae7b495647ccd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/0b6a48b27b16453aaaeae7b495647ccd/images/large/1.jpg not downloaded yet
2026-03-27 13:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529579ef50>
2026-03-27 13:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977023ea-1da6-5abc-86cb-e6c42e762e20/977023ea-1da6-5abc-86cb-e6c42e762e20_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252Fbe574122a9ee4df5acdbf465693057c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/be574122a9ee4df5acdbf465693057c7/images/large/1.jpg saved to cache
2026-03-27 13:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 977023ea-1da6-5abc-86cb-e6c42e762e20
2026-03-27 13:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 977023ea-1da6-5abc-86cb-e6c42e762e20, skipping ID generation
2026-03-27 13:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977023ea-1da6-5abc-86cb-e6c42e762e20 with scrape type 1
2026-03-27 13:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 977023ea-1da6-5abc-86cb-e6c42e762e20 sending to next pipeline
2026-03-27 13:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 977023ea-1da6-5abc-86cb-e6c42e762e20, identifier: 1986849
2026-03-27 13:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957b4d90>
2026-03-27 13:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58bc041b-f307-5db5-8464-bbc595301e21/58bc041b-f307-5db5-8464-bbc595301e21_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Fb9b6592854c74365ae8f088389b4b528%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/b9b6592854c74365ae8f088389b4b528/images/large/1.jpg saved to cache
2026-03-27 13:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58bc041b-f307-5db5-8464-bbc595301e21
2026-03-27 13:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58bc041b-f307-5db5-8464-bbc595301e21, skipping ID generation
2026-03-27 13:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bc041b-f307-5db5-8464-bbc595301e21 with scrape type 1
2026-03-27 13:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58bc041b-f307-5db5-8464-bbc595301e21 sending to next pipeline
2026-03-27 13:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 58bc041b-f307-5db5-8464-bbc595301e21, identifier: 1986851
2026-03-27 13:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bfd750>
2026-03-27 13:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1599ab7-8d93-5e9a-aaf7-04a96231341e/b1599ab7-8d93-5e9a-aaf7-04a96231341e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F739%252F7715b444a8b1437f8de42b0ac9650a5e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/739/7715b444a8b1437f8de42b0ac9650a5e/images/large/1.jpg saved to cache
2026-03-27 13:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1599ab7-8d93-5e9a-aaf7-04a96231341e
2026-03-27 13:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1599ab7-8d93-5e9a-aaf7-04a96231341e, skipping ID generation
2026-03-27 13:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1599ab7-8d93-5e9a-aaf7-04a96231341e with scrape type 1
2026-03-27 13:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1599ab7-8d93-5e9a-aaf7-04a96231341e sending to next pipeline
2026-03-27 13:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1599ab7-8d93-5e9a-aaf7-04a96231341e, identifier: 1986852
2026-03-27 13:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/623/ab8c70e7de8941a4b0f4be747b891947/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:32 [ayvens.es] INFO: Found listing with ID: 1986946
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986946%27 HTTP/1.1" 200 None
2026-03-27 13:33:32 [ayvens.es] INFO: Scrape type for 1986946: 1
2026-03-27 13:33:32 [ayvens.es] INFO: Extracting data for car ID: 1986946
2026-03-27 13:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5434c540-9d70-5196-8914-8fd8308d0bde with identifier: 1986946
2026-03-27 13:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5434c540-9d70-5196-8914-8fd8308d0bde with scrape type 1
2026-03-27 13:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5434c540-9d70-5196-8914-8fd8308d0bde
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F525%252F472d89c31bb24f67968b992cd4d5b566%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/525/472d89c31bb24f67968b992cd4d5b566/images/large/1.jpg not downloaded yet
2026-03-27 13:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 977023ea-1da6-5abc-86cb-e6c42e762e20 with identifier: 1986849
2026-03-27 13:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 977023ea-1da6-5abc-86cb-e6c42e762e20 with identifier: 1986849
2026-03-27 13:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 977023ea-1da6-5abc-86cb-e6c42e762e20 with identifier: 1986849 to the API
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/491/be574122a9ee4df5acdbf465693057c7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '977023ea-1da6-5abc-86cb-e6c42e762e20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 116928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977023ea-1da6-5abc-86cb-e6c42e762e20/977023ea-1da6-5abc-86cb-e6c42e762e20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/491/be574122a9ee4df5acdbf465693057c7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986849%27 HTTP/1.1" 200 None
2026-03-27 13:33:32 [ayvens.es] INFO: Saving data for 1986849: {'created_time': 1774618412.765319, 'last_price_update_time': 1774618412.765331, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986849') HTTP/1.1" 204 0
2026-03-27 13:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 58bc041b-f307-5db5-8464-bbc595301e21 with identifier: 1986851
2026-03-27 13:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 58bc041b-f307-5db5-8464-bbc595301e21 with identifier: 1986851
2026-03-27 13:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 58bc041b-f307-5db5-8464-bbc595301e21 with identifier: 1986851 to the API
2026-03-27 13:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/b9b6592854c74365ae8f088389b4b528/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '58bc041b-f307-5db5-8464-bbc595301e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 126960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58bc041b-f307-5db5-8464-bbc595301e21/58bc041b-f307-5db5-8464-bbc595301e21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/b9b6592854c74365ae8f088389b4b528/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986851%27 HTTP/1.1" 200 None
2026-03-27 13:33:33 [ayvens.es] INFO: Saving data for 1986851: {'created_time': 1774618413.169764, 'last_price_update_time': 1774618413.169775, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986851') HTTP/1.1" 204 0
2026-03-27 13:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1599ab7-8d93-5e9a-aaf7-04a96231341e with identifier: 1986852
2026-03-27 13:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1599ab7-8d93-5e9a-aaf7-04a96231341e with identifier: 1986852
2026-03-27 13:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1599ab7-8d93-5e9a-aaf7-04a96231341e with identifier: 1986852 to the API
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/739/7715b444a8b1437f8de42b0ac9650a5e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b1599ab7-8d93-5e9a-aaf7-04a96231341e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1599ab7-8d93-5e9a-aaf7-04a96231341e/b1599ab7-8d93-5e9a-aaf7-04a96231341e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/739/7715b444a8b1437f8de42b0ac9650a5e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style Go',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986852%27 HTTP/1.1" 200 None
2026-03-27 13:33:33 [ayvens.es] INFO: Saving data for 1986852: {'created_time': 1774618413.520007, 'last_price_update_time': 1774618413.520018, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986852') HTTP/1.1" 204 0
2026-03-27 13:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/781/4a84757796e2455d8e95d414b1ce0b53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:33 [ayvens.es] INFO: Found listing with ID: 1986947
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986947%27 HTTP/1.1" 200 None
2026-03-27 13:33:33 [ayvens.es] INFO: Scrape type for 1986947: 1
2026-03-27 13:33:33 [ayvens.es] INFO: Extracting data for car ID: 1986947
2026-03-27 13:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef84855c-a0e7-5547-a2b9-d5799e30c11a with identifier: 1986947
2026-03-27 13:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef84855c-a0e7-5547-a2b9-d5799e30c11a with scrape type 1
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef84855c-a0e7-5547-a2b9-d5799e30c11a
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F885%252F56f2cf4b8e4f41c48608a3039cdb49fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/885/56f2cf4b8e4f41c48608a3039cdb49fa/images/large/1.jpg not downloaded yet
2026-03-27 13:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960c0c10>
2026-03-27 13:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93e0f19-d8db-52ce-a378-2dbab0d12488/d93e0f19-d8db-52ce-a378-2dbab0d12488_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252Ff62c3983244347b9915dda633bed6a83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/f62c3983244347b9915dda633bed6a83/images/large/1.jpg saved to cache
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d93e0f19-d8db-52ce-a378-2dbab0d12488
2026-03-27 13:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d93e0f19-d8db-52ce-a378-2dbab0d12488, skipping ID generation
2026-03-27 13:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93e0f19-d8db-52ce-a378-2dbab0d12488 with scrape type 1
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d93e0f19-d8db-52ce-a378-2dbab0d12488 sending to next pipeline
2026-03-27 13:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d93e0f19-d8db-52ce-a378-2dbab0d12488, identifier: 1986853
2026-03-27 13:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ed7090>
2026-03-27 13:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab0d626-9af5-5ad6-9789-cfe0d63a83b0/4ab0d626-9af5-5ad6-9789-cfe0d63a83b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F623%252Fab8c70e7de8941a4b0f4be747b891947%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/623/ab8c70e7de8941a4b0f4be747b891947/images/large/1.jpg saved to cache
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0
2026-03-27 13:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0, skipping ID generation
2026-03-27 13:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with scrape type 1
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 sending to next pipeline
2026-03-27 13:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0, identifier: 1986854
2026-03-27 13:33:33 [ayvens.es] INFO: Found listing with ID: 1986948
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986948%27 HTTP/1.1" 200 None
2026-03-27 13:33:33 [ayvens.es] INFO: Scrape type for 1986948: 1
2026-03-27 13:33:33 [ayvens.es] INFO: Extracting data for car ID: 1986948
2026-03-27 13:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55f1116-b4b3-51bc-9328-9eefbcd5f89b with identifier: 1986948
2026-03-27 13:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b with scrape type 1
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252Fcd99b56d896040aea9183b07eb88de35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/cd99b56d896040aea9183b07eb88de35/images/large/1.jpg not downloaded yet
2026-03-27 13:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d93e0f19-d8db-52ce-a378-2dbab0d12488 with identifier: 1986853
2026-03-27 13:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d93e0f19-d8db-52ce-a378-2dbab0d12488 with identifier: 1986853
2026-03-27 13:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d93e0f19-d8db-52ce-a378-2dbab0d12488 with identifier: 1986853 to the API
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/911/f62c3983244347b9915dda633bed6a83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd93e0f19-d8db-52ce-a378-2dbab0d12488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 147505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93e0f19-d8db-52ce-a378-2dbab0d12488/d93e0f19-d8db-52ce-a378-2dbab0d12488_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/911/f62c3983244347b9915dda633bed6a83/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986853%27 HTTP/1.1" 200 None
2026-03-27 13:33:34 [ayvens.es] INFO: Saving data for 1986853: {'created_time': 1774618414.229635, 'last_price_update_time': 1774618414.229646, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986853') HTTP/1.1" 204 0
2026-03-27 13:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with identifier: 1986854
2026-03-27 13:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with identifier: 1986854
2026-03-27 13:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with identifier: 1986854 to the API
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/623/ab8c70e7de8941a4b0f4be747b891947/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ab0d626-9af5-5ad6-9789-cfe0d63a83b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 179554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab0d626-9af5-5ad6-9789-cfe0d63a83b0/4ab0d626-9af5-5ad6-9789-cfe0d63a83b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/623/ab8c70e7de8941a4b0f4be747b891947/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Equilibre Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2023}
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986854%27 HTTP/1.1" 200 None
2026-03-27 13:33:34 [ayvens.es] INFO: Saving data for 1986854: {'created_time': 1774618414.549982, 'last_price_update_time': 1774618414.549992, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986854') HTTP/1.1" 204 0
2026-03-27 13:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/597/87aabe40ca824acdacba5de6ac0ae442/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/c0587f6accff4f4daf5b0af60f9dcd2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/48c524b263574117bf6e6130fedbb3c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:34 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-27 13:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52982f2b10>
2026-03-27 13:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101ae601-de13-5d20-ac7d-5ae40d032fc5/101ae601-de13-5d20-ac7d-5ae40d032fc5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F781%252F4a84757796e2455d8e95d414b1ce0b53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/781/4a84757796e2455d8e95d414b1ce0b53/images/large/1.jpg saved to cache
2026-03-27 13:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 101ae601-de13-5d20-ac7d-5ae40d032fc5
2026-03-27 13:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 101ae601-de13-5d20-ac7d-5ae40d032fc5, skipping ID generation
2026-03-27 13:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101ae601-de13-5d20-ac7d-5ae40d032fc5 with scrape type 1
2026-03-27 13:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 101ae601-de13-5d20-ac7d-5ae40d032fc5 sending to next pipeline
2026-03-27 13:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 101ae601-de13-5d20-ac7d-5ae40d032fc5, identifier: 1986855
2026-03-27 13:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 101ae601-de13-5d20-ac7d-5ae40d032fc5 with identifier: 1986855
2026-03-27 13:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 101ae601-de13-5d20-ac7d-5ae40d032fc5 with identifier: 1986855
2026-03-27 13:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 101ae601-de13-5d20-ac7d-5ae40d032fc5 with identifier: 1986855 to the API
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/781/4a84757796e2455d8e95d414b1ce0b53/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '101ae601-de13-5d20-ac7d-5ae40d032fc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 103068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101ae601-de13-5d20-ac7d-5ae40d032fc5/101ae601-de13-5d20-ac7d-5ae40d032fc5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/781/4a84757796e2455d8e95d414b1ce0b53/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV) Variant',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV) Variant',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986855%27 HTTP/1.1" 200 None
2026-03-27 13:33:35 [ayvens.es] INFO: Saving data for 1986855: {'created_time': 1774618415.048486, 'last_price_update_time': 1774618415.048497, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986855') HTTP/1.1" 204 0
2026-03-27 13:33:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 13:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/177/0b6a48b27b16453aaaeae7b495647ccd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52a4137dd0>
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eea1f09-c08e-5a39-83a6-59729f41dfce/0eea1f09-c08e-5a39-83a6-59729f41dfce_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F597%252F87aabe40ca824acdacba5de6ac0ae442%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/597/87aabe40ca824acdacba5de6ac0ae442/images/large/1.jpg saved to cache
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eea1f09-c08e-5a39-83a6-59729f41dfce
2026-03-27 13:33:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eea1f09-c08e-5a39-83a6-59729f41dfce, skipping ID generation
2026-03-27 13:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eea1f09-c08e-5a39-83a6-59729f41dfce with scrape type 1
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eea1f09-c08e-5a39-83a6-59729f41dfce sending to next pipeline
2026-03-27 13:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0eea1f09-c08e-5a39-83a6-59729f41dfce, identifier: 1986856
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961dad50>
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dc418ee-136c-589a-9941-99078d2f0e8a/2dc418ee-136c-589a-9941-99078d2f0e8a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252Fc0587f6accff4f4daf5b0af60f9dcd2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/c0587f6accff4f4daf5b0af60f9dcd2a/images/large/1.jpg saved to cache
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dc418ee-136c-589a-9941-99078d2f0e8a
2026-03-27 13:33:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dc418ee-136c-589a-9941-99078d2f0e8a, skipping ID generation
2026-03-27 13:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dc418ee-136c-589a-9941-99078d2f0e8a with scrape type 1
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dc418ee-136c-589a-9941-99078d2f0e8a sending to next pipeline
2026-03-27 13:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2dc418ee-136c-589a-9941-99078d2f0e8a, identifier: 1986943
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52a4137dd0>
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d3e1e48-30a1-59c6-9958-4f0c385b85b5/0d3e1e48-30a1-59c6-9958-4f0c385b85b5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F48c524b263574117bf6e6130fedbb3c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/48c524b263574117bf6e6130fedbb3c6/images/large/1.jpg saved to cache
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d3e1e48-30a1-59c6-9958-4f0c385b85b5
2026-03-27 13:33:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d3e1e48-30a1-59c6-9958-4f0c385b85b5, skipping ID generation
2026-03-27 13:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d3e1e48-30a1-59c6-9958-4f0c385b85b5 with scrape type 1
2026-03-27 13:33:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d3e1e48-30a1-59c6-9958-4f0c385b85b5 sending to next pipeline
2026-03-27 13:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0d3e1e48-30a1-59c6-9958-4f0c385b85b5, identifier: 1986857
2026-03-27 13:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0eea1f09-c08e-5a39-83a6-59729f41dfce with identifier: 1986856
2026-03-27 13:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0eea1f09-c08e-5a39-83a6-59729f41dfce with identifier: 1986856
2026-03-27 13:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0eea1f09-c08e-5a39-83a6-59729f41dfce with identifier: 1986856 to the API
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/597/87aabe40ca824acdacba5de6ac0ae442/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '0eea1f09-c08e-5a39-83a6-59729f41dfce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 74589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eea1f09-c08e-5a39-83a6-59729f41dfce/0eea1f09-c08e-5a39-83a6-59729f41dfce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/597/87aabe40ca824acdacba5de6ac0ae442/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.5 TSI 110kW DSG S&S Style Edition Nav',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW DSG S&S Style Edition Nav',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986856%27 HTTP/1.1" 200 None
2026-03-27 13:33:35 [ayvens.es] INFO: Saving data for 1986856: {'created_time': 1774618415.950452, 'last_price_update_time': 1774618415.950463, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986856') HTTP/1.1" 204 0
2026-03-27 13:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2dc418ee-136c-589a-9941-99078d2f0e8a with identifier: 1986943
2026-03-27 13:33:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2dc418ee-136c-589a-9941-99078d2f0e8a with identifier: 1986943
2026-03-27 13:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2dc418ee-136c-589a-9941-99078d2f0e8a with identifier: 1986943 to the API
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/c0587f6accff4f4daf5b0af60f9dcd2a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2dc418ee-136c-589a-9941-99078d2f0e8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 48165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dc418ee-136c-589a-9941-99078d2f0e8a/2dc418ee-136c-589a-9941-99078d2f0e8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/c0587f6accff4f4daf5b0af60f9dcd2a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Authentic Energy Blue dCi 81 kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Authentic Energy Blue dCi 81 kW (110CV)',
 'vin': None,
 'year': 2024}
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986943%27 HTTP/1.1" 200 None
2026-03-27 13:33:36 [ayvens.es] INFO: Saving data for 1986943: {'created_time': 1774618416.417724, 'last_price_update_time': 1774618416.417736, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986943') HTTP/1.1" 204 0
2026-03-27 13:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0d3e1e48-30a1-59c6-9958-4f0c385b85b5 with identifier: 1986857
2026-03-27 13:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0d3e1e48-30a1-59c6-9958-4f0c385b85b5 with identifier: 1986857
2026-03-27 13:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0d3e1e48-30a1-59c6-9958-4f0c385b85b5 with identifier: 1986857 to the API
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/48c524b263574117bf6e6130fedbb3c6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0d3e1e48-30a1-59c6-9958-4f0c385b85b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41090',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 112880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d3e1e48-30a1-59c6-9958-4f0c385b85b5/0d3e1e48-30a1-59c6-9958-4f0c385b85b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/48c524b263574117bf6e6130fedbb3c6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 1.4 TSI eHybrid 180kW (245CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 1.4 TSI eHybrid 180kW (245CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986857%27 HTTP/1.1" 200 None
2026-03-27 13:33:36 [ayvens.es] INFO: Saving data for 1986857: {'created_time': 1774618416.732607, 'last_price_update_time': 1774618416.732618, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986857') HTTP/1.1" 204 0
2026-03-27 13:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/143/a3aa07c638c548fa80f592dd040fcb2f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/885/56f2cf4b8e4f41c48608a3039cdb49fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295783c50>
2026-03-27 13:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40/b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252F0b6a48b27b16453aaaeae7b495647ccd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/0b6a48b27b16453aaaeae7b495647ccd/images/large/1.jpg saved to cache
2026-03-27 13:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40
2026-03-27 13:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40, skipping ID generation
2026-03-27 13:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with scrape type 1
2026-03-27 13:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 sending to next pipeline
2026-03-27 13:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40, identifier: 1986945
2026-03-27 13:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/525/472d89c31bb24f67968b992cd4d5b566/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with identifier: 1986945
2026-03-27 13:33:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with identifier: 1986945
2026-03-27 13:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with identifier: 1986945 to the API
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/177/0b6a48b27b16453aaaeae7b495647ccd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'British green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 89132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40/b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/177/0b6a48b27b16453aaaeae7b495647ccd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986945%27 HTTP/1.1" 200 None
2026-03-27 13:33:37 [ayvens.es] INFO: Saving data for 1986945: {'created_time': 1774618417.24554, 'last_price_update_time': 1774618417.24555, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986945') HTTP/1.1" 204 0
2026-03-27 13:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/cd99b56d896040aea9183b07eb88de35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296401ed0>
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9e8777-f999-5aeb-b707-da654c85dc04/de9e8777-f999-5aeb-b707-da654c85dc04_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F143%252Fa3aa07c638c548fa80f592dd040fcb2f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/143/a3aa07c638c548fa80f592dd040fcb2f/images/large/1.jpg saved to cache
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de9e8777-f999-5aeb-b707-da654c85dc04
2026-03-27 13:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de9e8777-f999-5aeb-b707-da654c85dc04, skipping ID generation
2026-03-27 13:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9e8777-f999-5aeb-b707-da654c85dc04 with scrape type 1
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de9e8777-f999-5aeb-b707-da654c85dc04 sending to next pipeline
2026-03-27 13:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de9e8777-f999-5aeb-b707-da654c85dc04, identifier: 1986944
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961d8250>
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef84855c-a0e7-5547-a2b9-d5799e30c11a/ef84855c-a0e7-5547-a2b9-d5799e30c11a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F885%252F56f2cf4b8e4f41c48608a3039cdb49fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/885/56f2cf4b8e4f41c48608a3039cdb49fa/images/large/1.jpg saved to cache
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef84855c-a0e7-5547-a2b9-d5799e30c11a
2026-03-27 13:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef84855c-a0e7-5547-a2b9-d5799e30c11a, skipping ID generation
2026-03-27 13:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef84855c-a0e7-5547-a2b9-d5799e30c11a with scrape type 1
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef84855c-a0e7-5547-a2b9-d5799e30c11a sending to next pipeline
2026-03-27 13:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef84855c-a0e7-5547-a2b9-d5799e30c11a, identifier: 1986947
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632e590>
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5434c540-9d70-5196-8914-8fd8308d0bde/5434c540-9d70-5196-8914-8fd8308d0bde_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F525%252F472d89c31bb24f67968b992cd4d5b566%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/525/472d89c31bb24f67968b992cd4d5b566/images/large/1.jpg saved to cache
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5434c540-9d70-5196-8914-8fd8308d0bde
2026-03-27 13:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5434c540-9d70-5196-8914-8fd8308d0bde, skipping ID generation
2026-03-27 13:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5434c540-9d70-5196-8914-8fd8308d0bde with scrape type 1
2026-03-27 13:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5434c540-9d70-5196-8914-8fd8308d0bde sending to next pipeline
2026-03-27 13:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5434c540-9d70-5196-8914-8fd8308d0bde, identifier: 1986946
2026-03-27 13:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de9e8777-f999-5aeb-b707-da654c85dc04 with identifier: 1986944
2026-03-27 13:33:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de9e8777-f999-5aeb-b707-da654c85dc04 with identifier: 1986944
2026-03-27 13:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de9e8777-f999-5aeb-b707-da654c85dc04 with identifier: 1986944 to the API
2026-03-27 13:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/143/a3aa07c638c548fa80f592dd040fcb2f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris daytona',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de9e8777-f999-5aeb-b707-da654c85dc04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 121821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9e8777-f999-5aeb-b707-da654c85dc04/de9e8777-f999-5aeb-b707-da654c85dc04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/143/a3aa07c638c548fa80f592dd040fcb2f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sedan S line 35 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Sedan S line 35 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986944%27 HTTP/1.1" 200 None
2026-03-27 13:33:38 [ayvens.es] INFO: Saving data for 1986944: {'created_time': 1774618418.144657, 'last_price_update_time': 1774618418.144667, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986944') HTTP/1.1" 204 0
2026-03-27 13:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef84855c-a0e7-5547-a2b9-d5799e30c11a with identifier: 1986947
2026-03-27 13:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef84855c-a0e7-5547-a2b9-d5799e30c11a with identifier: 1986947
2026-03-27 13:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef84855c-a0e7-5547-a2b9-d5799e30c11a with identifier: 1986947 to the API
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/885/56f2cf4b8e4f41c48608a3039cdb49fa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ef84855c-a0e7-5547-a2b9-d5799e30c11a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 67434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef84855c-a0e7-5547-a2b9-d5799e30c11a/ef84855c-a0e7-5547-a2b9-d5799e30c11a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/885/56f2cf4b8e4f41c48608a3039cdb49fa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986947%27 HTTP/1.1" 200 None
2026-03-27 13:33:38 [ayvens.es] INFO: Saving data for 1986947: {'created_time': 1774618418.467148, 'last_price_update_time': 1774618418.46716, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986947') HTTP/1.1" 204 0
2026-03-27 13:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5434c540-9d70-5196-8914-8fd8308d0bde with identifier: 1986946
2026-03-27 13:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5434c540-9d70-5196-8914-8fd8308d0bde with identifier: 1986946
2026-03-27 13:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5434c540-9d70-5196-8914-8fd8308d0bde with identifier: 1986946 to the API
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/525/472d89c31bb24f67968b992cd4d5b566/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5434c540-9d70-5196-8914-8fd8308d0bde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 101245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5434c540-9d70-5196-8914-8fd8308d0bde/5434c540-9d70-5196-8914-8fd8308d0bde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/525/472d89c31bb24f67968b992cd4d5b566/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Ecomotive',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Ecomotive',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986946%27 HTTP/1.1" 200 None
2026-03-27 13:33:38 [ayvens.es] INFO: Saving data for 1986946: {'created_time': 1774618418.891066, 'last_price_update_time': 1774618418.89108, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986946') HTTP/1.1" 204 0
2026-03-27 13:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632ecd0>
2026-03-27 13:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55f1116-b4b3-51bc-9328-9eefbcd5f89b/b55f1116-b4b3-51bc-9328-9eefbcd5f89b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252Fcd99b56d896040aea9183b07eb88de35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/cd99b56d896040aea9183b07eb88de35/images/large/1.jpg saved to cache
2026-03-27 13:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b
2026-03-27 13:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b55f1116-b4b3-51bc-9328-9eefbcd5f89b, skipping ID generation
2026-03-27 13:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b with scrape type 1
2026-03-27 13:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b sending to next pipeline
2026-03-27 13:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b55f1116-b4b3-51bc-9328-9eefbcd5f89b, identifier: 1986948
2026-03-27 13:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b55f1116-b4b3-51bc-9328-9eefbcd5f89b with identifier: 1986948
2026-03-27 13:33:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b55f1116-b4b3-51bc-9328-9eefbcd5f89b with identifier: 1986948
2026-03-27 13:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b55f1116-b4b3-51bc-9328-9eefbcd5f89b with identifier: 1986948 to the API
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/735/cd99b56d896040aea9183b07eb88de35/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Portofino blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b55f1116-b4b3-51bc-9328-9eefbcd5f89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'F-PACE',
 'odometer': 84293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55f1116-b4b3-51bc-9328-9eefbcd5f89b/b55f1116-b4b3-51bc-9328-9eefbcd5f89b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/cd99b56d896040aea9183b07eb88de35/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR F-PACE 2.0L i4D AWD Automatico Prestige',
 'transmission': 'manual',
 'trim': '2.0L i4D AWD Automatico Prestige',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986948%27 HTTP/1.1" 200 None
2026-03-27 13:33:39 [ayvens.es] INFO: Saving data for 1986948: {'created_time': 1774618419.529848, 'last_price_update_time': 1774618419.529861, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986948') HTTP/1.1" 204 0
2026-03-27 13:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986949
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986949%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986949: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986949
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c334c5db-ea70-5b62-ad80-bc5ce8958610 with identifier: 1986949
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c334c5db-ea70-5b62-ad80-bc5ce8958610 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c334c5db-ea70-5b62-ad80-bc5ce8958610
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F114%252F62003500642f4c1ba1b66b2a8ae81ba7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/114/62003500642f4c1ba1b66b2a8ae81ba7/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986950
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986950%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986950: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986950
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b81031-96ca-5817-83ac-ab424cf91352 with identifier: 1986950
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b81031-96ca-5817-83ac-ab424cf91352 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6b81031-96ca-5817-83ac-ab424cf91352
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F842%252F8a1b701d498c4aeb9f198c25294f7f23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/842/8a1b701d498c4aeb9f198c25294f7f23/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986951
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986951%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986951: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986951
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fedc954-5ec6-5ee8-a402-6980aad4cf38 with identifier: 1986951
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fedc954-5ec6-5ee8-a402-6980aad4cf38 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9fedc954-5ec6-5ee8-a402-6980aad4cf38
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252Fc2381c93d9e24e839aab828016a931a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/c2381c93d9e24e839aab828016a931a7/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986952
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986952%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986952: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986952
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6355beca-0070-53b0-9807-1002e2a4b157 with identifier: 1986952
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6355beca-0070-53b0-9807-1002e2a4b157 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6355beca-0070-53b0-9807-1002e2a4b157
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F127%252F221dd430b70a42ce9fcaf9c027cb7e64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/127/221dd430b70a42ce9fcaf9c027cb7e64/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986953
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986953%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986953: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986953
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 415e744b-0e9c-5edd-b725-93d756b102d4 with identifier: 1986953
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 415e744b-0e9c-5edd-b725-93d756b102d4 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 415e744b-0e9c-5edd-b725-93d756b102d4
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F155%252F3ad34573fb3744d898f17cee4bb6402f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/155/3ad34573fb3744d898f17cee4bb6402f/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986954
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986954%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986954: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986954
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with identifier: 1986954
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F055%252F4fbdc9913ddf4b58878ace958b7dc5c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/055/4fbdc9913ddf4b58878ace958b7dc5c8/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986955
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986955%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986955: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986955
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7714f290-0a4e-5438-a710-7c2ff3369e41 with identifier: 1986955
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7714f290-0a4e-5438-a710-7c2ff3369e41 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7714f290-0a4e-5438-a710-7c2ff3369e41
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F949%252F5ad80d04101e473c901c6f74be0abacd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/949/5ad80d04101e473c901c6f74be0abacd/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986956
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986956%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986956: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986956
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with identifier: 1986956
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F151%252F8c9965bc1f9444f4a24ba14f2275bb0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/151/8c9965bc1f9444f4a24ba14f2275bb0c/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986957
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986957%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986957: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986957
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f947572-d00a-50b9-a9a6-39c9b92decd3 with identifier: 1986957
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f947572-d00a-50b9-a9a6-39c9b92decd3 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f947572-d00a-50b9-a9a6-39c9b92decd3
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F864%252Fbb727ef3bcb849529055fd98a0f5c6b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/864/bb727ef3bcb849529055fd98a0f5c6b6/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986958
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986958%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986958: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986958
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d784d8a-b276-565c-9cbc-5befd7786133 with identifier: 1986958
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d784d8a-b276-565c-9cbc-5befd7786133 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6d784d8a-b276-565c-9cbc-5befd7786133
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252Fbdfef6e6d9ff430ebf31a3a263a6e094%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/bdfef6e6d9ff430ebf31a3a263a6e094/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986959
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986959%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986959: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986959
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5b04997-eb4b-50e3-9937-d85ca51bba62 with identifier: 1986959
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5b04997-eb4b-50e3-9937-d85ca51bba62 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5b04997-eb4b-50e3-9937-d85ca51bba62
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F869%252F800ebfcdfb3f49d99e4c919964574111%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/869/800ebfcdfb3f49d99e4c919964574111/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/842/8a1b701d498c4aeb9f198c25294f7f23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986960
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986960%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986960: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986960
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with identifier: 1986960
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252F729554854753419ebd58842064b4c643%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/729554854753419ebd58842064b4c643/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986961
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986961%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986961: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986961
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d900bd12-c6a6-5e02-9db8-92152ca8b114 with identifier: 1986961
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d900bd12-c6a6-5e02-9db8-92152ca8b114 with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d900bd12-c6a6-5e02-9db8-92152ca8b114
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252F21963c6b778a423b835cea7a00abe0ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/21963c6b778a423b835cea7a00abe0ae/images/large/1.jpg not downloaded yet
2026-03-27 13:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/127/221dd430b70a42ce9fcaf9c027cb7e64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:40 [ayvens.es] INFO: Found listing with ID: 1986962
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986962%27 HTTP/1.1" 200 None
2026-03-27 13:33:40 [ayvens.es] INFO: Scrape type for 1986962: 1
2026-03-27 13:33:40 [ayvens.es] INFO: Extracting data for car ID: 1986962
2026-03-27 13:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c58486-77b1-5240-966e-45086c5f8f7a with identifier: 1986962
2026-03-27 13:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c58486-77b1-5240-966e-45086c5f8f7a with scrape type 1
2026-03-27 13:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23c58486-77b1-5240-966e-45086c5f8f7a
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252F260baefdeda240d996fb077bc1b4a395%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/260baefdeda240d996fb077bc1b4a395/images/large/1.jpg not downloaded yet
2026-03-27 13:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/955/c2381c93d9e24e839aab828016a931a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:41 [ayvens.es] INFO: Found listing with ID: 1986963
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986963%27 HTTP/1.1" 200 None
2026-03-27 13:33:41 [ayvens.es] INFO: Scrape type for 1986963: 1
2026-03-27 13:33:41 [ayvens.es] INFO: Extracting data for car ID: 1986963
2026-03-27 13:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e904d6e7-937a-58c6-8203-1a71224dca46 with identifier: 1986963
2026-03-27 13:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e904d6e7-937a-58c6-8203-1a71224dca46 with scrape type 1
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e904d6e7-937a-58c6-8203-1a71224dca46
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F083%252Fdf900535b51a423eac567b8db1a6ccf2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/083/df900535b51a423eac567b8db1a6ccf2/images/large/1.jpg not downloaded yet
2026-03-27 13:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/151/8c9965bc1f9444f4a24ba14f2275bb0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/949/5ad80d04101e473c901c6f74be0abacd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fbe850>
2026-03-27 13:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b81031-96ca-5817-83ac-ab424cf91352/d6b81031-96ca-5817-83ac-ab424cf91352_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F842%252F8a1b701d498c4aeb9f198c25294f7f23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/842/8a1b701d498c4aeb9f198c25294f7f23/images/large/1.jpg saved to cache
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6b81031-96ca-5817-83ac-ab424cf91352
2026-03-27 13:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6b81031-96ca-5817-83ac-ab424cf91352, skipping ID generation
2026-03-27 13:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b81031-96ca-5817-83ac-ab424cf91352 with scrape type 1
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6b81031-96ca-5817-83ac-ab424cf91352 sending to next pipeline
2026-03-27 13:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6b81031-96ca-5817-83ac-ab424cf91352, identifier: 1986950
2026-03-27 13:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/114/62003500642f4c1ba1b66b2a8ae81ba7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:41 [ayvens.es] INFO: Found listing with ID: 1986964
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986964%27 HTTP/1.1" 200 None
2026-03-27 13:33:41 [ayvens.es] INFO: Scrape type for 1986964: 1
2026-03-27 13:33:41 [ayvens.es] INFO: Extracting data for car ID: 1986964
2026-03-27 13:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d02f36ef-2334-5013-835e-47a9acb382df with identifier: 1986964
2026-03-27 13:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d02f36ef-2334-5013-835e-47a9acb382df with scrape type 1
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d02f36ef-2334-5013-835e-47a9acb382df
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F019%252F2d0a65df24a247c6b844b1c70e636b14%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/019/2d0a65df24a247c6b844b1c70e636b14/images/large/1.jpg not downloaded yet
2026-03-27 13:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6b81031-96ca-5817-83ac-ab424cf91352 with identifier: 1986950
2026-03-27 13:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6b81031-96ca-5817-83ac-ab424cf91352 with identifier: 1986950
2026-03-27 13:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6b81031-96ca-5817-83ac-ab424cf91352 with identifier: 1986950 to the API
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/842/8a1b701d498c4aeb9f198c25294f7f23/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd6b81031-96ca-5817-83ac-ab424cf91352',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 105343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b81031-96ca-5817-83ac-ab424cf91352/d6b81031-96ca-5817-83ac-ab424cf91352_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/842/8a1b701d498c4aeb9f198c25294f7f23/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Pro Standard 600kg BlueHDi 55kW',
 'transmission': 'manual',
 'trim': 'Pro Standard 600kg BlueHDi 55kW',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986950%27 HTTP/1.1" 200 None
2026-03-27 13:33:41 [ayvens.es] INFO: Saving data for 1986950: {'created_time': 1774618421.719724, 'last_price_update_time': 1774618421.719734, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986950') HTTP/1.1" 204 0
2026-03-27 13:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/155/3ad34573fb3744d898f17cee4bb6402f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:41 [ayvens.es] INFO: Found listing with ID: 1986965
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986965%27 HTTP/1.1" 200 None
2026-03-27 13:33:41 [ayvens.es] INFO: Scrape type for 1986965: 1
2026-03-27 13:33:41 [ayvens.es] INFO: Extracting data for car ID: 1986965
2026-03-27 13:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4ab5532-9b17-53dd-9241-9e4edb756b4e with identifier: 1986965
2026-03-27 13:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ab5532-9b17-53dd-9241-9e4edb756b4e with scrape type 1
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e4ab5532-9b17-53dd-9241-9e4edb756b4e
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F419%252F935c205a69e34d44ac6df19a9088a23e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/419/935c205a69e34d44ac6df19a9088a23e/images/large/1.jpg not downloaded yet
2026-03-27 13:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/864/bb727ef3bcb849529055fd98a0f5c6b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961a8bd0>
2026-03-27 13:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6355beca-0070-53b0-9807-1002e2a4b157/6355beca-0070-53b0-9807-1002e2a4b157_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F127%252F221dd430b70a42ce9fcaf9c027cb7e64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/127/221dd430b70a42ce9fcaf9c027cb7e64/images/large/1.jpg saved to cache
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6355beca-0070-53b0-9807-1002e2a4b157
2026-03-27 13:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6355beca-0070-53b0-9807-1002e2a4b157, skipping ID generation
2026-03-27 13:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6355beca-0070-53b0-9807-1002e2a4b157 with scrape type 1
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6355beca-0070-53b0-9807-1002e2a4b157 sending to next pipeline
2026-03-27 13:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6355beca-0070-53b0-9807-1002e2a4b157, identifier: 1986952
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f08c10>
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fedc954-5ec6-5ee8-a402-6980aad4cf38/9fedc954-5ec6-5ee8-a402-6980aad4cf38_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252Fc2381c93d9e24e839aab828016a931a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/c2381c93d9e24e839aab828016a931a7/images/large/1.jpg saved to cache
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fedc954-5ec6-5ee8-a402-6980aad4cf38
2026-03-27 13:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fedc954-5ec6-5ee8-a402-6980aad4cf38, skipping ID generation
2026-03-27 13:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fedc954-5ec6-5ee8-a402-6980aad4cf38 with scrape type 1
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fedc954-5ec6-5ee8-a402-6980aad4cf38 sending to next pipeline
2026-03-27 13:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9fedc954-5ec6-5ee8-a402-6980aad4cf38, identifier: 1986951
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632dd10>
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d/f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F151%252F8c9965bc1f9444f4a24ba14f2275bb0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/151/8c9965bc1f9444f4a24ba14f2275bb0c/images/large/1.jpg saved to cache
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d
2026-03-27 13:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d, skipping ID generation
2026-03-27 13:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with scrape type 1
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d sending to next pipeline
2026-03-27 13:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d, identifier: 1986956
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f2a710>
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7714f290-0a4e-5438-a710-7c2ff3369e41/7714f290-0a4e-5438-a710-7c2ff3369e41_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F949%252F5ad80d04101e473c901c6f74be0abacd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/949/5ad80d04101e473c901c6f74be0abacd/images/large/1.jpg saved to cache
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7714f290-0a4e-5438-a710-7c2ff3369e41
2026-03-27 13:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7714f290-0a4e-5438-a710-7c2ff3369e41, skipping ID generation
2026-03-27 13:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7714f290-0a4e-5438-a710-7c2ff3369e41 with scrape type 1
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7714f290-0a4e-5438-a710-7c2ff3369e41 sending to next pipeline
2026-03-27 13:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7714f290-0a4e-5438-a710-7c2ff3369e41, identifier: 1986955
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529619fc10>
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c334c5db-ea70-5b62-ad80-bc5ce8958610/c334c5db-ea70-5b62-ad80-bc5ce8958610_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F114%252F62003500642f4c1ba1b66b2a8ae81ba7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/114/62003500642f4c1ba1b66b2a8ae81ba7/images/large/1.jpg saved to cache
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c334c5db-ea70-5b62-ad80-bc5ce8958610
2026-03-27 13:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c334c5db-ea70-5b62-ad80-bc5ce8958610, skipping ID generation
2026-03-27 13:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c334c5db-ea70-5b62-ad80-bc5ce8958610 with scrape type 1
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c334c5db-ea70-5b62-ad80-bc5ce8958610 sending to next pipeline
2026-03-27 13:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c334c5db-ea70-5b62-ad80-bc5ce8958610, identifier: 1986949
2026-03-27 13:33:42 [ayvens.es] INFO: Found listing with ID: 1986966
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986966%27 HTTP/1.1" 200 None
2026-03-27 13:33:42 [ayvens.es] INFO: Scrape type for 1986966: 1
2026-03-27 13:33:42 [ayvens.es] INFO: Extracting data for car ID: 1986966
2026-03-27 13:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2863834-f302-57f6-a347-9b58ca215334 with identifier: 1986966
2026-03-27 13:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2863834-f302-57f6-a347-9b58ca215334 with scrape type 1
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2863834-f302-57f6-a347-9b58ca215334
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F961%252F0ba64463a41b4055a6650056c85a0e40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/961/0ba64463a41b4055a6650056c85a0e40/images/large/1.jpg not downloaded yet
2026-03-27 13:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6355beca-0070-53b0-9807-1002e2a4b157 with identifier: 1986952
2026-03-27 13:33:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6355beca-0070-53b0-9807-1002e2a4b157 with identifier: 1986952
2026-03-27 13:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6355beca-0070-53b0-9807-1002e2a4b157 with identifier: 1986952 to the API
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/127/221dd430b70a42ce9fcaf9c027cb7e64/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6355beca-0070-53b0-9807-1002e2a4b157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 133654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6355beca-0070-53b0-9807-1002e2a4b157/6355beca-0070-53b0-9807-1002e2a4b157_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/127/221dd430b70a42ce9fcaf9c027cb7e64/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Style BlueHDi 130 S&S',
 'transmission': 'manual',
 'trim': 'SW Style BlueHDi 130 S&S',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986952%27 HTTP/1.1" 200 None
2026-03-27 13:33:43 [ayvens.es] INFO: Saving data for 1986952: {'created_time': 1774618423.25068, 'last_price_update_time': 1774618423.250689, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986952') HTTP/1.1" 204 0
2026-03-27 13:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9fedc954-5ec6-5ee8-a402-6980aad4cf38 with identifier: 1986951
2026-03-27 13:33:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9fedc954-5ec6-5ee8-a402-6980aad4cf38 with identifier: 1986951
2026-03-27 13:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9fedc954-5ec6-5ee8-a402-6980aad4cf38 with identifier: 1986951 to the API
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/955/c2381c93d9e24e839aab828016a931a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9fedc954-5ec6-5ee8-a402-6980aad4cf38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 93519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fedc954-5ec6-5ee8-a402-6980aad4cf38/9fedc954-5ec6-5ee8-a402-6980aad4cf38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/955/c2381c93d9e24e839aab828016a931a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 300 L2 Trend+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 300 L2 Trend+++Revisar peritacion+++',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986951%27 HTTP/1.1" 200 None
2026-03-27 13:33:43 [ayvens.es] INFO: Saving data for 1986951: {'created_time': 1774618423.56713, 'last_price_update_time': 1774618423.56714, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986951') HTTP/1.1" 204 0
2026-03-27 13:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with identifier: 1986956
2026-03-27 13:33:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with identifier: 1986956
2026-03-27 13:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with identifier: 1986956 to the API
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/151/8c9965bc1f9444f4a24ba14f2275bb0c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'color': 'Fuji white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 61822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d/f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/151/8c9965bc1f9444f4a24ba14f2275bb0c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 P250 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 P250 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986956%27 HTTP/1.1" 200 None
2026-03-27 13:33:43 [ayvens.es] INFO: Saving data for 1986956: {'created_time': 1774618423.890793, 'last_price_update_time': 1774618423.890803, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986956') HTTP/1.1" 204 0
2026-03-27 13:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7714f290-0a4e-5438-a710-7c2ff3369e41 with identifier: 1986955
2026-03-27 13:33:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7714f290-0a4e-5438-a710-7c2ff3369e41 with identifier: 1986955
2026-03-27 13:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7714f290-0a4e-5438-a710-7c2ff3369e41 with identifier: 1986955 to the API
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/949/5ad80d04101e473c901c6f74be0abacd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7714f290-0a4e-5438-a710-7c2ff3369e41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 171671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7714f290-0a4e-5438-a710-7c2ff3369e41/7714f290-0a4e-5438-a710-7c2ff3369e41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/949/5ad80d04101e473c901c6f74be0abacd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 70kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 70kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986955%27 HTTP/1.1" 200 None
2026-03-27 13:33:44 [ayvens.es] INFO: Saving data for 1986955: {'created_time': 1774618424.237226, 'last_price_update_time': 1774618424.237237, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986955') HTTP/1.1" 204 0
2026-03-27 13:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c334c5db-ea70-5b62-ad80-bc5ce8958610 with identifier: 1986949
2026-03-27 13:33:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c334c5db-ea70-5b62-ad80-bc5ce8958610 with identifier: 1986949
2026-03-27 13:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c334c5db-ea70-5b62-ad80-bc5ce8958610 with identifier: 1986949 to the API
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/114/62003500642f4c1ba1b66b2a8ae81ba7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c334c5db-ea70-5b62-ad80-bc5ce8958610',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 228920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c334c5db-ea70-5b62-ad80-bc5ce8958610/c334c5db-ea70-5b62-ad80-bc5ce8958610_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/114/62003500642f4c1ba1b66b2a8ae81ba7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 335 L2H2 HDi 130+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '335 L2H2 HDi 130+++Revisar peritacion+++',
 'vin': None,
 'year': 2017}
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986949%27 HTTP/1.1" 200 None
2026-03-27 13:33:44 [ayvens.es] INFO: Saving data for 1986949: {'created_time': 1774618424.554438, 'last_price_update_time': 1774618424.554449, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986949') HTTP/1.1" 204 0
2026-03-27 13:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/061/bdfef6e6d9ff430ebf31a3a263a6e094/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/869/800ebfcdfb3f49d99e4c919964574111/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/128/729554854753419ebd58842064b4c643/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:44 [ayvens.es] INFO: Found listing with ID: 1986967
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986967%27 HTTP/1.1" 200 None
2026-03-27 13:33:44 [ayvens.es] INFO: Scrape type for 1986967: 1
2026-03-27 13:33:44 [ayvens.es] INFO: Extracting data for car ID: 1986967
2026-03-27 13:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ba2aa8-e914-503e-9cf5-87d59b974493 with identifier: 1986967
2026-03-27 13:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ba2aa8-e914-503e-9cf5-87d59b974493 with scrape type 1
2026-03-27 13:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 97ba2aa8-e914-503e-9cf5-87d59b974493
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252F30dab9322aa34eccb5785417247e6478%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/30dab9322aa34eccb5785417247e6478/images/large/1.jpg not downloaded yet
2026-03-27 13:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c1fd0>
2026-03-27 13:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415e744b-0e9c-5edd-b725-93d756b102d4/415e744b-0e9c-5edd-b725-93d756b102d4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F155%252F3ad34573fb3744d898f17cee4bb6402f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/155/3ad34573fb3744d898f17cee4bb6402f/images/large/1.jpg saved to cache
2026-03-27 13:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 415e744b-0e9c-5edd-b725-93d756b102d4
2026-03-27 13:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 415e744b-0e9c-5edd-b725-93d756b102d4, skipping ID generation
2026-03-27 13:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 415e744b-0e9c-5edd-b725-93d756b102d4 with scrape type 1
2026-03-27 13:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 415e744b-0e9c-5edd-b725-93d756b102d4 sending to next pipeline
2026-03-27 13:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 415e744b-0e9c-5edd-b725-93d756b102d4, identifier: 1986953
2026-03-27 13:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295707d90>
2026-03-27 13:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f947572-d00a-50b9-a9a6-39c9b92decd3/1f947572-d00a-50b9-a9a6-39c9b92decd3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F864%252Fbb727ef3bcb849529055fd98a0f5c6b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/864/bb727ef3bcb849529055fd98a0f5c6b6/images/large/1.jpg saved to cache
2026-03-27 13:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f947572-d00a-50b9-a9a6-39c9b92decd3
2026-03-27 13:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f947572-d00a-50b9-a9a6-39c9b92decd3, skipping ID generation
2026-03-27 13:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f947572-d00a-50b9-a9a6-39c9b92decd3 with scrape type 1
2026-03-27 13:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f947572-d00a-50b9-a9a6-39c9b92decd3 sending to next pipeline
2026-03-27 13:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f947572-d00a-50b9-a9a6-39c9b92decd3, identifier: 1986957
2026-03-27 13:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/620/21963c6b778a423b835cea7a00abe0ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 415e744b-0e9c-5edd-b725-93d756b102d4 with identifier: 1986953
2026-03-27 13:33:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 415e744b-0e9c-5edd-b725-93d756b102d4 with identifier: 1986953
2026-03-27 13:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 415e744b-0e9c-5edd-b725-93d756b102d4 with identifier: 1986953 to the API
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/155/3ad34573fb3744d898f17cee4bb6402f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '415e744b-0e9c-5edd-b725-93d756b102d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 117416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415e744b-0e9c-5edd-b725-93d756b102d4/415e744b-0e9c-5edd-b725-93d756b102d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/155/3ad34573fb3744d898f17cee4bb6402f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO Cargo L 650kg Diesel 1.5 100HP S&S MT E6',
 'transmission': 'manual',
 'trim': 'Cargo L 650kg Diesel 1.5 100HP S&S MT E6',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986953%27 HTTP/1.1" 200 None
2026-03-27 13:33:45 [ayvens.es] INFO: Saving data for 1986953: {'created_time': 1774618425.394093, 'last_price_update_time': 1774618425.394103, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986953') HTTP/1.1" 204 0
2026-03-27 13:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f947572-d00a-50b9-a9a6-39c9b92decd3 with identifier: 1986957
2026-03-27 13:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f947572-d00a-50b9-a9a6-39c9b92decd3 with identifier: 1986957
2026-03-27 13:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f947572-d00a-50b9-a9a6-39c9b92decd3 with identifier: 1986957 to the API
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/864/bb727ef3bcb849529055fd98a0f5c6b6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '1f947572-d00a-50b9-a9a6-39c9b92decd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 237914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f947572-d00a-50b9-a9a6-39c9b92decd3/1f947572-d00a-50b9-a9a6-39c9b92decd3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/864/bb727ef3bcb849529055fd98a0f5c6b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 dCi 88kW (120CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 dCi 88kW (120CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986957%27 HTTP/1.1" 200 None
2026-03-27 13:33:45 [ayvens.es] INFO: Saving data for 1986957: {'created_time': 1774618425.699037, 'last_price_update_time': 1774618425.699047, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986957') HTTP/1.1" 204 0
2026-03-27 13:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/055/4fbdc9913ddf4b58878ace958b7dc5c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:45 [ayvens.es] INFO: Found listing with ID: 1986968
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986968%27 HTTP/1.1" 200 None
2026-03-27 13:33:45 [ayvens.es] INFO: Scrape type for 1986968: 1
2026-03-27 13:33:45 [ayvens.es] INFO: Extracting data for car ID: 1986968
2026-03-27 13:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a6301b-8b68-59d3-9a82-1bd263538278 with identifier: 1986968
2026-03-27 13:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a6301b-8b68-59d3-9a82-1bd263538278 with scrape type 1
2026-03-27 13:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99a6301b-8b68-59d3-9a82-1bd263538278
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252Fe713eff8df6a44ba840fe8102a2551a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/e713eff8df6a44ba840fe8102a2551a2/images/large/1.jpg not downloaded yet
2026-03-27 13:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/026/260baefdeda240d996fb077bc1b4a395/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295e51990>
2026-03-27 13:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d784d8a-b276-565c-9cbc-5befd7786133/6d784d8a-b276-565c-9cbc-5befd7786133_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252Fbdfef6e6d9ff430ebf31a3a263a6e094%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/bdfef6e6d9ff430ebf31a3a263a6e094/images/large/1.jpg saved to cache
2026-03-27 13:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d784d8a-b276-565c-9cbc-5befd7786133
2026-03-27 13:33:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d784d8a-b276-565c-9cbc-5befd7786133, skipping ID generation
2026-03-27 13:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d784d8a-b276-565c-9cbc-5befd7786133 with scrape type 1
2026-03-27 13:33:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d784d8a-b276-565c-9cbc-5befd7786133 sending to next pipeline
2026-03-27 13:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6d784d8a-b276-565c-9cbc-5befd7786133, identifier: 1986958
2026-03-27 13:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961e8750>
2026-03-27 13:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5b04997-eb4b-50e3-9937-d85ca51bba62/d5b04997-eb4b-50e3-9937-d85ca51bba62_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F869%252F800ebfcdfb3f49d99e4c919964574111%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/869/800ebfcdfb3f49d99e4c919964574111/images/large/1.jpg saved to cache
2026-03-27 13:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5b04997-eb4b-50e3-9937-d85ca51bba62
2026-03-27 13:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5b04997-eb4b-50e3-9937-d85ca51bba62, skipping ID generation
2026-03-27 13:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5b04997-eb4b-50e3-9937-d85ca51bba62 with scrape type 1
2026-03-27 13:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5b04997-eb4b-50e3-9937-d85ca51bba62 sending to next pipeline
2026-03-27 13:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d5b04997-eb4b-50e3-9937-d85ca51bba62, identifier: 1986959
2026-03-27 13:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bf9350>
2026-03-27 13:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cb5c72f-a699-5c32-a8be-63cbb0ad8774/7cb5c72f-a699-5c32-a8be-63cbb0ad8774_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252F729554854753419ebd58842064b4c643%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/729554854753419ebd58842064b4c643/images/large/1.jpg saved to cache
2026-03-27 13:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774
2026-03-27 13:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774, skipping ID generation
2026-03-27 13:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with scrape type 1
2026-03-27 13:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 sending to next pipeline
2026-03-27 13:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774, identifier: 1986960
2026-03-27 13:33:46 [ayvens.es] INFO: Found listing with ID: 1986969
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986969%27 HTTP/1.1" 200 None
2026-03-27 13:33:46 [ayvens.es] INFO: Scrape type for 1986969: 1
2026-03-27 13:33:46 [ayvens.es] INFO: Extracting data for car ID: 1986969
2026-03-27 13:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with identifier: 1986969
2026-03-27 13:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with scrape type 1
2026-03-27 13:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F453%252Fffd3c0ddcf184c58ae596285b932251f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/453/ffd3c0ddcf184c58ae596285b932251f/images/large/1.jpg not downloaded yet
2026-03-27 13:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6d784d8a-b276-565c-9cbc-5befd7786133 with identifier: 1986958
2026-03-27 13:33:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6d784d8a-b276-565c-9cbc-5befd7786133 with identifier: 1986958
2026-03-27 13:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6d784d8a-b276-565c-9cbc-5befd7786133 with identifier: 1986958 to the API
2026-03-27 13:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/061/bdfef6e6d9ff430ebf31a3a263a6e094/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6d784d8a-b276-565c-9cbc-5befd7786133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 124799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d784d8a-b276-565c-9cbc-5befd7786133/6d784d8a-b276-565c-9cbc-5befd7786133_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/061/bdfef6e6d9ff430ebf31a3a263a6e094/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986958%27 HTTP/1.1" 200 None
2026-03-27 13:33:47 [ayvens.es] INFO: Saving data for 1986958: {'created_time': 1774618427.294967, 'last_price_update_time': 1774618427.294977, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986958') HTTP/1.1" 204 0
2026-03-27 13:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d5b04997-eb4b-50e3-9937-d85ca51bba62 with identifier: 1986959
2026-03-27 13:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d5b04997-eb4b-50e3-9937-d85ca51bba62 with identifier: 1986959
2026-03-27 13:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d5b04997-eb4b-50e3-9937-d85ca51bba62 with identifier: 1986959 to the API
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/869/800ebfcdfb3f49d99e4c919964574111/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd5b04997-eb4b-50e3-9937-d85ca51bba62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 124451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5b04997-eb4b-50e3-9937-d85ca51bba62/d5b04997-eb4b-50e3-9937-d85ca51bba62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/869/800ebfcdfb3f49d99e4c919964574111/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986959%27 HTTP/1.1" 200 None
2026-03-27 13:33:47 [ayvens.es] INFO: Saving data for 1986959: {'created_time': 1774618427.605363, 'last_price_update_time': 1774618427.605373, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986959') HTTP/1.1" 204 0
2026-03-27 13:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with identifier: 1986960
2026-03-27 13:33:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with identifier: 1986960
2026-03-27 13:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with identifier: 1986960 to the API
2026-03-27 13:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/128/729554854753419ebd58842064b4c643/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Glaciersilber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7cb5c72f-a699-5c32-a8be-63cbb0ad8774',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 111505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cb5c72f-a699-5c32-a8be-63cbb0ad8774/7cb5c72f-a699-5c32-a8be-63cbb0ad8774_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/128/729554854753419ebd58842064b4c643/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986960%27 HTTP/1.1" 200 None
2026-03-27 13:33:48 [ayvens.es] INFO: Saving data for 1986960: {'created_time': 1774618428.840221, 'last_price_update_time': 1774618428.840234, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986960') HTTP/1.1" 204 0
2026-03-27 13:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/083/df900535b51a423eac567b8db1a6ccf2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295eb1b10>
2026-03-27 13:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d900bd12-c6a6-5e02-9db8-92152ca8b114/d900bd12-c6a6-5e02-9db8-92152ca8b114_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252F21963c6b778a423b835cea7a00abe0ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/21963c6b778a423b835cea7a00abe0ae/images/large/1.jpg saved to cache
2026-03-27 13:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d900bd12-c6a6-5e02-9db8-92152ca8b114
2026-03-27 13:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d900bd12-c6a6-5e02-9db8-92152ca8b114, skipping ID generation
2026-03-27 13:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d900bd12-c6a6-5e02-9db8-92152ca8b114 with scrape type 1
2026-03-27 13:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d900bd12-c6a6-5e02-9db8-92152ca8b114 sending to next pipeline
2026-03-27 13:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d900bd12-c6a6-5e02-9db8-92152ca8b114, identifier: 1986961
2026-03-27 13:33:49 [ayvens.es] INFO: Found listing with ID: 1986970
2026-03-27 13:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986970%27 HTTP/1.1" 200 None
2026-03-27 13:33:49 [ayvens.es] INFO: Scrape type for 1986970: 1
2026-03-27 13:33:49 [ayvens.es] INFO: Extracting data for car ID: 1986970
2026-03-27 13:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with identifier: 1986970
2026-03-27 13:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with scrape type 1
2026-03-27 13:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136
2026-03-27 13:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F433%252F452ff41ab4fd445db7ddf294340ed0c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/433/452ff41ab4fd445db7ddf294340ed0c7/images/large/1.jpg not downloaded yet
2026-03-27 13:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d900bd12-c6a6-5e02-9db8-92152ca8b114 with identifier: 1986961
2026-03-27 13:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d900bd12-c6a6-5e02-9db8-92152ca8b114 with identifier: 1986961
2026-03-27 13:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d900bd12-c6a6-5e02-9db8-92152ca8b114 with identifier: 1986961 to the API
2026-03-27 13:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/620/21963c6b778a423b835cea7a00abe0ae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd900bd12-c6a6-5e02-9db8-92152ca8b114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 46813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d900bd12-c6a6-5e02-9db8-92152ca8b114/d900bd12-c6a6-5e02-9db8-92152ca8b114_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/620/21963c6b778a423b835cea7a00abe0ae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Authentic Energy Blue dCi 81 kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Authentic Energy Blue dCi 81 kW (110CV)',
 'vin': None,
 'year': 2024}
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986961%27 HTTP/1.1" 200 None
2026-03-27 13:33:50 [ayvens.es] INFO: Saving data for 1986961: {'created_time': 1774618430.2936, 'last_price_update_time': 1774618430.293611, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986961') HTTP/1.1" 204 0
2026-03-27 13:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/019/2d0a65df24a247c6b844b1c70e636b14/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/419/935c205a69e34d44ac6df19a9088a23e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4cc50>
2026-03-27 13:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1/4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F055%252F4fbdc9913ddf4b58878ace958b7dc5c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/055/4fbdc9913ddf4b58878ace958b7dc5c8/images/large/1.jpg saved to cache
2026-03-27 13:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1
2026-03-27 13:33:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1, skipping ID generation
2026-03-27 13:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with scrape type 1
2026-03-27 13:33:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 sending to next pipeline
2026-03-27 13:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1, identifier: 1986954
2026-03-27 13:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960cf0d0>
2026-03-27 13:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c58486-77b1-5240-966e-45086c5f8f7a/23c58486-77b1-5240-966e-45086c5f8f7a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252F260baefdeda240d996fb077bc1b4a395%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/260baefdeda240d996fb077bc1b4a395/images/large/1.jpg saved to cache
2026-03-27 13:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23c58486-77b1-5240-966e-45086c5f8f7a
2026-03-27 13:33:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23c58486-77b1-5240-966e-45086c5f8f7a, skipping ID generation
2026-03-27 13:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c58486-77b1-5240-966e-45086c5f8f7a with scrape type 1
2026-03-27 13:33:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23c58486-77b1-5240-966e-45086c5f8f7a sending to next pipeline
2026-03-27 13:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23c58486-77b1-5240-966e-45086c5f8f7a, identifier: 1986962
2026-03-27 13:33:50 [ayvens.es] INFO: Found listing with ID: 1986971
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986971%27 HTTP/1.1" 200 None
2026-03-27 13:33:50 [ayvens.es] INFO: Scrape type for 1986971: 1
2026-03-27 13:33:50 [ayvens.es] INFO: Extracting data for car ID: 1986971
2026-03-27 13:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327a1ae7-6b70-5007-9cb8-8d43972fd96b with identifier: 1986971
2026-03-27 13:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b with scrape type 1
2026-03-27 13:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F470%252Fbec82e0b1cbd4ce198de851968c56d73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/470/bec82e0b1cbd4ce198de851968c56d73/images/large/1.jpg not downloaded yet
2026-03-27 13:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with identifier: 1986954
2026-03-27 13:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with identifier: 1986954
2026-03-27 13:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with identifier: 1986954 to the API
2026-03-27 13:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/055/4fbdc9913ddf4b58878ace958b7dc5c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KADJAR',
 'odometer': 101173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1/4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/055/4fbdc9913ddf4b58878ace958b7dc5c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KADJAR Intens Blue dCi 85kW (115CV) - 18',
 'transmission': 'manual',
 'trim': 'Intens Blue dCi 85kW (115CV) - 18',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986954%27 HTTP/1.1" 200 None
2026-03-27 13:33:51 [ayvens.es] INFO: Saving data for 1986954: {'created_time': 1774618431.109276, 'last_price_update_time': 1774618431.109286, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986954') HTTP/1.1" 204 0
2026-03-27 13:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23c58486-77b1-5240-966e-45086c5f8f7a with identifier: 1986962
2026-03-27 13:33:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23c58486-77b1-5240-966e-45086c5f8f7a with identifier: 1986962
2026-03-27 13:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 23c58486-77b1-5240-966e-45086c5f8f7a with identifier: 1986962 to the API
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/026/260baefdeda240d996fb077bc1b4a395/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Eiger grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '23c58486-77b1-5240-966e-45086c5f8f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR',
 'odometer': 126875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23c58486-77b1-5240-966e-45086c5f8f7a/23c58486-77b1-5240-966e-45086c5f8f7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/026/260baefdeda240d996fb077bc1b4a395/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER VELAR (O) 2.0 D180 132kW R-Dynamic S 4WD '
          'Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 D180 132kW R-Dynamic S 4WD Auto',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986962%27 HTTP/1.1" 200 None
2026-03-27 13:33:51 [ayvens.es] INFO: Saving data for 1986962: {'created_time': 1774618431.453419, 'last_price_update_time': 1774618431.45343, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986962') HTTP/1.1" 204 0
2026-03-27 13:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/961/0ba64463a41b4055a6650056c85a0e40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529611c610>
2026-03-27 13:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e904d6e7-937a-58c6-8203-1a71224dca46/e904d6e7-937a-58c6-8203-1a71224dca46_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F083%252Fdf900535b51a423eac567b8db1a6ccf2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/083/df900535b51a423eac567b8db1a6ccf2/images/large/1.jpg saved to cache
2026-03-27 13:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e904d6e7-937a-58c6-8203-1a71224dca46
2026-03-27 13:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e904d6e7-937a-58c6-8203-1a71224dca46, skipping ID generation
2026-03-27 13:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e904d6e7-937a-58c6-8203-1a71224dca46 with scrape type 1
2026-03-27 13:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e904d6e7-937a-58c6-8203-1a71224dca46 sending to next pipeline
2026-03-27 13:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e904d6e7-937a-58c6-8203-1a71224dca46, identifier: 1986963
2026-03-27 13:33:51 [ayvens.es] INFO: Found listing with ID: 1986972
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986972%27 HTTP/1.1" 200 None
2026-03-27 13:33:51 [ayvens.es] INFO: Scrape type for 1986972: 1
2026-03-27 13:33:51 [ayvens.es] INFO: Extracting data for car ID: 1986972
2026-03-27 13:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with identifier: 1986972
2026-03-27 13:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with scrape type 1
2026-03-27 13:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F168%252F5a222416ae9a4f409baa461502fcdb93%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/168/5a222416ae9a4f409baa461502fcdb93/images/large/1.jpg not downloaded yet
2026-03-27 13:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e904d6e7-937a-58c6-8203-1a71224dca46 with identifier: 1986963
2026-03-27 13:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e904d6e7-937a-58c6-8203-1a71224dca46 with identifier: 1986963
2026-03-27 13:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e904d6e7-937a-58c6-8203-1a71224dca46 with identifier: 1986963 to the API
2026-03-27 13:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/083/df900535b51a423eac567b8db1a6ccf2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e904d6e7-937a-58c6-8203-1a71224dca46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 69615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e904d6e7-937a-58c6-8203-1a71224dca46/e904d6e7-937a-58c6-8203-1a71224dca46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/083/df900535b51a423eac567b8db1a6ccf2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel Pack',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986963%27 HTTP/1.1" 200 None
2026-03-27 13:33:52 [ayvens.es] INFO: Saving data for 1986963: {'created_time': 1774618432.824881, 'last_price_update_time': 1774618432.824894, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986963') HTTP/1.1" 204 0
2026-03-27 13:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f32610>
2026-03-27 13:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d02f36ef-2334-5013-835e-47a9acb382df/d02f36ef-2334-5013-835e-47a9acb382df_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F019%252F2d0a65df24a247c6b844b1c70e636b14%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/019/2d0a65df24a247c6b844b1c70e636b14/images/large/1.jpg saved to cache
2026-03-27 13:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d02f36ef-2334-5013-835e-47a9acb382df
2026-03-27 13:33:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d02f36ef-2334-5013-835e-47a9acb382df, skipping ID generation
2026-03-27 13:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d02f36ef-2334-5013-835e-47a9acb382df with scrape type 1
2026-03-27 13:33:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d02f36ef-2334-5013-835e-47a9acb382df sending to next pipeline
2026-03-27 13:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d02f36ef-2334-5013-835e-47a9acb382df, identifier: 1986964
2026-03-27 13:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fbfbd0>
2026-03-27 13:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4ab5532-9b17-53dd-9241-9e4edb756b4e/e4ab5532-9b17-53dd-9241-9e4edb756b4e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F419%252F935c205a69e34d44ac6df19a9088a23e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/419/935c205a69e34d44ac6df19a9088a23e/images/large/1.jpg saved to cache
2026-03-27 13:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4ab5532-9b17-53dd-9241-9e4edb756b4e
2026-03-27 13:33:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4ab5532-9b17-53dd-9241-9e4edb756b4e, skipping ID generation
2026-03-27 13:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ab5532-9b17-53dd-9241-9e4edb756b4e with scrape type 1
2026-03-27 13:33:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4ab5532-9b17-53dd-9241-9e4edb756b4e sending to next pipeline
2026-03-27 13:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e4ab5532-9b17-53dd-9241-9e4edb756b4e, identifier: 1986965
2026-03-27 13:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/626/e713eff8df6a44ba840fe8102a2551a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:53 [ayvens.es] INFO: Found listing with ID: 1986973
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986973%27 HTTP/1.1" 200 None
2026-03-27 13:33:53 [ayvens.es] INFO: Scrape type for 1986973: 1
2026-03-27 13:33:53 [ayvens.es] INFO: Extracting data for car ID: 1986973
2026-03-27 13:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e946aae-9411-5b17-b27d-4fab7de430d5 with identifier: 1986973
2026-03-27 13:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e946aae-9411-5b17-b27d-4fab7de430d5 with scrape type 1
2026-03-27 13:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e946aae-9411-5b17-b27d-4fab7de430d5
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252Fa998e955b5784c8b87fb2012d8ccb9ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/a998e955b5784c8b87fb2012d8ccb9ad/images/large/1.jpg not downloaded yet
2026-03-27 13:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d02f36ef-2334-5013-835e-47a9acb382df with identifier: 1986964
2026-03-27 13:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d02f36ef-2334-5013-835e-47a9acb382df with identifier: 1986964
2026-03-27 13:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d02f36ef-2334-5013-835e-47a9acb382df with identifier: 1986964 to the API
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/019/2d0a65df24a247c6b844b1c70e636b14/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd02f36ef-2334-5013-835e-47a9acb382df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 153011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d02f36ef-2334-5013-835e-47a9acb382df/d02f36ef-2334-5013-835e-47a9acb382df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/019/2d0a65df24a247c6b844b1c70e636b14/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986964%27 HTTP/1.1" 200 None
2026-03-27 13:33:53 [ayvens.es] INFO: Saving data for 1986964: {'created_time': 1774618433.577178, 'last_price_update_time': 1774618433.577189, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986964') HTTP/1.1" 204 0
2026-03-27 13:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e4ab5532-9b17-53dd-9241-9e4edb756b4e with identifier: 1986965
2026-03-27 13:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e4ab5532-9b17-53dd-9241-9e4edb756b4e with identifier: 1986965
2026-03-27 13:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e4ab5532-9b17-53dd-9241-9e4edb756b4e with identifier: 1986965 to the API
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/419/935c205a69e34d44ac6df19a9088a23e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e4ab5532-9b17-53dd-9241-9e4edb756b4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 112751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ab5532-9b17-53dd-9241-9e4edb756b4e/e4ab5532-9b17-53dd-9241-9e4edb756b4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/419/935c205a69e34d44ac6df19a9088a23e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986965%27 HTTP/1.1" 200 None
2026-03-27 13:33:53 [ayvens.es] INFO: Saving data for 1986965: {'created_time': 1774618433.901517, 'last_price_update_time': 1774618433.901528, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986965') HTTP/1.1" 204 0
2026-03-27 13:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ed4850>
2026-03-27 13:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2863834-f302-57f6-a347-9b58ca215334/f2863834-f302-57f6-a347-9b58ca215334_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F961%252F0ba64463a41b4055a6650056c85a0e40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/961/0ba64463a41b4055a6650056c85a0e40/images/large/1.jpg saved to cache
2026-03-27 13:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2863834-f302-57f6-a347-9b58ca215334
2026-03-27 13:33:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2863834-f302-57f6-a347-9b58ca215334, skipping ID generation
2026-03-27 13:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2863834-f302-57f6-a347-9b58ca215334 with scrape type 1
2026-03-27 13:33:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2863834-f302-57f6-a347-9b58ca215334 sending to next pipeline
2026-03-27 13:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2863834-f302-57f6-a347-9b58ca215334, identifier: 1986966
2026-03-27 13:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/379/30dab9322aa34eccb5785417247e6478/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:54 [ayvens.es] INFO: Found listing with ID: 1986974
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986974%27 HTTP/1.1" 200 None
2026-03-27 13:33:54 [ayvens.es] INFO: Scrape type for 1986974: 1
2026-03-27 13:33:54 [ayvens.es] INFO: Extracting data for car ID: 1986974
2026-03-27 13:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with identifier: 1986974
2026-03-27 13:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with scrape type 1
2026-03-27 13:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F483%252Fb06c40cd21504206b8375b875f41465a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/483/b06c40cd21504206b8375b875f41465a/images/large/1.jpg not downloaded yet
2026-03-27 13:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2863834-f302-57f6-a347-9b58ca215334 with identifier: 1986966
2026-03-27 13:33:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2863834-f302-57f6-a347-9b58ca215334 with identifier: 1986966
2026-03-27 13:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2863834-f302-57f6-a347-9b58ca215334 with identifier: 1986966 to the API
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/961/0ba64463a41b4055a6650056c85a0e40/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f2863834-f302-57f6-a347-9b58ca215334',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 137413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2863834-f302-57f6-a347-9b58ca215334/f2863834-f302-57f6-a347-9b58ca215334_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/961/0ba64463a41b4055a6650056c85a0e40/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sportback Advanced 35 TDI 110kW S tronic',
 'transmission': 'manual',
 'trim': 'Sportback Advanced 35 TDI 110kW S tronic',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986966%27 HTTP/1.1" 200 None
2026-03-27 13:33:54 [ayvens.es] INFO: Saving data for 1986966: {'created_time': 1774618434.507183, 'last_price_update_time': 1774618434.507193, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986966') HTTP/1.1" 204 0
2026-03-27 13:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bded10>
2026-03-27 13:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a6301b-8b68-59d3-9a82-1bd263538278/99a6301b-8b68-59d3-9a82-1bd263538278_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252Fe713eff8df6a44ba840fe8102a2551a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/e713eff8df6a44ba840fe8102a2551a2/images/large/1.jpg saved to cache
2026-03-27 13:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99a6301b-8b68-59d3-9a82-1bd263538278
2026-03-27 13:33:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99a6301b-8b68-59d3-9a82-1bd263538278, skipping ID generation
2026-03-27 13:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a6301b-8b68-59d3-9a82-1bd263538278 with scrape type 1
2026-03-27 13:33:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99a6301b-8b68-59d3-9a82-1bd263538278 sending to next pipeline
2026-03-27 13:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99a6301b-8b68-59d3-9a82-1bd263538278, identifier: 1986968
2026-03-27 13:33:54 [ayvens.es] INFO: Found listing with ID: 1986975
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986975%27 HTTP/1.1" 200 None
2026-03-27 13:33:54 [ayvens.es] INFO: Scrape type for 1986975: 1
2026-03-27 13:33:54 [ayvens.es] INFO: Extracting data for car ID: 1986975
2026-03-27 13:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb23c4b7-5629-5a60-9b11-d41c124ad75f with identifier: 1986975
2026-03-27 13:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb23c4b7-5629-5a60-9b11-d41c124ad75f with scrape type 1
2026-03-27 13:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb23c4b7-5629-5a60-9b11-d41c124ad75f
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F727%252F91c1e65ee5c24279a5e2fc2348fda01a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/727/91c1e65ee5c24279a5e2fc2348fda01a/images/large/1.jpg not downloaded yet
2026-03-27 13:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99a6301b-8b68-59d3-9a82-1bd263538278 with identifier: 1986968
2026-03-27 13:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99a6301b-8b68-59d3-9a82-1bd263538278 with identifier: 1986968
2026-03-27 13:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99a6301b-8b68-59d3-9a82-1bd263538278 with identifier: 1986968 to the API
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/626/e713eff8df6a44ba840fe8102a2551a2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '99a6301b-8b68-59d3-9a82-1bd263538278',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 104970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a6301b-8b68-59d3-9a82-1bd263538278/99a6301b-8b68-59d3-9a82-1bd263538278_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/626/e713eff8df6a44ba840fe8102a2551a2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986968%27 HTTP/1.1" 200 None
2026-03-27 13:33:55 [ayvens.es] INFO: Saving data for 1986968: {'created_time': 1774618435.025341, 'last_price_update_time': 1774618435.025351, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986968') HTTP/1.1" 204 0
2026-03-27 13:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/433/452ff41ab4fd445db7ddf294340ed0c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/453/ffd3c0ddcf184c58ae596285b932251f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5298640790>
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ba2aa8-e914-503e-9cf5-87d59b974493/97ba2aa8-e914-503e-9cf5-87d59b974493_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252F30dab9322aa34eccb5785417247e6478%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/30dab9322aa34eccb5785417247e6478/images/large/1.jpg saved to cache
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97ba2aa8-e914-503e-9cf5-87d59b974493
2026-03-27 13:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97ba2aa8-e914-503e-9cf5-87d59b974493, skipping ID generation
2026-03-27 13:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ba2aa8-e914-503e-9cf5-87d59b974493 with scrape type 1
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97ba2aa8-e914-503e-9cf5-87d59b974493 sending to next pipeline
2026-03-27 13:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 97ba2aa8-e914-503e-9cf5-87d59b974493, identifier: 1986967
2026-03-27 13:33:55 [ayvens.es] INFO: Found listing with ID: 1986976
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986976%27 HTTP/1.1" 200 None
2026-03-27 13:33:55 [ayvens.es] INFO: Scrape type for 1986976: 1
2026-03-27 13:33:55 [ayvens.es] INFO: Extracting data for car ID: 1986976
2026-03-27 13:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 769ca24f-2b81-535c-937a-67f7006e3da8 with identifier: 1986976
2026-03-27 13:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769ca24f-2b81-535c-937a-67f7006e3da8 with scrape type 1
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 769ca24f-2b81-535c-937a-67f7006e3da8
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F920%252Fc2877ca3e8c646c191956d2893cbc220%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/920/c2877ca3e8c646c191956d2893cbc220/images/large/1.jpg not downloaded yet
2026-03-27 13:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 97ba2aa8-e914-503e-9cf5-87d59b974493 with identifier: 1986967
2026-03-27 13:33:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 97ba2aa8-e914-503e-9cf5-87d59b974493 with identifier: 1986967
2026-03-27 13:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 97ba2aa8-e914-503e-9cf5-87d59b974493 with identifier: 1986967 to the API
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/379/30dab9322aa34eccb5785417247e6478/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '97ba2aa8-e914-503e-9cf5-87d59b974493',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 95344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ba2aa8-e914-503e-9cf5-87d59b974493/97ba2aa8-e914-503e-9cf5-87d59b974493_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/379/30dab9322aa34eccb5785417247e6478/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986967%27 HTTP/1.1" 200 None
2026-03-27 13:33:55 [ayvens.es] INFO: Saving data for 1986967: {'created_time': 1774618435.624, 'last_price_update_time': 1774618435.624014, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986967') HTTP/1.1" 204 0
2026-03-27 13:33:55 [ayvens.es] INFO: Found listing with ID: 1986977
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986977%27 HTTP/1.1" 200 None
2026-03-27 13:33:55 [ayvens.es] INFO: Scrape type for 1986977: 1
2026-03-27 13:33:55 [ayvens.es] INFO: Extracting data for car ID: 1986977
2026-03-27 13:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16542c5d-ac2e-5ca9-96ba-145d588ac344 with identifier: 1986977
2026-03-27 13:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16542c5d-ac2e-5ca9-96ba-145d588ac344 with scrape type 1
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 16542c5d-ac2e-5ca9-96ba-145d588ac344
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F614%252F6584d524800d4d9dbd87b500d6927fae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/614/6584d524800d4d9dbd87b500d6927fae/images/large/1.jpg not downloaded yet
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c32890>
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f56b42-fe74-5f4e-b84e-d882e3f2d136/95f56b42-fe74-5f4e-b84e-d882e3f2d136_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F433%252F452ff41ab4fd445db7ddf294340ed0c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/433/452ff41ab4fd445db7ddf294340ed0c7/images/large/1.jpg saved to cache
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136
2026-03-27 13:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95f56b42-fe74-5f4e-b84e-d882e3f2d136, skipping ID generation
2026-03-27 13:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with scrape type 1
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95f56b42-fe74-5f4e-b84e-d882e3f2d136 sending to next pipeline
2026-03-27 13:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 95f56b42-fe74-5f4e-b84e-d882e3f2d136, identifier: 1986970
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529672d610>
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c2b2d9-d18d-5aa5-9f28-df5302f2ed19/44c2b2d9-d18d-5aa5-9f28-df5302f2ed19_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F453%252Fffd3c0ddcf184c58ae596285b932251f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/453/ffd3c0ddcf184c58ae596285b932251f/images/large/1.jpg saved to cache
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19
2026-03-27 13:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19, skipping ID generation
2026-03-27 13:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with scrape type 1
2026-03-27 13:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 sending to next pipeline
2026-03-27 13:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19, identifier: 1986969
2026-03-27 13:33:56 [ayvens.es] INFO: Found listing with ID: 1986978
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986978%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [ayvens.es] INFO: Scrape type for 1986978: 1
2026-03-27 13:33:56 [ayvens.es] INFO: Extracting data for car ID: 1986978
2026-03-27 13:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bde61271-b140-5e8f-85ea-3f085f54261f with identifier: 1986978
2026-03-27 13:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bde61271-b140-5e8f-85ea-3f085f54261f with scrape type 1
2026-03-27 13:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bde61271-b140-5e8f-85ea-3f085f54261f
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F334%252F0d3f85db95e74ff99b3efd6757ef8ffa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/334/0d3f85db95e74ff99b3efd6757ef8ffa/images/large/1.jpg not downloaded yet
2026-03-27 13:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with identifier: 1986970
2026-03-27 13:33:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with identifier: 1986970
2026-03-27 13:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 95f56b42-fe74-5f4e-b84e-d882e3f2d136 with identifier: 1986970 to the API
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/433/452ff41ab4fd445db7ddf294340ed0c7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco blanquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '95f56b42-fe74-5f4e-b84e-d882e3f2d136',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 159666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f56b42-fe74-5f4e-b84e-d882e3f2d136/95f56b42-fe74-5f4e-b84e-d882e3f2d136_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/433/452ff41ab4fd445db7ddf294340ed0c7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE PureTech 60kW (82CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE PureTech 60kW (82CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986970%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [ayvens.es] INFO: Saving data for 1986970: {'created_time': 1774618436.447572, 'last_price_update_time': 1774618436.447589, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986970') HTTP/1.1" 204 0
2026-03-27 13:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with identifier: 1986969
2026-03-27 13:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with identifier: 1986969
2026-03-27 13:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with identifier: 1986969 to the API
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/453/ffd3c0ddcf184c58ae596285b932251f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '44c2b2d9-d18d-5aa5-9f28-df5302f2ed19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 90901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c2b2d9-d18d-5aa5-9f28-df5302f2ed19/44c2b2d9-d18d-5aa5-9f28-df5302f2ed19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/453/ffd3c0ddcf184c58ae596285b932251f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Allure Pack PureTech 130 S&S',
 'transmission': 'manual',
 'trim': 'SW Allure Pack PureTech 130 S&S',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986969%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [ayvens.es] INFO: Saving data for 1986969: {'created_time': 1774618436.771768, 'last_price_update_time': 1774618436.771779, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986969') HTTP/1.1" 204 0
2026-03-27 13:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/470/bec82e0b1cbd4ce198de851968c56d73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/168/5a222416ae9a4f409baa461502fcdb93/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/993/a998e955b5784c8b87fb2012d8ccb9ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:56 [ayvens.es] INFO: Found listing with ID: 1986979
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986979%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [ayvens.es] INFO: Scrape type for 1986979: 1
2026-03-27 13:33:56 [ayvens.es] INFO: Extracting data for car ID: 1986979
2026-03-27 13:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca41c121-4d1e-513a-86c9-db6a4b762f2c with identifier: 1986979
2026-03-27 13:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca41c121-4d1e-513a-86c9-db6a4b762f2c with scrape type 1
2026-03-27 13:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca41c121-4d1e-513a-86c9-db6a4b762f2c
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F524%252Fb3f41bd4d72a41a2b89ae2f08dc48787%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/524/b3f41bd4d72a41a2b89ae2f08dc48787/images/large/1.jpg not downloaded yet
2026-03-27 13:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/483/b06c40cd21504206b8375b875f41465a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:56 [ayvens.es] INFO: Found listing with ID: 1986980
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986980%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [ayvens.es] INFO: Scrape type for 1986980: 1
2026-03-27 13:33:56 [ayvens.es] INFO: Extracting data for car ID: 1986980
2026-03-27 13:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23325fdd-30e6-5408-a008-65adbf9050cd with identifier: 1986980
2026-03-27 13:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23325fdd-30e6-5408-a008-65adbf9050cd with scrape type 1
2026-03-27 13:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23325fdd-30e6-5408-a008-65adbf9050cd
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F761%252Fd3f190383ff24d95916f95a433952b33%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/761/d3f190383ff24d95916f95a433952b33/images/large/1.jpg not downloaded yet
2026-03-27 13:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/727/91c1e65ee5c24279a5e2fc2348fda01a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:56 [ayvens.es] INFO: Found listing with ID: 1986981
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986981%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [ayvens.es] INFO: Scrape type for 1986981: 1
2026-03-27 13:33:56 [ayvens.es] INFO: Extracting data for car ID: 1986981
2026-03-27 13:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49363511-9375-541b-bbfe-f73abbd2b6fb with identifier: 1986981
2026-03-27 13:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49363511-9375-541b-bbfe-f73abbd2b6fb with scrape type 1
2026-03-27 13:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49363511-9375-541b-bbfe-f73abbd2b6fb
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F461%252F30d846a134a741d5b4d005088c27eabf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/461/30d846a134a741d5b4d005088c27eabf/images/large/1.jpg not downloaded yet
2026-03-27 13:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/920/c2877ca3e8c646c191956d2893cbc220/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c94d0>
2026-03-27 13:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327a1ae7-6b70-5007-9cb8-8d43972fd96b/327a1ae7-6b70-5007-9cb8-8d43972fd96b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F470%252Fbec82e0b1cbd4ce198de851968c56d73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/470/bec82e0b1cbd4ce198de851968c56d73/images/large/1.jpg saved to cache
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b
2026-03-27 13:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 327a1ae7-6b70-5007-9cb8-8d43972fd96b, skipping ID generation
2026-03-27 13:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b with scrape type 1
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 327a1ae7-6b70-5007-9cb8-8d43972fd96b sending to next pipeline
2026-03-27 13:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 327a1ae7-6b70-5007-9cb8-8d43972fd96b, identifier: 1986971
2026-03-27 13:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f326d0>
2026-03-27 13:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef/b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F168%252F5a222416ae9a4f409baa461502fcdb93%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/168/5a222416ae9a4f409baa461502fcdb93/images/large/1.jpg saved to cache
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef
2026-03-27 13:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef, skipping ID generation
2026-03-27 13:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with scrape type 1
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef sending to next pipeline
2026-03-27 13:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef, identifier: 1986972
2026-03-27 13:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fbc8d0>
2026-03-27 13:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e946aae-9411-5b17-b27d-4fab7de430d5/2e946aae-9411-5b17-b27d-4fab7de430d5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252Fa998e955b5784c8b87fb2012d8ccb9ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/a998e955b5784c8b87fb2012d8ccb9ad/images/large/1.jpg saved to cache
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e946aae-9411-5b17-b27d-4fab7de430d5
2026-03-27 13:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e946aae-9411-5b17-b27d-4fab7de430d5, skipping ID generation
2026-03-27 13:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e946aae-9411-5b17-b27d-4fab7de430d5 with scrape type 1
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e946aae-9411-5b17-b27d-4fab7de430d5 sending to next pipeline
2026-03-27 13:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2e946aae-9411-5b17-b27d-4fab7de430d5, identifier: 1986973
2026-03-27 13:33:57 [ayvens.es] INFO: Found listing with ID: 1986982
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986982%27 HTTP/1.1" 200 None
2026-03-27 13:33:57 [ayvens.es] INFO: Scrape type for 1986982: 1
2026-03-27 13:33:57 [ayvens.es] INFO: Extracting data for car ID: 1986982
2026-03-27 13:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd536fbb-7861-5d0c-a51a-40e6b3b1174e with identifier: 1986982
2026-03-27 13:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd536fbb-7861-5d0c-a51a-40e6b3b1174e with scrape type 1
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dd536fbb-7861-5d0c-a51a-40e6b3b1174e
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F083%252F5a60116bf3924d388ed775750f5f1ecf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/083/5a60116bf3924d388ed775750f5f1ecf/images/large/1.jpg not downloaded yet
2026-03-27 13:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 327a1ae7-6b70-5007-9cb8-8d43972fd96b with identifier: 1986971
2026-03-27 13:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 327a1ae7-6b70-5007-9cb8-8d43972fd96b with identifier: 1986971
2026-03-27 13:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 327a1ae7-6b70-5007-9cb8-8d43972fd96b with identifier: 1986971 to the API
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/470/bec82e0b1cbd4ce198de851968c56d73/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '327a1ae7-6b70-5007-9cb8-8d43972fd96b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 50429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327a1ae7-6b70-5007-9cb8-8d43972fd96b/327a1ae7-6b70-5007-9cb8-8d43972fd96b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/470/bec82e0b1cbd4ce198de851968c56d73/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986971%27 HTTP/1.1" 200 None
2026-03-27 13:33:57 [ayvens.es] INFO: Saving data for 1986971: {'created_time': 1774618437.792026, 'last_price_update_time': 1774618437.792037, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986971') HTTP/1.1" 204 0
2026-03-27 13:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with identifier: 1986972
2026-03-27 13:33:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with identifier: 1986972
2026-03-27 13:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef with identifier: 1986972 to the API
2026-03-27 13:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/168/5a222416ae9a4f409baa461502fcdb93/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura blanco glaci',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 165578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef/b0fa3f5e-2ea5-5adc-b7f9-8b68b57543ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/168/5a222416ae9a4f409baa461502fcdb93/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986972%27 HTTP/1.1" 200 None
2026-03-27 13:33:58 [ayvens.es] INFO: Saving data for 1986972: {'created_time': 1774618438.136908, 'last_price_update_time': 1774618438.136922, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986972') HTTP/1.1" 204 0
2026-03-27 13:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2e946aae-9411-5b17-b27d-4fab7de430d5 with identifier: 1986973
2026-03-27 13:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2e946aae-9411-5b17-b27d-4fab7de430d5 with identifier: 1986973
2026-03-27 13:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2e946aae-9411-5b17-b27d-4fab7de430d5 with identifier: 1986973 to the API
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/993/a998e955b5784c8b87fb2012d8ccb9ad/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2e946aae-9411-5b17-b27d-4fab7de430d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 150135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e946aae-9411-5b17-b27d-4fab7de430d5/2e946aae-9411-5b17-b27d-4fab7de430d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/993/a998e955b5784c8b87fb2012d8ccb9ad/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2021}
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986973%27 HTTP/1.1" 200 None
2026-03-27 13:33:58 [ayvens.es] INFO: Saving data for 1986973: {'created_time': 1774618438.463777, 'last_price_update_time': 1774618438.463789, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986973') HTTP/1.1" 204 0
2026-03-27 13:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4e550>
2026-03-27 13:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f98d349f-d3e2-52c8-bd64-2a0d9cf67c62/f98d349f-d3e2-52c8-bd64-2a0d9cf67c62_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F483%252Fb06c40cd21504206b8375b875f41465a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/483/b06c40cd21504206b8375b875f41465a/images/large/1.jpg saved to cache
2026-03-27 13:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62
2026-03-27 13:33:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62, skipping ID generation
2026-03-27 13:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with scrape type 1
2026-03-27 13:33:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 sending to next pipeline
2026-03-27 13:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62, identifier: 1986974
2026-03-27 13:33:58 [ayvens.es] INFO: Found listing with ID: 1986983
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986983%27 HTTP/1.1" 200 None
2026-03-27 13:33:58 [ayvens.es] INFO: Scrape type for 1986983: 1
2026-03-27 13:33:58 [ayvens.es] INFO: Extracting data for car ID: 1986983
2026-03-27 13:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b3af89-8a24-5ec3-9758-d27e01658563 with identifier: 1986983
2026-03-27 13:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b3af89-8a24-5ec3-9758-d27e01658563 with scrape type 1
2026-03-27 13:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f1b3af89-8a24-5ec3-9758-d27e01658563
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F536%252F3066cf65a1ca4d2190922584e205fdb0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/536/3066cf65a1ca4d2190922584e205fdb0/images/large/1.jpg not downloaded yet
2026-03-27 13:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with identifier: 1986974
2026-03-27 13:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with identifier: 1986974
2026-03-27 13:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with identifier: 1986974 to the API
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/483/b06c40cd21504206b8375b875f41465a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f98d349f-d3e2-52c8-bd64-2a0d9cf67c62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 60093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f98d349f-d3e2-52c8-bd64-2a0d9cf67c62/f98d349f-d3e2-52c8-bd64-2a0d9cf67c62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/483/b06c40cd21504206b8375b875f41465a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.7 CRDi VGT 85kW Business 4x2 Eco-Dynam',
 'transmission': 'manual',
 'trim': '1.7 CRDi VGT 85kW Business 4x2 Eco-Dynam',
 'vin': None,
 'year': 2018}
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986974%27 HTTP/1.1" 200 None
2026-03-27 13:33:59 [ayvens.es] INFO: Saving data for 1986974: {'created_time': 1774618439.022674, 'last_price_update_time': 1774618439.022686, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986974') HTTP/1.1" 204 0
2026-03-27 13:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bf8fd0>
2026-03-27 13:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb23c4b7-5629-5a60-9b11-d41c124ad75f/bb23c4b7-5629-5a60-9b11-d41c124ad75f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F727%252F91c1e65ee5c24279a5e2fc2348fda01a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/727/91c1e65ee5c24279a5e2fc2348fda01a/images/large/1.jpg saved to cache
2026-03-27 13:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb23c4b7-5629-5a60-9b11-d41c124ad75f
2026-03-27 13:33:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb23c4b7-5629-5a60-9b11-d41c124ad75f, skipping ID generation
2026-03-27 13:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb23c4b7-5629-5a60-9b11-d41c124ad75f with scrape type 1
2026-03-27 13:33:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb23c4b7-5629-5a60-9b11-d41c124ad75f sending to next pipeline
2026-03-27 13:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bb23c4b7-5629-5a60-9b11-d41c124ad75f, identifier: 1986975
2026-03-27 13:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956fbb10>
2026-03-27 13:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_769ca24f-2b81-535c-937a-67f7006e3da8/769ca24f-2b81-535c-937a-67f7006e3da8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F920%252Fc2877ca3e8c646c191956d2893cbc220%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/920/c2877ca3e8c646c191956d2893cbc220/images/large/1.jpg saved to cache
2026-03-27 13:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 769ca24f-2b81-535c-937a-67f7006e3da8
2026-03-27 13:33:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 769ca24f-2b81-535c-937a-67f7006e3da8, skipping ID generation
2026-03-27 13:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769ca24f-2b81-535c-937a-67f7006e3da8 with scrape type 1
2026-03-27 13:33:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 769ca24f-2b81-535c-937a-67f7006e3da8 sending to next pipeline
2026-03-27 13:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 769ca24f-2b81-535c-937a-67f7006e3da8, identifier: 1986976
2026-03-27 13:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/614/6584d524800d4d9dbd87b500d6927fae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:33:59 [ayvens.es] INFO: Found listing with ID: 1986984
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986984%27 HTTP/1.1" 200 None
2026-03-27 13:33:59 [ayvens.es] INFO: Scrape type for 1986984: 1
2026-03-27 13:33:59 [ayvens.es] INFO: Extracting data for car ID: 1986984
2026-03-27 13:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b729148-6ae5-5ca5-8184-df672ed565ef with identifier: 1986984
2026-03-27 13:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b729148-6ae5-5ca5-8184-df672ed565ef with scrape type 1
2026-03-27 13:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1b729148-6ae5-5ca5-8184-df672ed565ef
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252Fd876df0ae9564583b99fa967aa058a28%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/d876df0ae9564583b99fa967aa058a28/images/large/1.jpg not downloaded yet
2026-03-27 13:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bb23c4b7-5629-5a60-9b11-d41c124ad75f with identifier: 1986975
2026-03-27 13:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bb23c4b7-5629-5a60-9b11-d41c124ad75f with identifier: 1986975
2026-03-27 13:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bb23c4b7-5629-5a60-9b11-d41c124ad75f with identifier: 1986975 to the API
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/727/91c1e65ee5c24279a5e2fc2348fda01a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bb23c4b7-5629-5a60-9b11-d41c124ad75f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 217625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb23c4b7-5629-5a60-9b11-d41c124ad75f/bb23c4b7-5629-5a60-9b11-d41c124ad75f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/727/91c1e65ee5c24279a5e2fc2348fda01a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986975%27 HTTP/1.1" 200 None
2026-03-27 13:33:59 [ayvens.es] INFO: Saving data for 1986975: {'created_time': 1774618439.77389, 'last_price_update_time': 1774618439.773899, 'auction_closing_time': 1774868400.0}
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986975') HTTP/1.1" 204 0
2026-03-27 13:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 769ca24f-2b81-535c-937a-67f7006e3da8 with identifier: 1986976
2026-03-27 13:33:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 769ca24f-2b81-535c-937a-67f7006e3da8 with identifier: 1986976
2026-03-27 13:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 769ca24f-2b81-535c-937a-67f7006e3da8 with identifier: 1986976 to the API
2026-03-27 13:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/920/c2877ca3e8c646c191956d2893cbc220/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado icebe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '769ca24f-2b81-535c-937a-67f7006e3da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 214155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769ca24f-2b81-535c-937a-67f7006e3da8/769ca24f-2b81-535c-937a-67f7006e3da8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/920/c2877ca3e8c646c191956d2893cbc220/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986976%27 HTTP/1.1" 200 None
2026-03-27 13:34:00 [ayvens.es] INFO: Saving data for 1986976: {'created_time': 1774618440.220582, 'last_price_update_time': 1774618440.220595, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986976') HTTP/1.1" 204 0
2026-03-27 13:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/334/0d3f85db95e74ff99b3efd6757ef8ffa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/524/b3f41bd4d72a41a2b89ae2f08dc48787/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:00 [ayvens.es] INFO: Found listing with ID: 1986985
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986985%27 HTTP/1.1" 200 None
2026-03-27 13:34:00 [ayvens.es] INFO: Scrape type for 1986985: 1
2026-03-27 13:34:00 [ayvens.es] INFO: Extracting data for car ID: 1986985
2026-03-27 13:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e25a3f-da8a-5d4a-ad40-2bb112da046e with identifier: 1986985
2026-03-27 13:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e25a3f-da8a-5d4a-ad40-2bb112da046e with scrape type 1
2026-03-27 13:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45e25a3f-da8a-5d4a-ad40-2bb112da046e
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252Fe278fa29579942369f8325df704fa9d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/e278fa29579942369f8325df704fa9d6/images/large/1.jpg not downloaded yet
2026-03-27 13:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295e50990>
2026-03-27 13:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16542c5d-ac2e-5ca9-96ba-145d588ac344/16542c5d-ac2e-5ca9-96ba-145d588ac344_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F614%252F6584d524800d4d9dbd87b500d6927fae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/614/6584d524800d4d9dbd87b500d6927fae/images/large/1.jpg saved to cache
2026-03-27 13:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16542c5d-ac2e-5ca9-96ba-145d588ac344
2026-03-27 13:34:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16542c5d-ac2e-5ca9-96ba-145d588ac344, skipping ID generation
2026-03-27 13:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16542c5d-ac2e-5ca9-96ba-145d588ac344 with scrape type 1
2026-03-27 13:34:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16542c5d-ac2e-5ca9-96ba-145d588ac344 sending to next pipeline
2026-03-27 13:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 16542c5d-ac2e-5ca9-96ba-145d588ac344, identifier: 1986977
2026-03-27 13:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/761/d3f190383ff24d95916f95a433952b33/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:00 [ayvens.es] INFO: Found listing with ID: 1986986
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986986%27 HTTP/1.1" 200 None
2026-03-27 13:34:00 [ayvens.es] INFO: Scrape type for 1986986: 1
2026-03-27 13:34:00 [ayvens.es] INFO: Extracting data for car ID: 1986986
2026-03-27 13:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc268829-0ca4-5ddb-9bc2-14feb117d860 with identifier: 1986986
2026-03-27 13:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc268829-0ca4-5ddb-9bc2-14feb117d860 with scrape type 1
2026-03-27 13:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc268829-0ca4-5ddb-9bc2-14feb117d860
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252F168efa3e38d2498b8c1aa035555be589%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/168efa3e38d2498b8c1aa035555be589/images/large/1.jpg not downloaded yet
2026-03-27 13:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 16542c5d-ac2e-5ca9-96ba-145d588ac344 with identifier: 1986977
2026-03-27 13:34:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 16542c5d-ac2e-5ca9-96ba-145d588ac344 with identifier: 1986977
2026-03-27 13:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 16542c5d-ac2e-5ca9-96ba-145d588ac344 with identifier: 1986977 to the API
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/614/6584d524800d4d9dbd87b500d6927fae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '16542c5d-ac2e-5ca9-96ba-145d588ac344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 61499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16542c5d-ac2e-5ca9-96ba-145d588ac344/16542c5d-ac2e-5ca9-96ba-145d588ac344_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/614/6584d524800d4d9dbd87b500d6927fae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 Hybrid Feel',
 'transmission': 'manual',
 'trim': '1.5 Hybrid Feel',
 'vin': None,
 'year': 2018}
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986977%27 HTTP/1.1" 200 None
2026-03-27 13:34:00 [ayvens.es] INFO: Saving data for 1986977: {'created_time': 1774618440.951043, 'last_price_update_time': 1774618440.951057, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986977') HTTP/1.1" 204 0
2026-03-27 13:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/461/30d846a134a741d5b4d005088c27eabf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:01 [ayvens.es] INFO: Found listing with ID: 1986987
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986987%27 HTTP/1.1" 200 None
2026-03-27 13:34:01 [ayvens.es] INFO: Scrape type for 1986987: 1
2026-03-27 13:34:01 [ayvens.es] INFO: Extracting data for car ID: 1986987
2026-03-27 13:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe7441f1-fd9e-5415-990c-35fa8a47060b with identifier: 1986987
2026-03-27 13:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe7441f1-fd9e-5415-990c-35fa8a47060b with scrape type 1
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fe7441f1-fd9e-5415-990c-35fa8a47060b
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F711%252F1c4298cc92e94ed8aa78baf8377cfaae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/711/1c4298cc92e94ed8aa78baf8377cfaae/images/large/1.jpg not downloaded yet
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b3d10>
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bde61271-b140-5e8f-85ea-3f085f54261f/bde61271-b140-5e8f-85ea-3f085f54261f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F334%252F0d3f85db95e74ff99b3efd6757ef8ffa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/334/0d3f85db95e74ff99b3efd6757ef8ffa/images/large/1.jpg saved to cache
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bde61271-b140-5e8f-85ea-3f085f54261f
2026-03-27 13:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bde61271-b140-5e8f-85ea-3f085f54261f, skipping ID generation
2026-03-27 13:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bde61271-b140-5e8f-85ea-3f085f54261f with scrape type 1
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bde61271-b140-5e8f-85ea-3f085f54261f sending to next pipeline
2026-03-27 13:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bde61271-b140-5e8f-85ea-3f085f54261f, identifier: 1986978
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529570ef50>
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca41c121-4d1e-513a-86c9-db6a4b762f2c/ca41c121-4d1e-513a-86c9-db6a4b762f2c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F524%252Fb3f41bd4d72a41a2b89ae2f08dc48787%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/524/b3f41bd4d72a41a2b89ae2f08dc48787/images/large/1.jpg saved to cache
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca41c121-4d1e-513a-86c9-db6a4b762f2c
2026-03-27 13:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca41c121-4d1e-513a-86c9-db6a4b762f2c, skipping ID generation
2026-03-27 13:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca41c121-4d1e-513a-86c9-db6a4b762f2c with scrape type 1
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca41c121-4d1e-513a-86c9-db6a4b762f2c sending to next pipeline
2026-03-27 13:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca41c121-4d1e-513a-86c9-db6a4b762f2c, identifier: 1986979
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fbe210>
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23325fdd-30e6-5408-a008-65adbf9050cd/23325fdd-30e6-5408-a008-65adbf9050cd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F761%252Fd3f190383ff24d95916f95a433952b33%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/761/d3f190383ff24d95916f95a433952b33/images/large/1.jpg saved to cache
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23325fdd-30e6-5408-a008-65adbf9050cd
2026-03-27 13:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23325fdd-30e6-5408-a008-65adbf9050cd, skipping ID generation
2026-03-27 13:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23325fdd-30e6-5408-a008-65adbf9050cd with scrape type 1
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23325fdd-30e6-5408-a008-65adbf9050cd sending to next pipeline
2026-03-27 13:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23325fdd-30e6-5408-a008-65adbf9050cd, identifier: 1986980
2026-03-27 13:34:01 [ayvens.es] INFO: Found listing with ID: 1986988
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986988%27 HTTP/1.1" 200 None
2026-03-27 13:34:01 [ayvens.es] INFO: Scrape type for 1986988: 1
2026-03-27 13:34:01 [ayvens.es] INFO: Extracting data for car ID: 1986988
2026-03-27 13:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 982a3443-f3c1-5767-a8dc-ee4ab569a029 with identifier: 1986988
2026-03-27 13:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982a3443-f3c1-5767-a8dc-ee4ab569a029 with scrape type 1
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 982a3443-f3c1-5767-a8dc-ee4ab569a029
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F076%252Fd6d9c5b45bd44c69ad18779cffdafb16%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/076/d6d9c5b45bd44c69ad18779cffdafb16/images/large/1.jpg not downloaded yet
2026-03-27 13:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bde61271-b140-5e8f-85ea-3f085f54261f with identifier: 1986978
2026-03-27 13:34:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bde61271-b140-5e8f-85ea-3f085f54261f with identifier: 1986978
2026-03-27 13:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bde61271-b140-5e8f-85ea-3f085f54261f with identifier: 1986978 to the API
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/334/0d3f85db95e74ff99b3efd6757ef8ffa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bde61271-b140-5e8f-85ea-3f085f54261f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 76801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde61271-b140-5e8f-85ea-3f085f54261f/bde61271-b140-5e8f-85ea-3f085f54261f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/334/0d3f85db95e74ff99b3efd6757ef8ffa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986978%27 HTTP/1.1" 200 None
2026-03-27 13:34:02 [ayvens.es] INFO: Saving data for 1986978: {'created_time': 1774618442.338214, 'last_price_update_time': 1774618442.338224, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986978') HTTP/1.1" 204 0
2026-03-27 13:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca41c121-4d1e-513a-86c9-db6a4b762f2c with identifier: 1986979
2026-03-27 13:34:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca41c121-4d1e-513a-86c9-db6a4b762f2c with identifier: 1986979
2026-03-27 13:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca41c121-4d1e-513a-86c9-db6a4b762f2c with identifier: 1986979 to the API
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/524/b3f41bd4d72a41a2b89ae2f08dc48787/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ca41c121-4d1e-513a-86c9-db6a4b762f2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 77146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca41c121-4d1e-513a-86c9-db6a4b762f2c/ca41c121-4d1e-513a-86c9-db6a4b762f2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/524/b3f41bd4d72a41a2b89ae2f08dc48787/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Active',
 'transmission': 'manual',
 'trim': '1.8 125H Active',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986979%27 HTTP/1.1" 200 None
2026-03-27 13:34:03 [ayvens.es] INFO: Saving data for 1986979: {'created_time': 1774618443.491811, 'last_price_update_time': 1774618443.491823, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986979') HTTP/1.1" 204 0
2026-03-27 13:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23325fdd-30e6-5408-a008-65adbf9050cd with identifier: 1986980
2026-03-27 13:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23325fdd-30e6-5408-a008-65adbf9050cd with identifier: 1986980
2026-03-27 13:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 23325fdd-30e6-5408-a008-65adbf9050cd with identifier: 1986980 to the API
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/761/d3f190383ff24d95916f95a433952b33/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '23325fdd-30e6-5408-a008-65adbf9050cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 99504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23325fdd-30e6-5408-a008-65adbf9050cd/23325fdd-30e6-5408-a008-65adbf9050cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/761/d3f190383ff24d95916f95a433952b33/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Active',
 'transmission': 'manual',
 'trim': '1.8 125H Active',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986980%27 HTTP/1.1" 200 None
2026-03-27 13:34:03 [ayvens.es] INFO: Saving data for 1986980: {'created_time': 1774618443.875197, 'last_price_update_time': 1774618443.875207, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986980') HTTP/1.1" 204 0
2026-03-27 13:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/083/5a60116bf3924d388ed775750f5f1ecf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/536/3066cf65a1ca4d2190922584e205fdb0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:03 [ayvens.es] INFO: Found listing with ID: 1986989
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986989%27 HTTP/1.1" 200 None
2026-03-27 13:34:03 [ayvens.es] INFO: Scrape type for 1986989: 1
2026-03-27 13:34:03 [ayvens.es] INFO: Extracting data for car ID: 1986989
2026-03-27 13:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5725479-94d9-556f-8da6-9a9b857f2058 with identifier: 1986989
2026-03-27 13:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5725479-94d9-556f-8da6-9a9b857f2058 with scrape type 1
2026-03-27 13:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5725479-94d9-556f-8da6-9a9b857f2058
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F559%252F0f28329db9d24ce2bef7ef86bbb9afcd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/559/0f28329db9d24ce2bef7ef86bbb9afcd/images/large/1.jpg not downloaded yet
2026-03-27 13:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/466/d876df0ae9564583b99fa967aa058a28/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962cb650>
2026-03-27 13:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49363511-9375-541b-bbfe-f73abbd2b6fb/49363511-9375-541b-bbfe-f73abbd2b6fb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F461%252F30d846a134a741d5b4d005088c27eabf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/461/30d846a134a741d5b4d005088c27eabf/images/large/1.jpg saved to cache
2026-03-27 13:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49363511-9375-541b-bbfe-f73abbd2b6fb
2026-03-27 13:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49363511-9375-541b-bbfe-f73abbd2b6fb, skipping ID generation
2026-03-27 13:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49363511-9375-541b-bbfe-f73abbd2b6fb with scrape type 1
2026-03-27 13:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49363511-9375-541b-bbfe-f73abbd2b6fb sending to next pipeline
2026-03-27 13:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49363511-9375-541b-bbfe-f73abbd2b6fb, identifier: 1986981
2026-03-27 13:34:05 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 3 pages/min), scraped 332 items (at 87 items/min)
2026-03-27 13:34:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-27 13:34:05 [ayvens.es] INFO: Found listing with ID: 1986990
2026-03-27 13:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986990%27 HTTP/1.1" 200 None
2026-03-27 13:34:05 [ayvens.es] INFO: Scrape type for 1986990: 1
2026-03-27 13:34:05 [ayvens.es] INFO: Extracting data for car ID: 1986990
2026-03-27 13:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b83ab6-e86f-5322-9b7f-f1039786f9bb with identifier: 1986990
2026-03-27 13:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b83ab6-e86f-5322-9b7f-f1039786f9bb with scrape type 1
2026-03-27 13:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 65b83ab6-e86f-5322-9b7f-f1039786f9bb
2026-03-27 13:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F274%252F1f5c7d008fe0493fbcfa7c68ad462b7c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/274/1f5c7d008fe0493fbcfa7c68ad462b7c/images/large/1.jpg not downloaded yet
2026-03-27 13:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49363511-9375-541b-bbfe-f73abbd2b6fb with identifier: 1986981
2026-03-27 13:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49363511-9375-541b-bbfe-f73abbd2b6fb with identifier: 1986981
2026-03-27 13:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49363511-9375-541b-bbfe-f73abbd2b6fb with identifier: 1986981 to the API
2026-03-27 13:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/461/30d846a134a741d5b4d005088c27eabf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '49363511-9375-541b-bbfe-f73abbd2b6fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 172678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49363511-9375-541b-bbfe-f73abbd2b6fb/49363511-9375-541b-bbfe-f73abbd2b6fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/461/30d846a134a741d5b4d005088c27eabf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986981%27 HTTP/1.1" 200 None
2026-03-27 13:34:07 [ayvens.es] INFO: Saving data for 1986981: {'created_time': 1774618447.163093, 'last_price_update_time': 1774618447.163104, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986981') HTTP/1.1" 204 0
2026-03-27 13:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/721/e278fa29579942369f8325df704fa9d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:07 [ayvens.es] INFO: Found listing with ID: 1986991
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986991%27 HTTP/1.1" 200 None
2026-03-27 13:34:07 [ayvens.es] INFO: Scrape type for 1986991: 1
2026-03-27 13:34:07 [ayvens.es] INFO: Extracting data for car ID: 1986991
2026-03-27 13:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3780b9cf-71d3-58d5-b3a3-9c854d2212b5 with identifier: 1986991
2026-03-27 13:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3780b9cf-71d3-58d5-b3a3-9c854d2212b5 with scrape type 1
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3780b9cf-71d3-58d5-b3a3-9c854d2212b5
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252F09f21b7a6f0c42209fa2310cd885df58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/09f21b7a6f0c42209fa2310cd885df58/images/large/1.jpg not downloaded yet
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956e83d0>
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd536fbb-7861-5d0c-a51a-40e6b3b1174e/dd536fbb-7861-5d0c-a51a-40e6b3b1174e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F083%252F5a60116bf3924d388ed775750f5f1ecf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/083/5a60116bf3924d388ed775750f5f1ecf/images/large/1.jpg saved to cache
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd536fbb-7861-5d0c-a51a-40e6b3b1174e
2026-03-27 13:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd536fbb-7861-5d0c-a51a-40e6b3b1174e, skipping ID generation
2026-03-27 13:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd536fbb-7861-5d0c-a51a-40e6b3b1174e with scrape type 1
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd536fbb-7861-5d0c-a51a-40e6b3b1174e sending to next pipeline
2026-03-27 13:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dd536fbb-7861-5d0c-a51a-40e6b3b1174e, identifier: 1986982
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4e250>
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b3af89-8a24-5ec3-9758-d27e01658563/f1b3af89-8a24-5ec3-9758-d27e01658563_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F536%252F3066cf65a1ca4d2190922584e205fdb0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/536/3066cf65a1ca4d2190922584e205fdb0/images/large/1.jpg saved to cache
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1b3af89-8a24-5ec3-9758-d27e01658563
2026-03-27 13:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1b3af89-8a24-5ec3-9758-d27e01658563, skipping ID generation
2026-03-27 13:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b3af89-8a24-5ec3-9758-d27e01658563 with scrape type 1
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1b3af89-8a24-5ec3-9758-d27e01658563 sending to next pipeline
2026-03-27 13:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f1b3af89-8a24-5ec3-9758-d27e01658563, identifier: 1986983
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632dd10>
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b729148-6ae5-5ca5-8184-df672ed565ef/1b729148-6ae5-5ca5-8184-df672ed565ef_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252Fd876df0ae9564583b99fa967aa058a28%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/d876df0ae9564583b99fa967aa058a28/images/large/1.jpg saved to cache
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b729148-6ae5-5ca5-8184-df672ed565ef
2026-03-27 13:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b729148-6ae5-5ca5-8184-df672ed565ef, skipping ID generation
2026-03-27 13:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b729148-6ae5-5ca5-8184-df672ed565ef with scrape type 1
2026-03-27 13:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b729148-6ae5-5ca5-8184-df672ed565ef sending to next pipeline
2026-03-27 13:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1b729148-6ae5-5ca5-8184-df672ed565ef, identifier: 1986984
2026-03-27 13:34:07 [ayvens.es] INFO: Found listing with ID: 1986992
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986992%27 HTTP/1.1" 200 None
2026-03-27 13:34:08 [ayvens.es] INFO: Scrape type for 1986992: 1
2026-03-27 13:34:08 [ayvens.es] INFO: Extracting data for car ID: 1986992
2026-03-27 13:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af47ba3-049a-5172-8808-53e87976bcc1 with identifier: 1986992
2026-03-27 13:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af47ba3-049a-5172-8808-53e87976bcc1 with scrape type 1
2026-03-27 13:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5af47ba3-049a-5172-8808-53e87976bcc1
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252Ffaccf73fe3534bfeb0d9e7c626259ab6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/faccf73fe3534bfeb0d9e7c626259ab6/images/large/1.jpg not downloaded yet
2026-03-27 13:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dd536fbb-7861-5d0c-a51a-40e6b3b1174e with identifier: 1986982
2026-03-27 13:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dd536fbb-7861-5d0c-a51a-40e6b3b1174e with identifier: 1986982
2026-03-27 13:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dd536fbb-7861-5d0c-a51a-40e6b3b1174e with identifier: 1986982 to the API
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/083/5a60116bf3924d388ed775750f5f1ecf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dd536fbb-7861-5d0c-a51a-40e6b3b1174e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 103633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd536fbb-7861-5d0c-a51a-40e6b3b1174e/dd536fbb-7861-5d0c-a51a-40e6b3b1174e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/083/5a60116bf3924d388ed775750f5f1ecf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986982%27 HTTP/1.1" 200 None
2026-03-27 13:34:08 [ayvens.es] INFO: Saving data for 1986982: {'created_time': 1774618448.45482, 'last_price_update_time': 1774618448.454831, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986982') HTTP/1.1" 204 0
2026-03-27 13:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f1b3af89-8a24-5ec3-9758-d27e01658563 with identifier: 1986983
2026-03-27 13:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f1b3af89-8a24-5ec3-9758-d27e01658563 with identifier: 1986983
2026-03-27 13:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f1b3af89-8a24-5ec3-9758-d27e01658563 with identifier: 1986983 to the API
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/536/3066cf65a1ca4d2190922584e205fdb0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f1b3af89-8a24-5ec3-9758-d27e01658563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 59792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b3af89-8a24-5ec3-9758-d27e01658563/f1b3af89-8a24-5ec3-9758-d27e01658563_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/536/3066cf65a1ca4d2190922584e205fdb0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986983%27 HTTP/1.1" 200 None
2026-03-27 13:34:08 [ayvens.es] INFO: Saving data for 1986983: {'created_time': 1774618448.85042, 'last_price_update_time': 1774618448.850433, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986983') HTTP/1.1" 204 0
2026-03-27 13:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1b729148-6ae5-5ca5-8184-df672ed565ef with identifier: 1986984
2026-03-27 13:34:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1b729148-6ae5-5ca5-8184-df672ed565ef with identifier: 1986984
2026-03-27 13:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1b729148-6ae5-5ca5-8184-df672ed565ef with identifier: 1986984 to the API
2026-03-27 13:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/466/d876df0ae9564583b99fa967aa058a28/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1b729148-6ae5-5ca5-8184-df672ed565ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 86132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b729148-6ae5-5ca5-8184-df672ed565ef/1b729148-6ae5-5ca5-8184-df672ed565ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/466/d876df0ae9564583b99fa967aa058a28/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986984%27 HTTP/1.1" 200 None
2026-03-27 13:34:09 [ayvens.es] INFO: Saving data for 1986984: {'created_time': 1774618449.203855, 'last_price_update_time': 1774618449.203867, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986984') HTTP/1.1" 204 0
2026-03-27 13:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296087e50>
2026-03-27 13:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e25a3f-da8a-5d4a-ad40-2bb112da046e/45e25a3f-da8a-5d4a-ad40-2bb112da046e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252Fe278fa29579942369f8325df704fa9d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/e278fa29579942369f8325df704fa9d6/images/large/1.jpg saved to cache
2026-03-27 13:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45e25a3f-da8a-5d4a-ad40-2bb112da046e
2026-03-27 13:34:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45e25a3f-da8a-5d4a-ad40-2bb112da046e, skipping ID generation
2026-03-27 13:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e25a3f-da8a-5d4a-ad40-2bb112da046e with scrape type 1
2026-03-27 13:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45e25a3f-da8a-5d4a-ad40-2bb112da046e sending to next pipeline
2026-03-27 13:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45e25a3f-da8a-5d4a-ad40-2bb112da046e, identifier: 1986985
2026-03-27 13:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/946/168efa3e38d2498b8c1aa035555be589/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/711/1c4298cc92e94ed8aa78baf8377cfaae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:09 [ayvens.es] INFO: Found listing with ID: 1986993
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986993%27 HTTP/1.1" 200 None
2026-03-27 13:34:09 [ayvens.es] INFO: Scrape type for 1986993: 1
2026-03-27 13:34:09 [ayvens.es] INFO: Extracting data for car ID: 1986993
2026-03-27 13:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9df803e7-1cc1-57df-99af-d85f8a37b124 with identifier: 1986993
2026-03-27 13:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df803e7-1cc1-57df-99af-d85f8a37b124 with scrape type 1
2026-03-27 13:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9df803e7-1cc1-57df-99af-d85f8a37b124
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F008%252Fe288771a41eb4d81a9430068c428055a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/008/e288771a41eb4d81a9430068c428055a/images/large/1.jpg not downloaded yet
2026-03-27 13:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45e25a3f-da8a-5d4a-ad40-2bb112da046e with identifier: 1986985
2026-03-27 13:34:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45e25a3f-da8a-5d4a-ad40-2bb112da046e with identifier: 1986985
2026-03-27 13:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45e25a3f-da8a-5d4a-ad40-2bb112da046e with identifier: 1986985 to the API
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/721/e278fa29579942369f8325df704fa9d6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Negro s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '45e25a3f-da8a-5d4a-ad40-2bb112da046e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 95586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e25a3f-da8a-5d4a-ad40-2bb112da046e/45e25a3f-da8a-5d4a-ad40-2bb112da046e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/721/e278fa29579942369f8325df704fa9d6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D Momentum Auto',
 'transmission': 'manual',
 'trim': '2.0 B4 D Momentum Auto',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986985%27 HTTP/1.1" 200 None
2026-03-27 13:34:09 [ayvens.es] INFO: Saving data for 1986985: {'created_time': 1774618449.868931, 'last_price_update_time': 1774618449.868942, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986985') HTTP/1.1" 204 0
2026-03-27 13:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/076/d6d9c5b45bd44c69ad18779cffdafb16/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:09 [ayvens.es] INFO: Found listing with ID: 1986994
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986994%27 HTTP/1.1" 200 None
2026-03-27 13:34:09 [ayvens.es] INFO: Scrape type for 1986994: 1
2026-03-27 13:34:09 [ayvens.es] INFO: Extracting data for car ID: 1986994
2026-03-27 13:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0965f985-ff24-5757-ba57-e89156538d7c with identifier: 1986994
2026-03-27 13:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0965f985-ff24-5757-ba57-e89156538d7c with scrape type 1
2026-03-27 13:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0965f985-ff24-5757-ba57-e89156538d7c
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F016%252F369fa02df18e4c378af8f25c5f38c4ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/016/369fa02df18e4c378af8f25c5f38c4ce/images/large/1.jpg not downloaded yet
2026-03-27 13:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295e524d0>
2026-03-27 13:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc268829-0ca4-5ddb-9bc2-14feb117d860/dc268829-0ca4-5ddb-9bc2-14feb117d860_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252F168efa3e38d2498b8c1aa035555be589%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/168efa3e38d2498b8c1aa035555be589/images/large/1.jpg saved to cache
2026-03-27 13:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc268829-0ca4-5ddb-9bc2-14feb117d860
2026-03-27 13:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc268829-0ca4-5ddb-9bc2-14feb117d860, skipping ID generation
2026-03-27 13:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc268829-0ca4-5ddb-9bc2-14feb117d860 with scrape type 1
2026-03-27 13:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc268829-0ca4-5ddb-9bc2-14feb117d860 sending to next pipeline
2026-03-27 13:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc268829-0ca4-5ddb-9bc2-14feb117d860, identifier: 1986986
2026-03-27 13:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bcc890>
2026-03-27 13:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe7441f1-fd9e-5415-990c-35fa8a47060b/fe7441f1-fd9e-5415-990c-35fa8a47060b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F711%252F1c4298cc92e94ed8aa78baf8377cfaae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/711/1c4298cc92e94ed8aa78baf8377cfaae/images/large/1.jpg saved to cache
2026-03-27 13:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe7441f1-fd9e-5415-990c-35fa8a47060b
2026-03-27 13:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe7441f1-fd9e-5415-990c-35fa8a47060b, skipping ID generation
2026-03-27 13:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe7441f1-fd9e-5415-990c-35fa8a47060b with scrape type 1
2026-03-27 13:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe7441f1-fd9e-5415-990c-35fa8a47060b sending to next pipeline
2026-03-27 13:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fe7441f1-fd9e-5415-990c-35fa8a47060b, identifier: 1986987
2026-03-27 13:34:10 [ayvens.es] INFO: Found listing with ID: 1986995
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986995%27 HTTP/1.1" 200 None
2026-03-27 13:34:10 [ayvens.es] INFO: Scrape type for 1986995: 1
2026-03-27 13:34:10 [ayvens.es] INFO: Extracting data for car ID: 1986995
2026-03-27 13:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f28c50c3-c3ce-53a4-a9a3-491e740afcb4 with identifier: 1986995
2026-03-27 13:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f28c50c3-c3ce-53a4-a9a3-491e740afcb4 with scrape type 1
2026-03-27 13:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f28c50c3-c3ce-53a4-a9a3-491e740afcb4
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252Fbe457a21e2ff4db682e150bc0d593a78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/be457a21e2ff4db682e150bc0d593a78/images/large/1.jpg not downloaded yet
2026-03-27 13:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc268829-0ca4-5ddb-9bc2-14feb117d860 with identifier: 1986986
2026-03-27 13:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc268829-0ca4-5ddb-9bc2-14feb117d860 with identifier: 1986986
2026-03-27 13:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc268829-0ca4-5ddb-9bc2-14feb117d860 with identifier: 1986986 to the API
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/946/168efa3e38d2498b8c1aa035555be589/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco perlado icebe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'dc268829-0ca4-5ddb-9bc2-14feb117d860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 147528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc268829-0ca4-5ddb-9bc2-14feb117d860/dc268829-0ca4-5ddb-9bc2-14feb117d860_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/946/168efa3e38d2498b8c1aa035555be589/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '2.0 180H Advance',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986986%27 HTTP/1.1" 200 None
2026-03-27 13:34:10 [ayvens.es] INFO: Saving data for 1986986: {'created_time': 1774618450.751443, 'last_price_update_time': 1774618450.751458, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986986') HTTP/1.1" 204 0
2026-03-27 13:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fe7441f1-fd9e-5415-990c-35fa8a47060b with identifier: 1986987
2026-03-27 13:34:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fe7441f1-fd9e-5415-990c-35fa8a47060b with identifier: 1986987
2026-03-27 13:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fe7441f1-fd9e-5415-990c-35fa8a47060b with identifier: 1986987 to the API
2026-03-27 13:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/711/1c4298cc92e94ed8aa78baf8377cfaae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe7441f1-fd9e-5415-990c-35fa8a47060b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 54660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe7441f1-fd9e-5415-990c-35fa8a47060b/fe7441f1-fd9e-5415-990c-35fa8a47060b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/711/1c4298cc92e94ed8aa78baf8377cfaae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986987%27 HTTP/1.1" 200 None
2026-03-27 13:34:11 [ayvens.es] INFO: Saving data for 1986987: {'created_time': 1774618451.147508, 'last_price_update_time': 1774618451.14752, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986987') HTTP/1.1" 204 0
2026-03-27 13:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/559/0f28329db9d24ce2bef7ef86bbb9afcd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:11 [ayvens.es] INFO: Found listing with ID: 1986996
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986996%27 HTTP/1.1" 200 None
2026-03-27 13:34:11 [ayvens.es] INFO: Scrape type for 1986996: 1
2026-03-27 13:34:11 [ayvens.es] INFO: Extracting data for car ID: 1986996
2026-03-27 13:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c29f3ea-2244-559f-91be-b681d3dac37f with identifier: 1986996
2026-03-27 13:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c29f3ea-2244-559f-91be-b681d3dac37f with scrape type 1
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3c29f3ea-2244-559f-91be-b681d3dac37f
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F804%252F1f2ed947560f4ac4bbd4eaa05813d634%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/804/1f2ed947560f4ac4bbd4eaa05813d634/images/large/1.jpg not downloaded yet
2026-03-27 13:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/274/1f5c7d008fe0493fbcfa7c68ad462b7c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/372/09f21b7a6f0c42209fa2310cd885df58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ed7b10>
2026-03-27 13:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_982a3443-f3c1-5767-a8dc-ee4ab569a029/982a3443-f3c1-5767-a8dc-ee4ab569a029_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F076%252Fd6d9c5b45bd44c69ad18779cffdafb16%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/076/d6d9c5b45bd44c69ad18779cffdafb16/images/large/1.jpg saved to cache
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 982a3443-f3c1-5767-a8dc-ee4ab569a029
2026-03-27 13:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 982a3443-f3c1-5767-a8dc-ee4ab569a029, skipping ID generation
2026-03-27 13:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982a3443-f3c1-5767-a8dc-ee4ab569a029 with scrape type 1
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 982a3443-f3c1-5767-a8dc-ee4ab569a029 sending to next pipeline
2026-03-27 13:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 982a3443-f3c1-5767-a8dc-ee4ab569a029, identifier: 1986988
2026-03-27 13:34:11 [ayvens.es] INFO: Found listing with ID: 1986997
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986997%27 HTTP/1.1" 200 None
2026-03-27 13:34:11 [ayvens.es] INFO: Scrape type for 1986997: 1
2026-03-27 13:34:11 [ayvens.es] INFO: Extracting data for car ID: 1986997
2026-03-27 13:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7404454b-4ad2-5982-9974-558bb2f218b4 with identifier: 1986997
2026-03-27 13:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7404454b-4ad2-5982-9974-558bb2f218b4 with scrape type 1
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7404454b-4ad2-5982-9974-558bb2f218b4
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F393%252Fead6789e6e3641629d23992788e26965%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/393/ead6789e6e3641629d23992788e26965/images/large/1.jpg not downloaded yet
2026-03-27 13:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 982a3443-f3c1-5767-a8dc-ee4ab569a029 with identifier: 1986988
2026-03-27 13:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 982a3443-f3c1-5767-a8dc-ee4ab569a029 with identifier: 1986988
2026-03-27 13:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 982a3443-f3c1-5767-a8dc-ee4ab569a029 with identifier: 1986988 to the API
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/076/d6d9c5b45bd44c69ad18779cffdafb16/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '982a3443-f3c1-5767-a8dc-ee4ab569a029',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'LANDCRUISER',
 'odometer': 173601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982a3443-f3c1-5767-a8dc-ee4ab569a029/982a3443-f3c1-5767-a8dc-ee4ab569a029_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/076/d6d9c5b45bd44c69ad18779cffdafb16/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA LANDCRUISER 2.8 D-4D GX',
 'transmission': 'manual',
 'trim': '2.8 D-4D GX',
 'vin': None,
 'year': 2019}
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986988%27 HTTP/1.1" 200 None
2026-03-27 13:34:11 [ayvens.es] INFO: Saving data for 1986988: {'created_time': 1774618451.781895, 'last_price_update_time': 1774618451.781906, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986988') HTTP/1.1" 204 0
2026-03-27 13:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/495/faccf73fe3534bfeb0d9e7c626259ab6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:11 [ayvens.es] INFO: Found listing with ID: 1986998
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986998%27 HTTP/1.1" 200 None
2026-03-27 13:34:11 [ayvens.es] INFO: Scrape type for 1986998: 1
2026-03-27 13:34:11 [ayvens.es] INFO: Extracting data for car ID: 1986998
2026-03-27 13:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7a0051-93f6-5804-ad97-cbf50a6d5784 with identifier: 1986998
2026-03-27 13:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7a0051-93f6-5804-ad97-cbf50a6d5784 with scrape type 1
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de7a0051-93f6-5804-ad97-cbf50a6d5784
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F647%252F40ccc8e3cd3447ec886bc5a8779307c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/647/40ccc8e3cd3447ec886bc5a8779307c0/images/large/1.jpg not downloaded yet
2026-03-27 13:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ed7d90>
2026-03-27 13:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5725479-94d9-556f-8da6-9a9b857f2058/d5725479-94d9-556f-8da6-9a9b857f2058_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F559%252F0f28329db9d24ce2bef7ef86bbb9afcd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/559/0f28329db9d24ce2bef7ef86bbb9afcd/images/large/1.jpg saved to cache
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5725479-94d9-556f-8da6-9a9b857f2058
2026-03-27 13:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5725479-94d9-556f-8da6-9a9b857f2058, skipping ID generation
2026-03-27 13:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5725479-94d9-556f-8da6-9a9b857f2058 with scrape type 1
2026-03-27 13:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5725479-94d9-556f-8da6-9a9b857f2058 sending to next pipeline
2026-03-27 13:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d5725479-94d9-556f-8da6-9a9b857f2058, identifier: 1986989
2026-03-27 13:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956d5c50>
2026-03-27 13:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b83ab6-e86f-5322-9b7f-f1039786f9bb/65b83ab6-e86f-5322-9b7f-f1039786f9bb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F274%252F1f5c7d008fe0493fbcfa7c68ad462b7c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/274/1f5c7d008fe0493fbcfa7c68ad462b7c/images/large/1.jpg saved to cache
2026-03-27 13:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65b83ab6-e86f-5322-9b7f-f1039786f9bb
2026-03-27 13:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65b83ab6-e86f-5322-9b7f-f1039786f9bb, skipping ID generation
2026-03-27 13:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b83ab6-e86f-5322-9b7f-f1039786f9bb with scrape type 1
2026-03-27 13:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65b83ab6-e86f-5322-9b7f-f1039786f9bb sending to next pipeline
2026-03-27 13:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 65b83ab6-e86f-5322-9b7f-f1039786f9bb, identifier: 1986990
2026-03-27 13:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c31d0>
2026-03-27 13:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3780b9cf-71d3-58d5-b3a3-9c854d2212b5/3780b9cf-71d3-58d5-b3a3-9c854d2212b5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252F09f21b7a6f0c42209fa2310cd885df58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/09f21b7a6f0c42209fa2310cd885df58/images/large/1.jpg saved to cache
2026-03-27 13:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3780b9cf-71d3-58d5-b3a3-9c854d2212b5
2026-03-27 13:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3780b9cf-71d3-58d5-b3a3-9c854d2212b5, skipping ID generation
2026-03-27 13:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3780b9cf-71d3-58d5-b3a3-9c854d2212b5 with scrape type 1
2026-03-27 13:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3780b9cf-71d3-58d5-b3a3-9c854d2212b5 sending to next pipeline
2026-03-27 13:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3780b9cf-71d3-58d5-b3a3-9c854d2212b5, identifier: 1986991
2026-03-27 13:34:12 [ayvens.es] INFO: Found listing with ID: 1986999
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986999%27 HTTP/1.1" 200 None
2026-03-27 13:34:12 [ayvens.es] INFO: Scrape type for 1986999: 1
2026-03-27 13:34:12 [ayvens.es] INFO: Extracting data for car ID: 1986999
2026-03-27 13:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19cf5eba-8f7b-5d04-a1b8-532ec9ada850 with identifier: 1986999
2026-03-27 13:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19cf5eba-8f7b-5d04-a1b8-532ec9ada850 with scrape type 1
2026-03-27 13:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 19cf5eba-8f7b-5d04-a1b8-532ec9ada850
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252Fd26e22c3fa9c4be38916ae425b98f954%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/d26e22c3fa9c4be38916ae425b98f954/images/large/1.jpg not downloaded yet
2026-03-27 13:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d5725479-94d9-556f-8da6-9a9b857f2058 with identifier: 1986989
2026-03-27 13:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d5725479-94d9-556f-8da6-9a9b857f2058 with identifier: 1986989
2026-03-27 13:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d5725479-94d9-556f-8da6-9a9b857f2058 with identifier: 1986989 to the API
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/559/0f28329db9d24ce2bef7ef86bbb9afcd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'electric',
 'id': 'd5725479-94d9-556f-8da6-9a9b857f2058',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 70555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5725479-94d9-556f-8da6-9a9b857f2058/d5725479-94d9-556f-8da6-9a9b857f2058_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/559/0f28329db9d24ce2bef7ef86bbb9afcd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pro Performance Life 150kW (204CV) Auto',
 'transmission': 'manual',
 'trim': 'Pro Performance Life 150kW (204CV) Auto',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986989%27 HTTP/1.1" 200 None
2026-03-27 13:34:12 [ayvens.es] INFO: Saving data for 1986989: {'created_time': 1774618452.844422, 'last_price_update_time': 1774618452.844435, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986989') HTTP/1.1" 204 0
2026-03-27 13:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 65b83ab6-e86f-5322-9b7f-f1039786f9bb with identifier: 1986990
2026-03-27 13:34:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 65b83ab6-e86f-5322-9b7f-f1039786f9bb with identifier: 1986990
2026-03-27 13:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 65b83ab6-e86f-5322-9b7f-f1039786f9bb with identifier: 1986990 to the API
2026-03-27 13:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/274/1f5c7d008fe0493fbcfa7c68ad462b7c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gris manganeso metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'electric',
 'id': '65b83ab6-e86f-5322-9b7f-f1039786f9bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 142025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b83ab6-e86f-5322-9b7f-f1039786f9bb/65b83ab6-e86f-5322-9b7f-f1039786f9bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/274/1f5c7d008fe0493fbcfa7c68ad462b7c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pro 128kW (174CV) Automatico',
 'transmission': 'manual',
 'trim': 'Pro 128kW (174CV) Automatico',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986990%27 HTTP/1.1" 200 None
2026-03-27 13:34:13 [ayvens.es] INFO: Saving data for 1986990: {'created_time': 1774618453.248441, 'last_price_update_time': 1774618453.248451, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986990') HTTP/1.1" 204 0
2026-03-27 13:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3780b9cf-71d3-58d5-b3a3-9c854d2212b5 with identifier: 1986991
2026-03-27 13:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3780b9cf-71d3-58d5-b3a3-9c854d2212b5 with identifier: 1986991
2026-03-27 13:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3780b9cf-71d3-58d5-b3a3-9c854d2212b5 with identifier: 1986991 to the API
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/372/09f21b7a6f0c42209fa2310cd885df58/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3780b9cf-71d3-58d5-b3a3-9c854d2212b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 41813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3780b9cf-71d3-58d5-b3a3-9c854d2212b5/3780b9cf-71d3-58d5-b3a3-9c854d2212b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/09f21b7a6f0c42209fa2310cd885df58/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2023}
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986991%27 HTTP/1.1" 200 None
2026-03-27 13:34:13 [ayvens.es] INFO: Saving data for 1986991: {'created_time': 1774618453.642198, 'last_price_update_time': 1774618453.64221, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986991') HTTP/1.1" 204 0
2026-03-27 13:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/008/e288771a41eb4d81a9430068c428055a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:13 [ayvens.es] INFO: Found listing with ID: 1987000
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987000%27 HTTP/1.1" 200 None
2026-03-27 13:34:13 [ayvens.es] INFO: Scrape type for 1987000: 1
2026-03-27 13:34:13 [ayvens.es] INFO: Extracting data for car ID: 1987000
2026-03-27 13:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58aa3be9-339a-5a3f-aedd-830cdf7f8c16 with identifier: 1987000
2026-03-27 13:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58aa3be9-339a-5a3f-aedd-830cdf7f8c16 with scrape type 1
2026-03-27 13:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 58aa3be9-339a-5a3f-aedd-830cdf7f8c16
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F4eb0c5c17f7a48f68a9af4502cfc4735%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/4eb0c5c17f7a48f68a9af4502cfc4735/images/large/1.jpg not downloaded yet
2026-03-27 13:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956cabd0>
2026-03-27 13:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af47ba3-049a-5172-8808-53e87976bcc1/5af47ba3-049a-5172-8808-53e87976bcc1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252Ffaccf73fe3534bfeb0d9e7c626259ab6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/faccf73fe3534bfeb0d9e7c626259ab6/images/large/1.jpg saved to cache
2026-03-27 13:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5af47ba3-049a-5172-8808-53e87976bcc1
2026-03-27 13:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5af47ba3-049a-5172-8808-53e87976bcc1, skipping ID generation
2026-03-27 13:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af47ba3-049a-5172-8808-53e87976bcc1 with scrape type 1
2026-03-27 13:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5af47ba3-049a-5172-8808-53e87976bcc1 sending to next pipeline
2026-03-27 13:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5af47ba3-049a-5172-8808-53e87976bcc1, identifier: 1986992
2026-03-27 13:34:13 [ayvens.es] INFO: Found listing with ID: 1987001
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987001%27 HTTP/1.1" 200 None
2026-03-27 13:34:13 [ayvens.es] INFO: Scrape type for 1987001: 1
2026-03-27 13:34:13 [ayvens.es] INFO: Extracting data for car ID: 1987001
2026-03-27 13:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b42b867-791d-5f9c-b510-1f1288906c00 with identifier: 1987001
2026-03-27 13:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b42b867-791d-5f9c-b510-1f1288906c00 with scrape type 1
2026-03-27 13:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b42b867-791d-5f9c-b510-1f1288906c00
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F800%252F8c3e9bbbe5f84306a44b7114941c5d9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/800/8c3e9bbbe5f84306a44b7114941c5d9d/images/large/1.jpg not downloaded yet
2026-03-27 13:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5af47ba3-049a-5172-8808-53e87976bcc1 with identifier: 1986992
2026-03-27 13:34:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5af47ba3-049a-5172-8808-53e87976bcc1 with identifier: 1986992
2026-03-27 13:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5af47ba3-049a-5172-8808-53e87976bcc1 with identifier: 1986992 to the API
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/495/faccf73fe3534bfeb0d9e7c626259ab6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Gris delf',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5af47ba3-049a-5172-8808-53e87976bcc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 64249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af47ba3-049a-5172-8808-53e87976bcc1/5af47ba3-049a-5172-8808-53e87976bcc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/495/faccf73fe3534bfeb0d9e7c626259ab6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986992%27 HTTP/1.1" 200 None
2026-03-27 13:34:14 [ayvens.es] INFO: Saving data for 1986992: {'created_time': 1774618454.308777, 'last_price_update_time': 1774618454.308787, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986992') HTTP/1.1" 204 0
2026-03-27 13:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/016/369fa02df18e4c378af8f25c5f38c4ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/804/1f2ed947560f4ac4bbd4eaa05813d634/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:14 [ayvens.es] INFO: Found listing with ID: 1987002
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987002%27 HTTP/1.1" 200 None
2026-03-27 13:34:14 [ayvens.es] INFO: Scrape type for 1987002: 1
2026-03-27 13:34:14 [ayvens.es] INFO: Extracting data for car ID: 1987002
2026-03-27 13:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa with identifier: 1987002
2026-03-27 13:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa with scrape type 1
2026-03-27 13:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252F4afa4601be7d4ea0bc3120cad1625a03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/4afa4601be7d4ea0bc3120cad1625a03/images/large/1.jpg not downloaded yet
2026-03-27 13:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c32890>
2026-03-27 13:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9df803e7-1cc1-57df-99af-d85f8a37b124/9df803e7-1cc1-57df-99af-d85f8a37b124_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F008%252Fe288771a41eb4d81a9430068c428055a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/008/e288771a41eb4d81a9430068c428055a/images/large/1.jpg saved to cache
2026-03-27 13:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9df803e7-1cc1-57df-99af-d85f8a37b124
2026-03-27 13:34:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9df803e7-1cc1-57df-99af-d85f8a37b124, skipping ID generation
2026-03-27 13:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df803e7-1cc1-57df-99af-d85f8a37b124 with scrape type 1
2026-03-27 13:34:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9df803e7-1cc1-57df-99af-d85f8a37b124 sending to next pipeline
2026-03-27 13:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9df803e7-1cc1-57df-99af-d85f8a37b124, identifier: 1986993
2026-03-27 13:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/746/be457a21e2ff4db682e150bc0d593a78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:14 [ayvens.es] INFO: Found listing with ID: 1987003
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987003%27 HTTP/1.1" 200 None
2026-03-27 13:34:14 [ayvens.es] INFO: Scrape type for 1987003: 1
2026-03-27 13:34:14 [ayvens.es] INFO: Extracting data for car ID: 1987003
2026-03-27 13:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070e6ec1-7e71-5a61-ae79-ad6d59348ef5 with identifier: 1987003
2026-03-27 13:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070e6ec1-7e71-5a61-ae79-ad6d59348ef5 with scrape type 1
2026-03-27 13:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 070e6ec1-7e71-5a61-ae79-ad6d59348ef5
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F812%252Fb54dec1b199a4fde860be9f33301ac3a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/812/b54dec1b199a4fde860be9f33301ac3a/images/large/1.jpg not downloaded yet
2026-03-27 13:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9df803e7-1cc1-57df-99af-d85f8a37b124 with identifier: 1986993
2026-03-27 13:34:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9df803e7-1cc1-57df-99af-d85f8a37b124 with identifier: 1986993
2026-03-27 13:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9df803e7-1cc1-57df-99af-d85f8a37b124 with identifier: 1986993 to the API
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/008/e288771a41eb4d81a9430068c428055a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Gris grafito',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9df803e7-1cc1-57df-99af-d85f8a37b124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 62129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df803e7-1cc1-57df-99af-d85f8a37b124/9df803e7-1cc1-57df-99af-d85f8a37b124_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/008/e288771a41eb4d81a9430068c428055a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Style',
 'transmission': 'manual',
 'trim': '2.5l 220H Style',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986993%27 HTTP/1.1" 200 None
2026-03-27 13:34:14 [ayvens.es] INFO: Saving data for 1986993: {'created_time': 1774618454.951867, 'last_price_update_time': 1774618454.951877, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986993') HTTP/1.1" 204 0
2026-03-27 13:34:14 [ayvens.es] INFO: Found listing with ID: 1987004
2026-03-27 13:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987004%27 HTTP/1.1" 200 None
2026-03-27 13:34:15 [ayvens.es] INFO: Scrape type for 1987004: 1
2026-03-27 13:34:15 [ayvens.es] INFO: Extracting data for car ID: 1987004
2026-03-27 13:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a171f2-eccd-507f-852a-90afc9c2360f with identifier: 1987004
2026-03-27 13:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a171f2-eccd-507f-852a-90afc9c2360f with scrape type 1
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 83a171f2-eccd-507f-852a-90afc9c2360f
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F355%252F5a92eaba675440d0b0922eed1f4e68f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/355/5a92eaba675440d0b0922eed1f4e68f5/images/large/1.jpg not downloaded yet
2026-03-27 13:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/647/40ccc8e3cd3447ec886bc5a8779307c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/393/ead6789e6e3641629d23992788e26965/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52a5633290>
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0965f985-ff24-5757-ba57-e89156538d7c/0965f985-ff24-5757-ba57-e89156538d7c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F016%252F369fa02df18e4c378af8f25c5f38c4ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/016/369fa02df18e4c378af8f25c5f38c4ce/images/large/1.jpg saved to cache
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0965f985-ff24-5757-ba57-e89156538d7c
2026-03-27 13:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0965f985-ff24-5757-ba57-e89156538d7c, skipping ID generation
2026-03-27 13:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0965f985-ff24-5757-ba57-e89156538d7c with scrape type 1
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0965f985-ff24-5757-ba57-e89156538d7c sending to next pipeline
2026-03-27 13:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0965f985-ff24-5757-ba57-e89156538d7c, identifier: 1986994
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c31790>
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c29f3ea-2244-559f-91be-b681d3dac37f/3c29f3ea-2244-559f-91be-b681d3dac37f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F804%252F1f2ed947560f4ac4bbd4eaa05813d634%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/804/1f2ed947560f4ac4bbd4eaa05813d634/images/large/1.jpg saved to cache
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c29f3ea-2244-559f-91be-b681d3dac37f
2026-03-27 13:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c29f3ea-2244-559f-91be-b681d3dac37f, skipping ID generation
2026-03-27 13:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c29f3ea-2244-559f-91be-b681d3dac37f with scrape type 1
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c29f3ea-2244-559f-91be-b681d3dac37f sending to next pipeline
2026-03-27 13:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3c29f3ea-2244-559f-91be-b681d3dac37f, identifier: 1986996
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960bf990>
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f28c50c3-c3ce-53a4-a9a3-491e740afcb4/f28c50c3-c3ce-53a4-a9a3-491e740afcb4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252Fbe457a21e2ff4db682e150bc0d593a78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/be457a21e2ff4db682e150bc0d593a78/images/large/1.jpg saved to cache
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f28c50c3-c3ce-53a4-a9a3-491e740afcb4
2026-03-27 13:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f28c50c3-c3ce-53a4-a9a3-491e740afcb4, skipping ID generation
2026-03-27 13:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f28c50c3-c3ce-53a4-a9a3-491e740afcb4 with scrape type 1
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f28c50c3-c3ce-53a4-a9a3-491e740afcb4 sending to next pipeline
2026-03-27 13:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f28c50c3-c3ce-53a4-a9a3-491e740afcb4, identifier: 1986995
2026-03-27 13:34:15 [ayvens.es] INFO: Found listing with ID: 1987005
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987005%27 HTTP/1.1" 200 None
2026-03-27 13:34:15 [ayvens.es] INFO: Scrape type for 1987005: 1
2026-03-27 13:34:15 [ayvens.es] INFO: Extracting data for car ID: 1987005
2026-03-27 13:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0 with identifier: 1987005
2026-03-27 13:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0 with scrape type 1
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F598%252F30d2181020fc4572b710fd864a8b6c30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/598/30d2181020fc4572b710fd864a8b6c30/images/large/1.jpg not downloaded yet
2026-03-27 13:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0965f985-ff24-5757-ba57-e89156538d7c with identifier: 1986994
2026-03-27 13:34:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0965f985-ff24-5757-ba57-e89156538d7c with identifier: 1986994
2026-03-27 13:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0965f985-ff24-5757-ba57-e89156538d7c with identifier: 1986994 to the API
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/016/369fa02df18e4c378af8f25c5f38c4ce/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0965f985-ff24-5757-ba57-e89156538d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 80587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0965f985-ff24-5757-ba57-e89156538d7c/0965f985-ff24-5757-ba57-e89156538d7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/016/369fa02df18e4c378af8f25c5f38c4ce/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Ready2Go 1.6 TDI 85kW (115CV) Variant',
 'transmission': 'manual',
 'trim': 'Ready2Go 1.6 TDI 85kW (115CV) Variant',
 'vin': None,
 'year': 2019}
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986994%27 HTTP/1.1" 200 None
2026-03-27 13:34:15 [ayvens.es] INFO: Saving data for 1986994: {'created_time': 1774618455.933286, 'last_price_update_time': 1774618455.933298, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986994') HTTP/1.1" 204 0
2026-03-27 13:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3c29f3ea-2244-559f-91be-b681d3dac37f with identifier: 1986996
2026-03-27 13:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3c29f3ea-2244-559f-91be-b681d3dac37f with identifier: 1986996
2026-03-27 13:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3c29f3ea-2244-559f-91be-b681d3dac37f with identifier: 1986996 to the API
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/804/1f2ed947560f4ac4bbd4eaa05813d634/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '3c29f3ea-2244-559f-91be-b681d3dac37f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 71098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c29f3ea-2244-559f-91be-b681d3dac37f/3c29f3ea-2244-559f-91be-b681d3dac37f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/804/1f2ed947560f4ac4bbd4eaa05813d634/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC (O) Advance R-Line 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Advance R-Line 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986996%27 HTTP/1.1" 200 None
2026-03-27 13:34:16 [ayvens.es] INFO: Saving data for 1986996: {'created_time': 1774618456.29685, 'last_price_update_time': 1774618456.296861, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986996') HTTP/1.1" 204 0
2026-03-27 13:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f28c50c3-c3ce-53a4-a9a3-491e740afcb4 with identifier: 1986995
2026-03-27 13:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f28c50c3-c3ce-53a4-a9a3-491e740afcb4 with identifier: 1986995
2026-03-27 13:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f28c50c3-c3ce-53a4-a9a3-491e740afcb4 with identifier: 1986995 to the API
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/746/be457a21e2ff4db682e150bc0d593a78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f28c50c3-c3ce-53a4-a9a3-491e740afcb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 79012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f28c50c3-c3ce-53a4-a9a3-491e740afcb4/f28c50c3-c3ce-53a4-a9a3-491e740afcb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/746/be457a21e2ff4db682e150bc0d593a78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986995%27 HTTP/1.1" 200 None
2026-03-27 13:34:16 [ayvens.es] INFO: Saving data for 1986995: {'created_time': 1774618456.745838, 'last_price_update_time': 1774618456.74585, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986995') HTTP/1.1" 204 0
2026-03-27 13:34:16 [ayvens.es] INFO: Found listing with ID: 1987006
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987006%27 HTTP/1.1" 200 None
2026-03-27 13:34:16 [ayvens.es] INFO: Scrape type for 1987006: 1
2026-03-27 13:34:16 [ayvens.es] INFO: Extracting data for car ID: 1987006
2026-03-27 13:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e68d2a3-c359-5e0f-8631-4c741b8f03f7 with identifier: 1987006
2026-03-27 13:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e68d2a3-c359-5e0f-8631-4c741b8f03f7 with scrape type 1
2026-03-27 13:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e68d2a3-c359-5e0f-8631-4c741b8f03f7
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F229%252F30be686fbdab4e818461a3b86ece4572%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/229/30be686fbdab4e818461a3b86ece4572/images/large/1.jpg not downloaded yet
2026-03-27 13:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f10890>
2026-03-27 13:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a0051-93f6-5804-ad97-cbf50a6d5784/de7a0051-93f6-5804-ad97-cbf50a6d5784_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F647%252F40ccc8e3cd3447ec886bc5a8779307c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/647/40ccc8e3cd3447ec886bc5a8779307c0/images/large/1.jpg saved to cache
2026-03-27 13:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de7a0051-93f6-5804-ad97-cbf50a6d5784
2026-03-27 13:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de7a0051-93f6-5804-ad97-cbf50a6d5784, skipping ID generation
2026-03-27 13:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7a0051-93f6-5804-ad97-cbf50a6d5784 with scrape type 1
2026-03-27 13:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de7a0051-93f6-5804-ad97-cbf50a6d5784 sending to next pipeline
2026-03-27 13:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de7a0051-93f6-5804-ad97-cbf50a6d5784, identifier: 1986998
2026-03-27 13:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960cc210>
2026-03-27 13:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404454b-4ad2-5982-9974-558bb2f218b4/7404454b-4ad2-5982-9974-558bb2f218b4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F393%252Fead6789e6e3641629d23992788e26965%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/393/ead6789e6e3641629d23992788e26965/images/large/1.jpg saved to cache
2026-03-27 13:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7404454b-4ad2-5982-9974-558bb2f218b4
2026-03-27 13:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7404454b-4ad2-5982-9974-558bb2f218b4, skipping ID generation
2026-03-27 13:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7404454b-4ad2-5982-9974-558bb2f218b4 with scrape type 1
2026-03-27 13:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7404454b-4ad2-5982-9974-558bb2f218b4 sending to next pipeline
2026-03-27 13:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7404454b-4ad2-5982-9974-558bb2f218b4, identifier: 1986997
2026-03-27 13:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/744/4eb0c5c17f7a48f68a9af4502cfc4735/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/957/d26e22c3fa9c4be38916ae425b98f954/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:17 [ayvens.es] INFO: Found listing with ID: 1987007
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987007%27 HTTP/1.1" 200 None
2026-03-27 13:34:17 [ayvens.es] INFO: Scrape type for 1987007: 1
2026-03-27 13:34:17 [ayvens.es] INFO: Extracting data for car ID: 1987007
2026-03-27 13:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2369b4db-70cd-5be8-95dd-d21e6a3e046d with identifier: 1987007
2026-03-27 13:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d with scrape type 1
2026-03-27 13:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252Fbd953096430248f2934d6192c9a7f93e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/bd953096430248f2934d6192c9a7f93e/images/large/1.jpg not downloaded yet
2026-03-27 13:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de7a0051-93f6-5804-ad97-cbf50a6d5784 with identifier: 1986998
2026-03-27 13:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de7a0051-93f6-5804-ad97-cbf50a6d5784 with identifier: 1986998
2026-03-27 13:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de7a0051-93f6-5804-ad97-cbf50a6d5784 with identifier: 1986998 to the API
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/647/40ccc8e3cd3447ec886bc5a8779307c0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de7a0051-93f6-5804-ad97-cbf50a6d5784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 89579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a0051-93f6-5804-ad97-cbf50a6d5784/de7a0051-93f6-5804-ad97-cbf50a6d5784_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/647/40ccc8e3cd3447ec886bc5a8779307c0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986998%27 HTTP/1.1" 200 None
2026-03-27 13:34:17 [ayvens.es] INFO: Saving data for 1986998: {'created_time': 1774618457.646965, 'last_price_update_time': 1774618457.646975, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986998') HTTP/1.1" 204 0
2026-03-27 13:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7404454b-4ad2-5982-9974-558bb2f218b4 with identifier: 1986997
2026-03-27 13:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7404454b-4ad2-5982-9974-558bb2f218b4 with identifier: 1986997
2026-03-27 13:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7404454b-4ad2-5982-9974-558bb2f218b4 with identifier: 1986997 to the API
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/393/ead6789e6e3641629d23992788e26965/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7404454b-4ad2-5982-9974-558bb2f218b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 46889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404454b-4ad2-5982-9974-558bb2f218b4/7404454b-4ad2-5982-9974-558bb2f218b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/393/ead6789e6e3641629d23992788e26965/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986997%27 HTTP/1.1" 200 None
2026-03-27 13:34:17 [ayvens.es] INFO: Saving data for 1986997: {'created_time': 1774618457.999538, 'last_price_update_time': 1774618457.999547, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986997') HTTP/1.1" 204 0
2026-03-27 13:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/800/8c3e9bbbe5f84306a44b7114941c5d9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:18 [ayvens.es] INFO: Found listing with ID: 1987008
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987008%27 HTTP/1.1" 200 None
2026-03-27 13:34:18 [ayvens.es] INFO: Scrape type for 1987008: 1
2026-03-27 13:34:18 [ayvens.es] INFO: Extracting data for car ID: 1987008
2026-03-27 13:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with identifier: 1987008
2026-03-27 13:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with scrape type 1
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F950%252Ffb4cc5c64b5b45fb91a33ae08b8fe34a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/950/fb4cc5c64b5b45fb91a33ae08b8fe34a/images/large/1.jpg not downloaded yet
2026-03-27 13:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957af050>
2026-03-27 13:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58aa3be9-339a-5a3f-aedd-830cdf7f8c16/58aa3be9-339a-5a3f-aedd-830cdf7f8c16_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F4eb0c5c17f7a48f68a9af4502cfc4735%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/4eb0c5c17f7a48f68a9af4502cfc4735/images/large/1.jpg saved to cache
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58aa3be9-339a-5a3f-aedd-830cdf7f8c16
2026-03-27 13:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58aa3be9-339a-5a3f-aedd-830cdf7f8c16, skipping ID generation
2026-03-27 13:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58aa3be9-339a-5a3f-aedd-830cdf7f8c16 with scrape type 1
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58aa3be9-339a-5a3f-aedd-830cdf7f8c16 sending to next pipeline
2026-03-27 13:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 58aa3be9-339a-5a3f-aedd-830cdf7f8c16, identifier: 1987000
2026-03-27 13:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297d3f750>
2026-03-27 13:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19cf5eba-8f7b-5d04-a1b8-532ec9ada850/19cf5eba-8f7b-5d04-a1b8-532ec9ada850_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252Fd26e22c3fa9c4be38916ae425b98f954%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/d26e22c3fa9c4be38916ae425b98f954/images/large/1.jpg saved to cache
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19cf5eba-8f7b-5d04-a1b8-532ec9ada850
2026-03-27 13:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19cf5eba-8f7b-5d04-a1b8-532ec9ada850, skipping ID generation
2026-03-27 13:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19cf5eba-8f7b-5d04-a1b8-532ec9ada850 with scrape type 1
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19cf5eba-8f7b-5d04-a1b8-532ec9ada850 sending to next pipeline
2026-03-27 13:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 19cf5eba-8f7b-5d04-a1b8-532ec9ada850, identifier: 1986999
2026-03-27 13:34:18 [ayvens.es] INFO: Found listing with ID: 1987009
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987009%27 HTTP/1.1" 200 None
2026-03-27 13:34:18 [ayvens.es] INFO: Scrape type for 1987009: 1
2026-03-27 13:34:18 [ayvens.es] INFO: Extracting data for car ID: 1987009
2026-03-27 13:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff25eaed-a37a-57f5-b715-663021df30f2 with identifier: 1987009
2026-03-27 13:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff25eaed-a37a-57f5-b715-663021df30f2 with scrape type 1
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff25eaed-a37a-57f5-b715-663021df30f2
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F090%252F8a58f749a1354c94b243068e76929155%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/090/8a58f749a1354c94b243068e76929155/images/large/1.jpg not downloaded yet
2026-03-27 13:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 58aa3be9-339a-5a3f-aedd-830cdf7f8c16 with identifier: 1987000
2026-03-27 13:34:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 58aa3be9-339a-5a3f-aedd-830cdf7f8c16 with identifier: 1987000
2026-03-27 13:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 58aa3be9-339a-5a3f-aedd-830cdf7f8c16 with identifier: 1987000 to the API
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/744/4eb0c5c17f7a48f68a9af4502cfc4735/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Blanco oryx efecto n',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '58aa3be9-339a-5a3f-aedd-830cdf7f8c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 67780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58aa3be9-339a-5a3f-aedd-830cdf7f8c16/58aa3be9-339a-5a3f-aedd-830cdf7f8c16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/744/4eb0c5c17f7a48f68a9af4502cfc4735/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987000%27 HTTP/1.1" 200 None
2026-03-27 13:34:18 [ayvens.es] INFO: Saving data for 1987000: {'created_time': 1774618458.78004, 'last_price_update_time': 1774618458.78005, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987000') HTTP/1.1" 204 0
2026-03-27 13:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 19cf5eba-8f7b-5d04-a1b8-532ec9ada850 with identifier: 1986999
2026-03-27 13:34:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 19cf5eba-8f7b-5d04-a1b8-532ec9ada850 with identifier: 1986999
2026-03-27 13:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 19cf5eba-8f7b-5d04-a1b8-532ec9ada850 with identifier: 1986999 to the API
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/957/d26e22c3fa9c4be38916ae425b98f954/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Gris indy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '19cf5eba-8f7b-5d04-a1b8-532ec9ada850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 158937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cf5eba-8f7b-5d04-a1b8-532ec9ada850/19cf5eba-8f7b-5d04-a1b8-532ec9ada850_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/957/d26e22c3fa9c4be38916ae425b98f954/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986999%27 HTTP/1.1" 200 None
2026-03-27 13:34:19 [ayvens.es] INFO: Saving data for 1986999: {'created_time': 1774618459.316446, 'last_price_update_time': 1774618459.316456, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986999') HTTP/1.1" 204 0
2026-03-27 13:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/819/4afa4601be7d4ea0bc3120cad1625a03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/812/b54dec1b199a4fde860be9f33301ac3a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:19 [ayvens.es] INFO: Found listing with ID: 1987010
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987010%27 HTTP/1.1" 200 None
2026-03-27 13:34:19 [ayvens.es] INFO: Scrape type for 1987010: 1
2026-03-27 13:34:19 [ayvens.es] INFO: Extracting data for car ID: 1987010
2026-03-27 13:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with identifier: 1987010
2026-03-27 13:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with scrape type 1
2026-03-27 13:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F968%252F72c68fa367124b8ea6d57cf2936c7d0e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/968/72c68fa367124b8ea6d57cf2936c7d0e/images/large/1.jpg not downloaded yet
2026-03-27 13:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fa8a90>
2026-03-27 13:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b42b867-791d-5f9c-b510-1f1288906c00/9b42b867-791d-5f9c-b510-1f1288906c00_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F800%252F8c3e9bbbe5f84306a44b7114941c5d9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/800/8c3e9bbbe5f84306a44b7114941c5d9d/images/large/1.jpg saved to cache
2026-03-27 13:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b42b867-791d-5f9c-b510-1f1288906c00
2026-03-27 13:34:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b42b867-791d-5f9c-b510-1f1288906c00, skipping ID generation
2026-03-27 13:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b42b867-791d-5f9c-b510-1f1288906c00 with scrape type 1
2026-03-27 13:34:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b42b867-791d-5f9c-b510-1f1288906c00 sending to next pipeline
2026-03-27 13:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b42b867-791d-5f9c-b510-1f1288906c00, identifier: 1987001
2026-03-27 13:34:19 [ayvens.es] INFO: Found listing with ID: 1987011
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987011%27 HTTP/1.1" 200 None
2026-03-27 13:34:19 [ayvens.es] INFO: Scrape type for 1987011: 1
2026-03-27 13:34:19 [ayvens.es] INFO: Extracting data for car ID: 1987011
2026-03-27 13:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebf729b0-a3d8-5daf-8036-b009321305a7 with identifier: 1987011
2026-03-27 13:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf729b0-a3d8-5daf-8036-b009321305a7 with scrape type 1
2026-03-27 13:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ebf729b0-a3d8-5daf-8036-b009321305a7
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F901%252Fa1ea5dcb42304cadbf31e1e154b06dce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/901/a1ea5dcb42304cadbf31e1e154b06dce/images/large/1.jpg not downloaded yet
2026-03-27 13:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b42b867-791d-5f9c-b510-1f1288906c00 with identifier: 1987001
2026-03-27 13:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b42b867-791d-5f9c-b510-1f1288906c00 with identifier: 1987001
2026-03-27 13:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b42b867-791d-5f9c-b510-1f1288906c00 with identifier: 1987001 to the API
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/800/8c3e9bbbe5f84306a44b7114941c5d9d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '9b42b867-791d-5f9c-b510-1f1288906c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 136402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42b867-791d-5f9c-b510-1f1288906c00/9b42b867-791d-5f9c-b510-1f1288906c00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/800/8c3e9bbbe5f84306a44b7114941c5d9d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 EcoTSI 70kW (95CV) Style',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI 70kW (95CV) Style',
 'vin': None,
 'year': 2018}
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987001%27 HTTP/1.1" 200 None
2026-03-27 13:34:19 [ayvens.es] INFO: Saving data for 1987001: {'created_time': 1774618459.928887, 'last_price_update_time': 1774618459.928897, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987001') HTTP/1.1" 204 0
2026-03-27 13:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/355/5a92eaba675440d0b0922eed1f4e68f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/598/30d2181020fc4572b710fd864a8b6c30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:19 [ayvens.es] INFO: Found listing with ID: 1987012
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987012%27 HTTP/1.1" 200 None
2026-03-27 13:34:19 [ayvens.es] INFO: Scrape type for 1987012: 1
2026-03-27 13:34:19 [ayvens.es] INFO: Extracting data for car ID: 1987012
2026-03-27 13:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with identifier: 1987012
2026-03-27 13:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with scrape type 1
2026-03-27 13:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98
2026-03-27 13:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F667%252F79e1b65a31bc485e86e5ca4769cfb12b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/667/79e1b65a31bc485e86e5ca4769cfb12b/images/large/1.jpg not downloaded yet
2026-03-27 13:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296318410>
2026-03-27 13:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa/aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252F4afa4601be7d4ea0bc3120cad1625a03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/4afa4601be7d4ea0bc3120cad1625a03/images/large/1.jpg saved to cache
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa
2026-03-27 13:34:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa, skipping ID generation
2026-03-27 13:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa with scrape type 1
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa sending to next pipeline
2026-03-27 13:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa, identifier: 1987002
2026-03-27 13:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529578ea50>
2026-03-27 13:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070e6ec1-7e71-5a61-ae79-ad6d59348ef5/070e6ec1-7e71-5a61-ae79-ad6d59348ef5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F812%252Fb54dec1b199a4fde860be9f33301ac3a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/812/b54dec1b199a4fde860be9f33301ac3a/images/large/1.jpg saved to cache
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 070e6ec1-7e71-5a61-ae79-ad6d59348ef5
2026-03-27 13:34:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 070e6ec1-7e71-5a61-ae79-ad6d59348ef5, skipping ID generation
2026-03-27 13:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070e6ec1-7e71-5a61-ae79-ad6d59348ef5 with scrape type 1
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 070e6ec1-7e71-5a61-ae79-ad6d59348ef5 sending to next pipeline
2026-03-27 13:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 070e6ec1-7e71-5a61-ae79-ad6d59348ef5, identifier: 1987003
2026-03-27 13:34:20 [ayvens.es] INFO: Found listing with ID: 1987013
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987013%27 HTTP/1.1" 200 None
2026-03-27 13:34:20 [ayvens.es] INFO: Scrape type for 1987013: 1
2026-03-27 13:34:20 [ayvens.es] INFO: Extracting data for car ID: 1987013
2026-03-27 13:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b658712-88f0-58c6-bbf6-2b9e5aded71b with identifier: 1987013
2026-03-27 13:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b with scrape type 1
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F458%252F40ed9531ed5c4cc796ca6b31d520e6f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/458/40ed9531ed5c4cc796ca6b31d520e6f8/images/large/1.jpg not downloaded yet
2026-03-27 13:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa with identifier: 1987002
2026-03-27 13:34:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa with identifier: 1987002
2026-03-27 13:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa with identifier: 1987002 to the API
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/819/4afa4601be7d4ea0bc3120cad1625a03/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Bi',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 164745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa/aff7ca22-4fb1-5a83-a1d1-1ac24d3ecdaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/819/4afa4601be7d4ea0bc3120cad1625a03/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 180H GR Sport',
 'transmission': 'manual',
 'trim': '2.0 180H GR Sport',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987002%27 HTTP/1.1" 200 None
2026-03-27 13:34:20 [ayvens.es] INFO: Saving data for 1987002: {'created_time': 1774618460.777308, 'last_price_update_time': 1774618460.777318, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987002') HTTP/1.1" 204 0
2026-03-27 13:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 070e6ec1-7e71-5a61-ae79-ad6d59348ef5 with identifier: 1987003
2026-03-27 13:34:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 070e6ec1-7e71-5a61-ae79-ad6d59348ef5 with identifier: 1987003
2026-03-27 13:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 070e6ec1-7e71-5a61-ae79-ad6d59348ef5 with identifier: 1987003 to the API
2026-03-27 13:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/812/b54dec1b199a4fde860be9f33301ac3a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '070e6ec1-7e71-5a61-ae79-ad6d59348ef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 204216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070e6ec1-7e71-5a61-ae79-ad6d59348ef5/070e6ec1-7e71-5a61-ae79-ad6d59348ef5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/812/b54dec1b199a4fde860be9f33301ac3a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '2.0 180H Advance',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987003%27 HTTP/1.1" 200 None
2026-03-27 13:34:21 [ayvens.es] INFO: Saving data for 1987003: {'created_time': 1774618461.210169, 'last_price_update_time': 1774618461.210179, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987003') HTTP/1.1" 204 0
2026-03-27 13:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/229/30be686fbdab4e818461a3b86ece4572/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/950/fb4cc5c64b5b45fb91a33ae08b8fe34a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/682/bd953096430248f2934d6192c9a7f93e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:21 [ayvens.es] INFO: Found listing with ID: 1987014
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987014%27 HTTP/1.1" 200 None
2026-03-27 13:34:21 [ayvens.es] INFO: Scrape type for 1987014: 1
2026-03-27 13:34:21 [ayvens.es] INFO: Extracting data for car ID: 1987014
2026-03-27 13:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with identifier: 1987014
2026-03-27 13:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with scrape type 1
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252F816dc0aa7ce04b029b378057c8690d63%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/816dc0aa7ce04b029b378057c8690d63/images/large/1.jpg not downloaded yet
2026-03-27 13:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963edf90>
2026-03-27 13:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a171f2-eccd-507f-852a-90afc9c2360f/83a171f2-eccd-507f-852a-90afc9c2360f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F355%252F5a92eaba675440d0b0922eed1f4e68f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/355/5a92eaba675440d0b0922eed1f4e68f5/images/large/1.jpg saved to cache
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83a171f2-eccd-507f-852a-90afc9c2360f
2026-03-27 13:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83a171f2-eccd-507f-852a-90afc9c2360f, skipping ID generation
2026-03-27 13:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a171f2-eccd-507f-852a-90afc9c2360f with scrape type 1
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83a171f2-eccd-507f-852a-90afc9c2360f sending to next pipeline
2026-03-27 13:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 83a171f2-eccd-507f-852a-90afc9c2360f, identifier: 1987004
2026-03-27 13:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f80cd0>
2026-03-27 13:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92b8a8b8-9014-5b4c-92ab-48c5156ba5a0/92b8a8b8-9014-5b4c-92ab-48c5156ba5a0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F598%252F30d2181020fc4572b710fd864a8b6c30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/598/30d2181020fc4572b710fd864a8b6c30/images/large/1.jpg saved to cache
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0
2026-03-27 13:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0, skipping ID generation
2026-03-27 13:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0 with scrape type 1
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0 sending to next pipeline
2026-03-27 13:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0, identifier: 1987005
2026-03-27 13:34:21 [ayvens.es] INFO: Found listing with ID: 1987015
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987015%27 HTTP/1.1" 200 None
2026-03-27 13:34:21 [ayvens.es] INFO: Scrape type for 1987015: 1
2026-03-27 13:34:21 [ayvens.es] INFO: Extracting data for car ID: 1987015
2026-03-27 13:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with identifier: 1987015
2026-03-27 13:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with scrape type 1
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F888%252F9586229f0e2f4952921d568886a2f316%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/888/9586229f0e2f4952921d568886a2f316/images/large/1.jpg not downloaded yet
2026-03-27 13:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 83a171f2-eccd-507f-852a-90afc9c2360f with identifier: 1987004
2026-03-27 13:34:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 83a171f2-eccd-507f-852a-90afc9c2360f with identifier: 1987004
2026-03-27 13:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 83a171f2-eccd-507f-852a-90afc9c2360f with identifier: 1987004 to the API
2026-03-27 13:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/355/5a92eaba675440d0b0922eed1f4e68f5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris urano',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '83a171f2-eccd-507f-852a-90afc9c2360f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 172780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a171f2-eccd-507f-852a-90afc9c2360f/83a171f2-eccd-507f-852a-90afc9c2360f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/355/5a92eaba675440d0b0922eed1f4e68f5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987004%27 HTTP/1.1" 200 None
2026-03-27 13:34:22 [ayvens.es] INFO: Saving data for 1987004: {'created_time': 1774618462.210201, 'last_price_update_time': 1774618462.210211, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987004') HTTP/1.1" 204 0
2026-03-27 13:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0 with identifier: 1987005
2026-03-27 13:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0 with identifier: 1987005
2026-03-27 13:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 92b8a8b8-9014-5b4c-92ab-48c5156ba5a0 with identifier: 1987005 to the API
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/598/30d2181020fc4572b710fd864a8b6c30/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '92b8a8b8-9014-5b4c-92ab-48c5156ba5a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 108538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92b8a8b8-9014-5b4c-92ab-48c5156ba5a0/92b8a8b8-9014-5b4c-92ab-48c5156ba5a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/598/30d2181020fc4572b710fd864a8b6c30/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 120H Business Plus',
 'transmission': 'manual',
 'trim': '1.5 120H Business Plus',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987005%27 HTTP/1.1" 200 None
2026-03-27 13:34:22 [ayvens.es] INFO: Saving data for 1987005: {'created_time': 1774618462.609418, 'last_price_update_time': 1774618462.609429, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987005') HTTP/1.1" 204 0
2026-03-27 13:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/968/72c68fa367124b8ea6d57cf2936c7d0e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:22 [ayvens.es] INFO: Found listing with ID: 1987016
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987016%27 HTTP/1.1" 200 None
2026-03-27 13:34:22 [ayvens.es] INFO: Scrape type for 1987016: 1
2026-03-27 13:34:22 [ayvens.es] INFO: Extracting data for car ID: 1987016
2026-03-27 13:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48b2eb63-919f-562f-9f2c-5509dea6465b with identifier: 1987016
2026-03-27 13:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b2eb63-919f-562f-9f2c-5509dea6465b with scrape type 1
2026-03-27 13:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 48b2eb63-919f-562f-9f2c-5509dea6465b
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F892%252F80e3950b772e429a80aa2017fec5cfaf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/892/80e3950b772e429a80aa2017fec5cfaf/images/large/1.jpg not downloaded yet
2026-03-27 13:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/090/8a58f749a1354c94b243068e76929155/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295721690>
2026-03-27 13:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e68d2a3-c359-5e0f-8631-4c741b8f03f7/3e68d2a3-c359-5e0f-8631-4c741b8f03f7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F229%252F30be686fbdab4e818461a3b86ece4572%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/229/30be686fbdab4e818461a3b86ece4572/images/large/1.jpg saved to cache
2026-03-27 13:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e68d2a3-c359-5e0f-8631-4c741b8f03f7
2026-03-27 13:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e68d2a3-c359-5e0f-8631-4c741b8f03f7, skipping ID generation
2026-03-27 13:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e68d2a3-c359-5e0f-8631-4c741b8f03f7 with scrape type 1
2026-03-27 13:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e68d2a3-c359-5e0f-8631-4c741b8f03f7 sending to next pipeline
2026-03-27 13:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e68d2a3-c359-5e0f-8631-4c741b8f03f7, identifier: 1987006
2026-03-27 13:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529672cf50>
2026-03-27 13:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6/f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F950%252Ffb4cc5c64b5b45fb91a33ae08b8fe34a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/950/fb4cc5c64b5b45fb91a33ae08b8fe34a/images/large/1.jpg saved to cache
2026-03-27 13:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6
2026-03-27 13:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6, skipping ID generation
2026-03-27 13:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with scrape type 1
2026-03-27 13:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 sending to next pipeline
2026-03-27 13:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6, identifier: 1987008
2026-03-27 13:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bcd910>
2026-03-27 13:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2369b4db-70cd-5be8-95dd-d21e6a3e046d/2369b4db-70cd-5be8-95dd-d21e6a3e046d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252Fbd953096430248f2934d6192c9a7f93e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/bd953096430248f2934d6192c9a7f93e/images/large/1.jpg saved to cache
2026-03-27 13:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d
2026-03-27 13:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2369b4db-70cd-5be8-95dd-d21e6a3e046d, skipping ID generation
2026-03-27 13:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d with scrape type 1
2026-03-27 13:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d sending to next pipeline
2026-03-27 13:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2369b4db-70cd-5be8-95dd-d21e6a3e046d, identifier: 1987007
2026-03-27 13:34:23 [ayvens.es] INFO: Found listing with ID: 1987017
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987017%27 HTTP/1.1" 200 None
2026-03-27 13:34:23 [ayvens.es] INFO: Scrape type for 1987017: 1
2026-03-27 13:34:23 [ayvens.es] INFO: Extracting data for car ID: 1987017
2026-03-27 13:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0bd45df-da94-5501-a30f-c2e10a76ffaa with identifier: 1987017
2026-03-27 13:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0bd45df-da94-5501-a30f-c2e10a76ffaa with scrape type 1
2026-03-27 13:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b0bd45df-da94-5501-a30f-c2e10a76ffaa
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252Fe82c3f617295499cbd0fc05e5f186009%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/e82c3f617295499cbd0fc05e5f186009/images/large/1.jpg not downloaded yet
2026-03-27 13:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e68d2a3-c359-5e0f-8631-4c741b8f03f7 with identifier: 1987006
2026-03-27 13:34:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e68d2a3-c359-5e0f-8631-4c741b8f03f7 with identifier: 1987006
2026-03-27 13:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e68d2a3-c359-5e0f-8631-4c741b8f03f7 with identifier: 1987006 to the API
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/229/30be686fbdab4e818461a3b86ece4572/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Azul ravenna',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e68d2a3-c359-5e0f-8631-4c741b8f03f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 133597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e68d2a3-c359-5e0f-8631-4c741b8f03f7/3e68d2a3-c359-5e0f-8631-4c741b8f03f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/229/30be686fbdab4e818461a3b86ece4572/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Life 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2023}
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987006%27 HTTP/1.1" 200 None
2026-03-27 13:34:23 [ayvens.es] INFO: Saving data for 1987006: {'created_time': 1774618463.711658, 'last_price_update_time': 1774618463.711668, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987006') HTTP/1.1" 204 0
2026-03-27 13:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with identifier: 1987008
2026-03-27 13:34:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with identifier: 1987008
2026-03-27 13:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with identifier: 1987008 to the API
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/950/fb4cc5c64b5b45fb91a33ae08b8fe34a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Deluxe white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 90752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6/f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/950/fb4cc5c64b5b45fb91a33ae08b8fe34a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 CRDi 85kW (115CV) Concept 4x2',
 'transmission': 'manual',
 'trim': '1.6 CRDi 85kW (115CV) Concept 4x2',
 'vin': None,
 'year': 2023}
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987008%27 HTTP/1.1" 200 None
2026-03-27 13:34:24 [ayvens.es] INFO: Saving data for 1987008: {'created_time': 1774618464.045076, 'last_price_update_time': 1774618464.045089, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987008') HTTP/1.1" 204 0
2026-03-27 13:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2369b4db-70cd-5be8-95dd-d21e6a3e046d with identifier: 1987007
2026-03-27 13:34:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2369b4db-70cd-5be8-95dd-d21e6a3e046d with identifier: 1987007
2026-03-27 13:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2369b4db-70cd-5be8-95dd-d21e6a3e046d with identifier: 1987007 to the API
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/682/bd953096430248f2934d6192c9a7f93e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2369b4db-70cd-5be8-95dd-d21e6a3e046d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 113373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2369b4db-70cd-5be8-95dd-d21e6a3e046d/2369b4db-70cd-5be8-95dd-d21e6a3e046d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/682/bd953096430248f2934d6192c9a7f93e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER SPORT 3.0D I6 183kW MHEV S AWD Auto.',
 'transmission': 'manual',
 'trim': '3.0D I6 183kW MHEV S AWD Auto.',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987007%27 HTTP/1.1" 200 None
2026-03-27 13:34:24 [ayvens.es] INFO: Saving data for 1987007: {'created_time': 1774618464.382866, 'last_price_update_time': 1774618464.382875, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987007') HTTP/1.1" 204 0
2026-03-27 13:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/901/a1ea5dcb42304cadbf31e1e154b06dce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:24 [ayvens.es] INFO: Found listing with ID: 1987018
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987018%27 HTTP/1.1" 200 None
2026-03-27 13:34:24 [ayvens.es] INFO: Scrape type for 1987018: 1
2026-03-27 13:34:24 [ayvens.es] INFO: Extracting data for car ID: 1987018
2026-03-27 13:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with identifier: 1987018
2026-03-27 13:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with scrape type 1
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252F5ab8580212a74f50bf39587f0572bc9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/5ab8580212a74f50bf39587f0572bc9c/images/large/1.jpg not downloaded yet
2026-03-27 13:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0ebd0>
2026-03-27 13:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d2ef966-b23f-5cf2-b8e3-afe1ff211175/4d2ef966-b23f-5cf2-b8e3-afe1ff211175_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F968%252F72c68fa367124b8ea6d57cf2936c7d0e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/968/72c68fa367124b8ea6d57cf2936c7d0e/images/large/1.jpg saved to cache
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175
2026-03-27 13:34:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175, skipping ID generation
2026-03-27 13:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with scrape type 1
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 sending to next pipeline
2026-03-27 13:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175, identifier: 1987010
2026-03-27 13:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fa8250>
2026-03-27 13:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff25eaed-a37a-57f5-b715-663021df30f2/ff25eaed-a37a-57f5-b715-663021df30f2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F090%252F8a58f749a1354c94b243068e76929155%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/090/8a58f749a1354c94b243068e76929155/images/large/1.jpg saved to cache
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff25eaed-a37a-57f5-b715-663021df30f2
2026-03-27 13:34:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff25eaed-a37a-57f5-b715-663021df30f2, skipping ID generation
2026-03-27 13:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff25eaed-a37a-57f5-b715-663021df30f2 with scrape type 1
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff25eaed-a37a-57f5-b715-663021df30f2 sending to next pipeline
2026-03-27 13:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff25eaed-a37a-57f5-b715-663021df30f2, identifier: 1987009
2026-03-27 13:34:24 [ayvens.es] INFO: Found listing with ID: 1987019
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987019%27 HTTP/1.1" 200 None
2026-03-27 13:34:24 [ayvens.es] INFO: Scrape type for 1987019: 1
2026-03-27 13:34:24 [ayvens.es] INFO: Extracting data for car ID: 1987019
2026-03-27 13:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 797c61a0-3302-51ce-b650-3065a2d624f3 with identifier: 1987019
2026-03-27 13:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 797c61a0-3302-51ce-b650-3065a2d624f3 with scrape type 1
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 797c61a0-3302-51ce-b650-3065a2d624f3
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F822%252F8adc9f3da19b4b93b02083e3b1ab28ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/822/8adc9f3da19b4b93b02083e3b1ab28ff/images/large/1.jpg not downloaded yet
2026-03-27 13:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with identifier: 1987010
2026-03-27 13:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with identifier: 1987010
2026-03-27 13:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with identifier: 1987010 to the API
2026-03-27 13:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/968/72c68fa367124b8ea6d57cf2936c7d0e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '4d2ef966-b23f-5cf2-b8e3-afe1ff211175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 61685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d2ef966-b23f-5cf2-b8e3-afe1ff211175/4d2ef966-b23f-5cf2-b8e3-afe1ff211175_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/968/72c68fa367124b8ea6d57cf2936c7d0e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'transmission': 'manual',
 'trim': 'IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987010%27 HTTP/1.1" 200 None
2026-03-27 13:34:25 [ayvens.es] INFO: Saving data for 1987010: {'created_time': 1774618465.140667, 'last_price_update_time': 1774618465.140678, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987010') HTTP/1.1" 204 0
2026-03-27 13:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff25eaed-a37a-57f5-b715-663021df30f2 with identifier: 1987009
2026-03-27 13:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff25eaed-a37a-57f5-b715-663021df30f2 with identifier: 1987009
2026-03-27 13:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ff25eaed-a37a-57f5-b715-663021df30f2 with identifier: 1987009 to the API
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/090/8a58f749a1354c94b243068e76929155/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff25eaed-a37a-57f5-b715-663021df30f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 137153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff25eaed-a37a-57f5-b715-663021df30f2/ff25eaed-a37a-57f5-b715-663021df30f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/090/8a58f749a1354c94b243068e76929155/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT (O) Furgon Pro 2.0 BlueHDi 90KW (120CV)',
 'transmission': 'manual',
 'trim': '(O) Furgon Pro 2.0 BlueHDi 90KW (120CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987009%27 HTTP/1.1" 200 None
2026-03-27 13:34:25 [ayvens.es] INFO: Saving data for 1987009: {'created_time': 1774618465.457057, 'last_price_update_time': 1774618465.457066, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987009') HTTP/1.1" 204 0
2026-03-27 13:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/378/816dc0aa7ce04b029b378057c8690d63/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/458/40ed9531ed5c4cc796ca6b31d520e6f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:25 [ayvens.es] INFO: Found listing with ID: 1987020
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987020%27 HTTP/1.1" 200 None
2026-03-27 13:34:25 [ayvens.es] INFO: Scrape type for 1987020: 1
2026-03-27 13:34:25 [ayvens.es] INFO: Extracting data for car ID: 1987020
2026-03-27 13:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a31edcb3-f343-5488-ba8b-ecbfdf41f9da with identifier: 1987020
2026-03-27 13:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da with scrape type 1
2026-03-27 13:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252F6ec433e6760f4934955cf3a67326be36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/6ec433e6760f4934955cf3a67326be36/images/large/1.jpg not downloaded yet
2026-03-27 13:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/667/79e1b65a31bc485e86e5ca4769cfb12b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0d650>
2026-03-27 13:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf729b0-a3d8-5daf-8036-b009321305a7/ebf729b0-a3d8-5daf-8036-b009321305a7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F901%252Fa1ea5dcb42304cadbf31e1e154b06dce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/901/a1ea5dcb42304cadbf31e1e154b06dce/images/large/1.jpg saved to cache
2026-03-27 13:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebf729b0-a3d8-5daf-8036-b009321305a7
2026-03-27 13:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebf729b0-a3d8-5daf-8036-b009321305a7, skipping ID generation
2026-03-27 13:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf729b0-a3d8-5daf-8036-b009321305a7 with scrape type 1
2026-03-27 13:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebf729b0-a3d8-5daf-8036-b009321305a7 sending to next pipeline
2026-03-27 13:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ebf729b0-a3d8-5daf-8036-b009321305a7, identifier: 1987011
2026-03-27 13:34:25 [ayvens.es] INFO: Found listing with ID: 1987021
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987021%27 HTTP/1.1" 200 None
2026-03-27 13:34:25 [ayvens.es] INFO: Scrape type for 1987021: 1
2026-03-27 13:34:25 [ayvens.es] INFO: Extracting data for car ID: 1987021
2026-03-27 13:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ea5495-2955-5d98-900a-36cd6fda0cea with identifier: 1987021
2026-03-27 13:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ea5495-2955-5d98-900a-36cd6fda0cea with scrape type 1
2026-03-27 13:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 00ea5495-2955-5d98-900a-36cd6fda0cea
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F397%252Fd4bd2605247545158de1fd09bcfc385b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/397/d4bd2605247545158de1fd09bcfc385b/images/large/1.jpg not downloaded yet
2026-03-27 13:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ebf729b0-a3d8-5daf-8036-b009321305a7 with identifier: 1987011
2026-03-27 13:34:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ebf729b0-a3d8-5daf-8036-b009321305a7 with identifier: 1987011
2026-03-27 13:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ebf729b0-a3d8-5daf-8036-b009321305a7 with identifier: 1987011 to the API
2026-03-27 13:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/901/a1ea5dcb42304cadbf31e1e154b06dce/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Azul encre',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ebf729b0-a3d8-5daf-8036-b009321305a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 125828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf729b0-a3d8-5daf-8036-b009321305a7/ebf729b0-a3d8-5daf-8036-b009321305a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/901/a1ea5dcb42304cadbf31e1e154b06dce/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987011%27 HTTP/1.1" 200 None
2026-03-27 13:34:26 [ayvens.es] INFO: Saving data for 1987011: {'created_time': 1774618466.115137, 'last_price_update_time': 1774618466.115149, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987011') HTTP/1.1" 204 0
2026-03-27 13:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/892/80e3950b772e429a80aa2017fec5cfaf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/888/9586229f0e2f4952921d568886a2f316/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:26 [ayvens.es] INFO: Found listing with ID: 1987022
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987022%27 HTTP/1.1" 200 None
2026-03-27 13:34:26 [ayvens.es] INFO: Scrape type for 1987022: 1
2026-03-27 13:34:26 [ayvens.es] INFO: Extracting data for car ID: 1987022
2026-03-27 13:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1022b21-2f9a-549a-b14a-03d58836858d with identifier: 1987022
2026-03-27 13:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1022b21-2f9a-549a-b14a-03d58836858d with scrape type 1
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1022b21-2f9a-549a-b14a-03d58836858d
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fad8908b4c0224818b0118ecfa0e3b2cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/ad8908b4c0224818b0118ecfa0e3b2cf/images/large/1.jpg not downloaded yet
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296719150>
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cbe8183-4ca8-5dee-8685-9317eeaaf573/0cbe8183-4ca8-5dee-8685-9317eeaaf573_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252F816dc0aa7ce04b029b378057c8690d63%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/816dc0aa7ce04b029b378057c8690d63/images/large/1.jpg saved to cache
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573
2026-03-27 13:34:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cbe8183-4ca8-5dee-8685-9317eeaaf573, skipping ID generation
2026-03-27 13:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with scrape type 1
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573 sending to next pipeline
2026-03-27 13:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0cbe8183-4ca8-5dee-8685-9317eeaaf573, identifier: 1987014
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bcd190>
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b658712-88f0-58c6-bbf6-2b9e5aded71b/9b658712-88f0-58c6-bbf6-2b9e5aded71b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F458%252F40ed9531ed5c4cc796ca6b31d520e6f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/458/40ed9531ed5c4cc796ca6b31d520e6f8/images/large/1.jpg saved to cache
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b
2026-03-27 13:34:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b658712-88f0-58c6-bbf6-2b9e5aded71b, skipping ID generation
2026-03-27 13:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b with scrape type 1
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b sending to next pipeline
2026-03-27 13:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b658712-88f0-58c6-bbf6-2b9e5aded71b, identifier: 1987013
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961e81d0>
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fba89a-6e89-532c-9e73-e1dd8b5b9d98/c9fba89a-6e89-532c-9e73-e1dd8b5b9d98_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F667%252F79e1b65a31bc485e86e5ca4769cfb12b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/667/79e1b65a31bc485e86e5ca4769cfb12b/images/large/1.jpg saved to cache
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98
2026-03-27 13:34:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98, skipping ID generation
2026-03-27 13:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with scrape type 1
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 sending to next pipeline
2026-03-27 13:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98, identifier: 1987012
2026-03-27 13:34:26 [ayvens.es] INFO: Found listing with ID: 1987023
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987023%27 HTTP/1.1" 200 None
2026-03-27 13:34:26 [ayvens.es] INFO: Scrape type for 1987023: 1
2026-03-27 13:34:26 [ayvens.es] INFO: Extracting data for car ID: 1987023
2026-03-27 13:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e69dc82-b2e4-576f-9a7d-50d485046f2c with identifier: 1987023
2026-03-27 13:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c with scrape type 1
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F883%252F8b5ca6d5a99245f58404fa02ac8372b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/883/8b5ca6d5a99245f58404fa02ac8372b1/images/large/1.jpg not downloaded yet
2026-03-27 13:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with identifier: 1987014
2026-03-27 13:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with identifier: 1987014
2026-03-27 13:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with identifier: 1987014 to the API
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/378/816dc0aa7ce04b029b378057c8690d63/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0cbe8183-4ca8-5dee-8685-9317eeaaf573',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 148879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbe8183-4ca8-5dee-8685-9317eeaaf573/0cbe8183-4ca8-5dee-8685-9317eeaaf573_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/378/816dc0aa7ce04b029b378057c8690d63/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Allure BlueHDI 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'Allure BlueHDI 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987014%27 HTTP/1.1" 200 None
2026-03-27 13:34:27 [ayvens.es] INFO: Saving data for 1987014: {'created_time': 1774618467.278742, 'last_price_update_time': 1774618467.278755, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987014') HTTP/1.1" 204 0
2026-03-27 13:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b658712-88f0-58c6-bbf6-2b9e5aded71b with identifier: 1987013
2026-03-27 13:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b658712-88f0-58c6-bbf6-2b9e5aded71b with identifier: 1987013
2026-03-27 13:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b658712-88f0-58c6-bbf6-2b9e5aded71b with identifier: 1987013 to the API
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/458/40ed9531ed5c4cc796ca6b31d520e6f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9b658712-88f0-58c6-bbf6-2b9e5aded71b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 98874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b658712-88f0-58c6-bbf6-2b9e5aded71b/9b658712-88f0-58c6-bbf6-2b9e5aded71b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/458/40ed9531ed5c4cc796ca6b31d520e6f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 200 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 200 d 4MATIC',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987013%27 HTTP/1.1" 200 None
2026-03-27 13:34:27 [ayvens.es] INFO: Saving data for 1987013: {'created_time': 1774618467.582516, 'last_price_update_time': 1774618467.58253, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987013') HTTP/1.1" 204 0
2026-03-27 13:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with identifier: 1987012
2026-03-27 13:34:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with identifier: 1987012
2026-03-27 13:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with identifier: 1987012 to the API
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/667/79e1b65a31bc485e86e5ca4769cfb12b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Narvik black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c9fba89a-6e89-532c-9e73-e1dd8b5b9d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 95867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fba89a-6e89-532c-9e73-e1dd8b5b9d98/c9fba89a-6e89-532c-9e73-e1dd8b5b9d98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/667/79e1b65a31bc485e86e5ca4769cfb12b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D150 S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D150 S AUTO 4WD MHEV',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987012%27 HTTP/1.1" 200 None
2026-03-27 13:34:27 [ayvens.es] INFO: Saving data for 1987012: {'created_time': 1774618467.904613, 'last_price_update_time': 1774618467.904624, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987012') HTTP/1.1" 204 0
2026-03-27 13:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/148/e82c3f617295499cbd0fc05e5f186009/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/722/5ab8580212a74f50bf39587f0572bc9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:27 [ayvens.es] INFO: Found listing with ID: 1987024
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987024%27 HTTP/1.1" 200 None
2026-03-27 13:34:27 [ayvens.es] INFO: Scrape type for 1987024: 1
2026-03-27 13:34:27 [ayvens.es] INFO: Extracting data for car ID: 1987024
2026-03-27 13:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with identifier: 1987024
2026-03-27 13:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with scrape type 1
2026-03-27 13:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65
2026-03-27 13:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F228%252Ff18a2e1aa6d949a2b02fdd0580cdfd55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/228/f18a2e1aa6d949a2b02fdd0580cdfd55/images/large/1.jpg not downloaded yet
2026-03-27 13:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f5dc90>
2026-03-27 13:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2eb63-919f-562f-9f2c-5509dea6465b/48b2eb63-919f-562f-9f2c-5509dea6465b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F892%252F80e3950b772e429a80aa2017fec5cfaf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/892/80e3950b772e429a80aa2017fec5cfaf/images/large/1.jpg saved to cache
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48b2eb63-919f-562f-9f2c-5509dea6465b
2026-03-27 13:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48b2eb63-919f-562f-9f2c-5509dea6465b, skipping ID generation
2026-03-27 13:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b2eb63-919f-562f-9f2c-5509dea6465b with scrape type 1
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48b2eb63-919f-562f-9f2c-5509dea6465b sending to next pipeline
2026-03-27 13:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 48b2eb63-919f-562f-9f2c-5509dea6465b, identifier: 1987016
2026-03-27 13:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945cad90>
2026-03-27 13:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f42b8a6-f092-5e85-82f9-20b5f25ca30a/5f42b8a6-f092-5e85-82f9-20b5f25ca30a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F888%252F9586229f0e2f4952921d568886a2f316%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/888/9586229f0e2f4952921d568886a2f316/images/large/1.jpg saved to cache
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a
2026-03-27 13:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a, skipping ID generation
2026-03-27 13:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with scrape type 1
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a sending to next pipeline
2026-03-27 13:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a, identifier: 1987015
2026-03-27 13:34:28 [ayvens.es] INFO: Found listing with ID: 1987025
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987025%27 HTTP/1.1" 200 None
2026-03-27 13:34:28 [ayvens.es] INFO: Scrape type for 1987025: 1
2026-03-27 13:34:28 [ayvens.es] INFO: Extracting data for car ID: 1987025
2026-03-27 13:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with identifier: 1987025
2026-03-27 13:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with scrape type 1
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F643%252Fd971cb8bdbb3429fb7924950eb540dc5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/643/d971cb8bdbb3429fb7924950eb540dc5/images/large/1.jpg not downloaded yet
2026-03-27 13:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 48b2eb63-919f-562f-9f2c-5509dea6465b with identifier: 1987016
2026-03-27 13:34:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 48b2eb63-919f-562f-9f2c-5509dea6465b with identifier: 1987016
2026-03-27 13:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 48b2eb63-919f-562f-9f2c-5509dea6465b with identifier: 1987016 to the API
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/892/80e3950b772e429a80aa2017fec5cfaf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '48b2eb63-919f-562f-9f2c-5509dea6465b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 81611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2eb63-919f-562f-9f2c-5509dea6465b/48b2eb63-919f-562f-9f2c-5509dea6465b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/892/80e3950b772e429a80aa2017fec5cfaf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18dA Corporate',
 'transmission': 'manual',
 'trim': 'sDrive18dA Corporate',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987016%27 HTTP/1.1" 200 None
2026-03-27 13:34:28 [ayvens.es] INFO: Saving data for 1987016: {'created_time': 1774618468.781463, 'last_price_update_time': 1774618468.781474, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987016') HTTP/1.1" 204 0
2026-03-27 13:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with identifier: 1987015
2026-03-27 13:34:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with identifier: 1987015
2026-03-27 13:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with identifier: 1987015 to the API
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/888/9586229f0e2f4952921d568886a2f316/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f42b8a6-f092-5e85-82f9-20b5f25ca30a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 70462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f42b8a6-f092-5e85-82f9-20b5f25ca30a/5f42b8a6-f092-5e85-82f9-20b5f25ca30a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/888/9586229f0e2f4952921d568886a2f316/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987015%27 HTTP/1.1" 200 None
2026-03-27 13:34:29 [ayvens.es] INFO: Saving data for 1987015: {'created_time': 1774618469.097948, 'last_price_update_time': 1774618469.097958, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987015') HTTP/1.1" 204 0
2026-03-27 13:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/753/6ec433e6760f4934955cf3a67326be36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:29 [ayvens.es] INFO: Found listing with ID: 1987026
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987026%27 HTTP/1.1" 200 None
2026-03-27 13:34:29 [ayvens.es] INFO: Scrape type for 1987026: 1
2026-03-27 13:34:29 [ayvens.es] INFO: Extracting data for car ID: 1987026
2026-03-27 13:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c26b163e-d808-526a-977a-d366dc10dbfc with identifier: 1987026
2026-03-27 13:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26b163e-d808-526a-977a-d366dc10dbfc with scrape type 1
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c26b163e-d808-526a-977a-d366dc10dbfc
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F190%252F6a8bf37048e94dffbc137f0b2ab1e14c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/190/6a8bf37048e94dffbc137f0b2ab1e14c/images/large/1.jpg not downloaded yet
2026-03-27 13:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f5f050>
2026-03-27 13:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0bd45df-da94-5501-a30f-c2e10a76ffaa/b0bd45df-da94-5501-a30f-c2e10a76ffaa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252Fe82c3f617295499cbd0fc05e5f186009%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/e82c3f617295499cbd0fc05e5f186009/images/large/1.jpg saved to cache
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0bd45df-da94-5501-a30f-c2e10a76ffaa
2026-03-27 13:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0bd45df-da94-5501-a30f-c2e10a76ffaa, skipping ID generation
2026-03-27 13:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0bd45df-da94-5501-a30f-c2e10a76ffaa with scrape type 1
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0bd45df-da94-5501-a30f-c2e10a76ffaa sending to next pipeline
2026-03-27 13:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b0bd45df-da94-5501-a30f-c2e10a76ffaa, identifier: 1987017
2026-03-27 13:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4f0d0>
2026-03-27 13:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca1f7b2-56ea-5681-9ee0-d0bc93c45442/9ca1f7b2-56ea-5681-9ee0-d0bc93c45442_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252F5ab8580212a74f50bf39587f0572bc9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/5ab8580212a74f50bf39587f0572bc9c/images/large/1.jpg saved to cache
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442
2026-03-27 13:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442, skipping ID generation
2026-03-27 13:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with scrape type 1
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 sending to next pipeline
2026-03-27 13:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442, identifier: 1987018
2026-03-27 13:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/822/8adc9f3da19b4b93b02083e3b1ab28ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:29 [ayvens.es] INFO: Found listing with ID: 1987027
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987027%27 HTTP/1.1" 200 None
2026-03-27 13:34:29 [ayvens.es] INFO: Scrape type for 1987027: 1
2026-03-27 13:34:29 [ayvens.es] INFO: Extracting data for car ID: 1987027
2026-03-27 13:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137f8a31-f6c2-5462-9b54-5e6e7b187518 with identifier: 1987027
2026-03-27 13:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137f8a31-f6c2-5462-9b54-5e6e7b187518 with scrape type 1
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 137f8a31-f6c2-5462-9b54-5e6e7b187518
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252F7f80780e5b224fb198e8ca70b62621e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/7f80780e5b224fb198e8ca70b62621e5/images/large/1.jpg not downloaded yet
2026-03-27 13:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b0bd45df-da94-5501-a30f-c2e10a76ffaa with identifier: 1987017
2026-03-27 13:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b0bd45df-da94-5501-a30f-c2e10a76ffaa with identifier: 1987017
2026-03-27 13:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b0bd45df-da94-5501-a30f-c2e10a76ffaa with identifier: 1987017 to the API
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/148/e82c3f617295499cbd0fc05e5f186009/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b0bd45df-da94-5501-a30f-c2e10a76ffaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7',
 'odometer': 39212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0bd45df-da94-5501-a30f-c2e10a76ffaa/b0bd45df-da94-5501-a30f-c2e10a76ffaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/e82c3f617295499cbd0fc05e5f186009/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 BlueHDi 130 Automatico PERFORMANCE LINE',
 'transmission': 'manual',
 'trim': 'BlueHDi 130 Automatico PERFORMANCE LINE',
 'vin': None,
 'year': 2024}
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987017%27 HTTP/1.1" 200 None
2026-03-27 13:34:29 [ayvens.es] INFO: Saving data for 1987017: {'created_time': 1774618469.853464, 'last_price_update_time': 1774618469.853474, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987017') HTTP/1.1" 204 0
2026-03-27 13:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with identifier: 1987018
2026-03-27 13:34:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with identifier: 1987018
2026-03-27 13:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with identifier: 1987018 to the API
2026-03-27 13:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/722/5ab8580212a74f50bf39587f0572bc9c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Signal red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '9ca1f7b2-56ea-5681-9ee0-d0bc93c45442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 54722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca1f7b2-56ea-5681-9ee0-d0bc93c45442/9ca1f7b2-56ea-5681-9ee0-d0bc93c45442_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/722/5ab8580212a74f50bf39587f0572bc9c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.2 DPi 62kW (84CV) Concept',
 'transmission': 'manual',
 'trim': '1.2 DPi 62kW (84CV) Concept',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987018%27 HTTP/1.1" 200 None
2026-03-27 13:34:30 [ayvens.es] INFO: Saving data for 1987018: {'created_time': 1774618470.985722, 'last_price_update_time': 1774618470.985733, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987018') HTTP/1.1" 204 0
2026-03-27 13:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/425/ad8908b4c0224818b0118ecfa0e3b2cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:31 [ayvens.es] INFO: Found listing with ID: 1987028
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987028%27 HTTP/1.1" 200 None
2026-03-27 13:34:31 [ayvens.es] INFO: Scrape type for 1987028: 1
2026-03-27 13:34:31 [ayvens.es] INFO: Extracting data for car ID: 1987028
2026-03-27 13:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with identifier: 1987028
2026-03-27 13:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with scrape type 1
2026-03-27 13:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F159%252Fc61549c73e2a468b82abc835d853e23c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/159/c61549c73e2a468b82abc835d853e23c/images/large/1.jpg not downloaded yet
2026-03-27 13:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296096690>
2026-03-27 13:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31edcb3-f343-5488-ba8b-ecbfdf41f9da/a31edcb3-f343-5488-ba8b-ecbfdf41f9da_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252F6ec433e6760f4934955cf3a67326be36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/6ec433e6760f4934955cf3a67326be36/images/large/1.jpg saved to cache
2026-03-27 13:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da
2026-03-27 13:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a31edcb3-f343-5488-ba8b-ecbfdf41f9da, skipping ID generation
2026-03-27 13:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da with scrape type 1
2026-03-27 13:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da sending to next pipeline
2026-03-27 13:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a31edcb3-f343-5488-ba8b-ecbfdf41f9da, identifier: 1987020
2026-03-27 13:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a31edcb3-f343-5488-ba8b-ecbfdf41f9da with identifier: 1987020
2026-03-27 13:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a31edcb3-f343-5488-ba8b-ecbfdf41f9da with identifier: 1987020
2026-03-27 13:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a31edcb3-f343-5488-ba8b-ecbfdf41f9da with identifier: 1987020 to the API
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/753/6ec433e6760f4934955cf3a67326be36/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a31edcb3-f343-5488-ba8b-ecbfdf41f9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q8',
 'odometer': 135542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31edcb3-f343-5488-ba8b-ecbfdf41f9da/a31edcb3-f343-5488-ba8b-ecbfdf41f9da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/753/6ec433e6760f4934955cf3a67326be36/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q8 50 TDI 210kW (286CV) quattro tiptronic',
 'transmission': 'manual',
 'trim': '50 TDI 210kW (286CV) quattro tiptronic',
 'vin': None,
 'year': 2018}
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987020%27 HTTP/1.1" 200 None
2026-03-27 13:34:32 [ayvens.es] INFO: Saving data for 1987020: {'created_time': 1774618472.065185, 'last_price_update_time': 1774618472.065195, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987020') HTTP/1.1" 204 0
2026-03-27 13:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bdf550>
2026-03-27 13:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_797c61a0-3302-51ce-b650-3065a2d624f3/797c61a0-3302-51ce-b650-3065a2d624f3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F822%252F8adc9f3da19b4b93b02083e3b1ab28ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/822/8adc9f3da19b4b93b02083e3b1ab28ff/images/large/1.jpg saved to cache
2026-03-27 13:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 797c61a0-3302-51ce-b650-3065a2d624f3
2026-03-27 13:34:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 797c61a0-3302-51ce-b650-3065a2d624f3, skipping ID generation
2026-03-27 13:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 797c61a0-3302-51ce-b650-3065a2d624f3 with scrape type 1
2026-03-27 13:34:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 797c61a0-3302-51ce-b650-3065a2d624f3 sending to next pipeline
2026-03-27 13:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 797c61a0-3302-51ce-b650-3065a2d624f3, identifier: 1987019
2026-03-27 13:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/397/d4bd2605247545158de1fd09bcfc385b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:32 [ayvens.es] INFO: Found listing with ID: 1987029
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987029%27 HTTP/1.1" 200 None
2026-03-27 13:34:32 [ayvens.es] INFO: Scrape type for 1987029: 1
2026-03-27 13:34:32 [ayvens.es] INFO: Extracting data for car ID: 1987029
2026-03-27 13:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a5add81-0576-58bd-bd54-373c60b9f22f with identifier: 1987029
2026-03-27 13:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a5add81-0576-58bd-bd54-373c60b9f22f with scrape type 1
2026-03-27 13:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a5add81-0576-58bd-bd54-373c60b9f22f
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252Feea699a079c24665a33889f801f34e11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/eea699a079c24665a33889f801f34e11/images/large/1.jpg not downloaded yet
2026-03-27 13:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 797c61a0-3302-51ce-b650-3065a2d624f3 with identifier: 1987019
2026-03-27 13:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 797c61a0-3302-51ce-b650-3065a2d624f3 with identifier: 1987019
2026-03-27 13:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 797c61a0-3302-51ce-b650-3065a2d624f3 with identifier: 1987019 to the API
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/822/8adc9f3da19b4b93b02083e3b1ab28ff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '797c61a0-3302-51ce-b650-3065a2d624f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 117468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_797c61a0-3302-51ce-b650-3065a2d624f3/797c61a0-3302-51ce-b650-3065a2d624f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/822/8adc9f3da19b4b93b02083e3b1ab28ff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987019%27 HTTP/1.1" 200 None
2026-03-27 13:34:32 [ayvens.es] INFO: Saving data for 1987019: {'created_time': 1774618472.940441, 'last_price_update_time': 1774618472.940451, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987019') HTTP/1.1" 204 0
2026-03-27 13:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/883/8b5ca6d5a99245f58404fa02ac8372b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529640a950>
2026-03-27 13:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1022b21-2f9a-549a-b14a-03d58836858d/e1022b21-2f9a-549a-b14a-03d58836858d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fad8908b4c0224818b0118ecfa0e3b2cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/ad8908b4c0224818b0118ecfa0e3b2cf/images/large/1.jpg saved to cache
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1022b21-2f9a-549a-b14a-03d58836858d
2026-03-27 13:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1022b21-2f9a-549a-b14a-03d58836858d, skipping ID generation
2026-03-27 13:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1022b21-2f9a-549a-b14a-03d58836858d with scrape type 1
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1022b21-2f9a-549a-b14a-03d58836858d sending to next pipeline
2026-03-27 13:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e1022b21-2f9a-549a-b14a-03d58836858d, identifier: 1987022
2026-03-27 13:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/228/f18a2e1aa6d949a2b02fdd0580cdfd55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:33 [ayvens.es] INFO: Found listing with ID: 1987030
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987030%27 HTTP/1.1" 200 None
2026-03-27 13:34:33 [ayvens.es] INFO: Scrape type for 1987030: 1
2026-03-27 13:34:33 [ayvens.es] INFO: Extracting data for car ID: 1987030
2026-03-27 13:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a5e38c-6a6f-5139-8d3e-1642ed893514 with identifier: 1987030
2026-03-27 13:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a5e38c-6a6f-5139-8d3e-1642ed893514 with scrape type 1
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99a5e38c-6a6f-5139-8d3e-1642ed893514
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F956%252Ff3616e1dfe8b44a29e0afcbc99eb3131%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/956/f3616e1dfe8b44a29e0afcbc99eb3131/images/large/1.jpg not downloaded yet
2026-03-27 13:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e1022b21-2f9a-549a-b14a-03d58836858d with identifier: 1987022
2026-03-27 13:34:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e1022b21-2f9a-549a-b14a-03d58836858d with identifier: 1987022
2026-03-27 13:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e1022b21-2f9a-549a-b14a-03d58836858d with identifier: 1987022 to the API
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/425/ad8908b4c0224818b0118ecfa0e3b2cf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'color': 'Azul dipinto di blu',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e1022b21-2f9a-549a-b14a-03d58836858d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 55928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1022b21-2f9a-549a-b14a-03d58836858d/e1022b21-2f9a-549a-b14a-03d58836858d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/425/ad8908b4c0224818b0118ecfa0e3b2cf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Lounge 1.0 6v GSE 52KW (70 CV)',
 'transmission': 'manual',
 'trim': 'Lounge 1.0 6v GSE 52KW (70 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987022%27 HTTP/1.1" 200 None
2026-03-27 13:34:33 [ayvens.es] INFO: Saving data for 1987022: {'created_time': 1774618473.556647, 'last_price_update_time': 1774618473.556657, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987022') HTTP/1.1" 204 0
2026-03-27 13:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b2690>
2026-03-27 13:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea5495-2955-5d98-900a-36cd6fda0cea/00ea5495-2955-5d98-900a-36cd6fda0cea_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F397%252Fd4bd2605247545158de1fd09bcfc385b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/397/d4bd2605247545158de1fd09bcfc385b/images/large/1.jpg saved to cache
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00ea5495-2955-5d98-900a-36cd6fda0cea
2026-03-27 13:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00ea5495-2955-5d98-900a-36cd6fda0cea, skipping ID generation
2026-03-27 13:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ea5495-2955-5d98-900a-36cd6fda0cea with scrape type 1
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00ea5495-2955-5d98-900a-36cd6fda0cea sending to next pipeline
2026-03-27 13:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 00ea5495-2955-5d98-900a-36cd6fda0cea, identifier: 1987021
2026-03-27 13:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/190/6a8bf37048e94dffbc137f0b2ab1e14c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:33 [ayvens.es] INFO: Found listing with ID: 1987031
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987031%27 HTTP/1.1" 200 None
2026-03-27 13:34:33 [ayvens.es] INFO: Scrape type for 1987031: 1
2026-03-27 13:34:33 [ayvens.es] INFO: Extracting data for car ID: 1987031
2026-03-27 13:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 374b89c4-10d9-5072-8b28-cf10967ec142 with identifier: 1987031
2026-03-27 13:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374b89c4-10d9-5072-8b28-cf10967ec142 with scrape type 1
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 374b89c4-10d9-5072-8b28-cf10967ec142
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F859%252F458dd2ff80b2480bb8170456378eaacd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/859/458dd2ff80b2480bb8170456378eaacd/images/large/1.jpg not downloaded yet
2026-03-27 13:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 00ea5495-2955-5d98-900a-36cd6fda0cea with identifier: 1987021
2026-03-27 13:34:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 00ea5495-2955-5d98-900a-36cd6fda0cea with identifier: 1987021
2026-03-27 13:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 00ea5495-2955-5d98-900a-36cd6fda0cea with identifier: 1987021 to the API
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/397/d4bd2605247545158de1fd09bcfc385b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris platino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '00ea5495-2955-5d98-900a-36cd6fda0cea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 39620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea5495-2955-5d98-900a-36cd6fda0cea/00ea5495-2955-5d98-900a-36cd6fda0cea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/397/d4bd2605247545158de1fd09bcfc385b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK BlueHDi 81 kW Manual SO CHIC',
 'transmission': 'manual',
 'trim': 'BlueHDi 81 kW Manual SO CHIC',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987021%27 HTTP/1.1" 200 None
2026-03-27 13:34:34 [ayvens.es] INFO: Saving data for 1987021: {'created_time': 1774618474.071562, 'last_price_update_time': 1774618474.071573, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987021') HTTP/1.1" 204 0
2026-03-27 13:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/643/d971cb8bdbb3429fb7924950eb540dc5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960bf450>
2026-03-27 13:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e69dc82-b2e4-576f-9a7d-50d485046f2c/0e69dc82-b2e4-576f-9a7d-50d485046f2c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F883%252F8b5ca6d5a99245f58404fa02ac8372b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/883/8b5ca6d5a99245f58404fa02ac8372b1/images/large/1.jpg saved to cache
2026-03-27 13:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c
2026-03-27 13:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e69dc82-b2e4-576f-9a7d-50d485046f2c, skipping ID generation
2026-03-27 13:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c with scrape type 1
2026-03-27 13:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c sending to next pipeline
2026-03-27 13:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e69dc82-b2e4-576f-9a7d-50d485046f2c, identifier: 1987023
2026-03-27 13:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956d6250>
2026-03-27 13:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a8d024-d9b3-5db0-8bb2-93d9c1267d65/39a8d024-d9b3-5db0-8bb2-93d9c1267d65_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F228%252Ff18a2e1aa6d949a2b02fdd0580cdfd55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/228/f18a2e1aa6d949a2b02fdd0580cdfd55/images/large/1.jpg saved to cache
2026-03-27 13:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65
2026-03-27 13:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65, skipping ID generation
2026-03-27 13:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with scrape type 1
2026-03-27 13:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 sending to next pipeline
2026-03-27 13:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65, identifier: 1987024
2026-03-27 13:34:34 [ayvens.es] INFO: Found listing with ID: 1987032
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987032%27 HTTP/1.1" 200 None
2026-03-27 13:34:34 [ayvens.es] INFO: Scrape type for 1987032: 1
2026-03-27 13:34:34 [ayvens.es] INFO: Extracting data for car ID: 1987032
2026-03-27 13:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88e601f-9fed-51f9-ac1c-6ec477ef7856 with identifier: 1987032
2026-03-27 13:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88e601f-9fed-51f9-ac1c-6ec477ef7856 with scrape type 1
2026-03-27 13:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f88e601f-9fed-51f9-ac1c-6ec477ef7856
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252Fd20226aa3bf347ecab9f6873b7c4e46e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/d20226aa3bf347ecab9f6873b7c4e46e/images/large/1.jpg not downloaded yet
2026-03-27 13:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e69dc82-b2e4-576f-9a7d-50d485046f2c with identifier: 1987023
2026-03-27 13:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e69dc82-b2e4-576f-9a7d-50d485046f2c with identifier: 1987023
2026-03-27 13:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0e69dc82-b2e4-576f-9a7d-50d485046f2c with identifier: 1987023 to the API
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/883/8b5ca6d5a99245f58404fa02ac8372b1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0e69dc82-b2e4-576f-9a7d-50d485046f2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 73988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e69dc82-b2e4-576f-9a7d-50d485046f2c/0e69dc82-b2e4-576f-9a7d-50d485046f2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/883/8b5ca6d5a99245f58404fa02ac8372b1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L2H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '350 96kW L2H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987023%27 HTTP/1.1" 200 None
2026-03-27 13:34:34 [ayvens.es] INFO: Saving data for 1987023: {'created_time': 1774618474.749292, 'last_price_update_time': 1774618474.749302, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987023') HTTP/1.1" 204 0
2026-03-27 13:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with identifier: 1987024
2026-03-27 13:34:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with identifier: 1987024
2026-03-27 13:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with identifier: 1987024 to the API
2026-03-27 13:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/228/f18a2e1aa6d949a2b02fdd0580cdfd55/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Silky silvier',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '39a8d024-d9b3-5db0-8bb2-93d9c1267d65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 77792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a8d024-d9b3-5db0-8bb2-93d9c1267d65/39a8d024-d9b3-5db0-8bb2-93d9c1267d65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/228/f18a2e1aa6d949a2b02fdd0580cdfd55/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 74kW (100CV) MHEV iMT Concept',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 74kW (100CV) MHEV iMT Concept',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987024%27 HTTP/1.1" 200 None
2026-03-27 13:34:35 [ayvens.es] INFO: Saving data for 1987024: {'created_time': 1774618475.53106, 'last_price_update_time': 1774618475.531075, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987024') HTTP/1.1" 204 0
2026-03-27 13:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bfec50>
2026-03-27 13:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c26b163e-d808-526a-977a-d366dc10dbfc/c26b163e-d808-526a-977a-d366dc10dbfc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F190%252F6a8bf37048e94dffbc137f0b2ab1e14c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/190/6a8bf37048e94dffbc137f0b2ab1e14c/images/large/1.jpg saved to cache
2026-03-27 13:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c26b163e-d808-526a-977a-d366dc10dbfc
2026-03-27 13:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c26b163e-d808-526a-977a-d366dc10dbfc, skipping ID generation
2026-03-27 13:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26b163e-d808-526a-977a-d366dc10dbfc with scrape type 1
2026-03-27 13:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c26b163e-d808-526a-977a-d366dc10dbfc sending to next pipeline
2026-03-27 13:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c26b163e-d808-526a-977a-d366dc10dbfc, identifier: 1987026
2026-03-27 13:34:35 [ayvens.es] INFO: Found listing with ID: 1987033
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987033%27 HTTP/1.1" 200 None
2026-03-27 13:34:35 [ayvens.es] INFO: Scrape type for 1987033: 1
2026-03-27 13:34:35 [ayvens.es] INFO: Extracting data for car ID: 1987033
2026-03-27 13:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc9e8706-981c-5e84-80e4-20e542c019e1 with identifier: 1987033
2026-03-27 13:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9e8706-981c-5e84-80e4-20e542c019e1 with scrape type 1
2026-03-27 13:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc9e8706-981c-5e84-80e4-20e542c019e1
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F627%252F4755366ebb334f1f9261f56e601a4292%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/627/4755366ebb334f1f9261f56e601a4292/images/large/1.jpg not downloaded yet
2026-03-27 13:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c26b163e-d808-526a-977a-d366dc10dbfc with identifier: 1987026
2026-03-27 13:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c26b163e-d808-526a-977a-d366dc10dbfc with identifier: 1987026
2026-03-27 13:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c26b163e-d808-526a-977a-d366dc10dbfc with identifier: 1987026 to the API
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/190/6a8bf37048e94dffbc137f0b2ab1e14c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c26b163e-d808-526a-977a-d366dc10dbfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 99155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c26b163e-d808-526a-977a-d366dc10dbfc/c26b163e-d808-526a-977a-d366dc10dbfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/190/6a8bf37048e94dffbc137f0b2ab1e14c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987026%27 HTTP/1.1" 200 None
2026-03-27 13:34:36 [ayvens.es] INFO: Saving data for 1987026: {'created_time': 1774618476.081336, 'last_price_update_time': 1774618476.081348, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987026') HTTP/1.1" 204 0
2026-03-27 13:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/110/7f80780e5b224fb198e8ca70b62621e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/159/c61549c73e2a468b82abc835d853e23c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296202fd0>
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dedd9a-073d-5d0d-8e49-b950df5b3d8d/13dedd9a-073d-5d0d-8e49-b950df5b3d8d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F643%252Fd971cb8bdbb3429fb7924950eb540dc5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/643/d971cb8bdbb3429fb7924950eb540dc5/images/large/1.jpg saved to cache
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d
2026-03-27 13:34:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d, skipping ID generation
2026-03-27 13:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with scrape type 1
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d sending to next pipeline
2026-03-27 13:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d, identifier: 1987025
2026-03-27 13:34:36 [ayvens.es] INFO: Found listing with ID: 1987034
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987034%27 HTTP/1.1" 200 None
2026-03-27 13:34:36 [ayvens.es] INFO: Scrape type for 1987034: 1
2026-03-27 13:34:36 [ayvens.es] INFO: Extracting data for car ID: 1987034
2026-03-27 13:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97d628e6-0a8f-5784-adff-3691a0e45cfe with identifier: 1987034
2026-03-27 13:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97d628e6-0a8f-5784-adff-3691a0e45cfe with scrape type 1
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 97d628e6-0a8f-5784-adff-3691a0e45cfe
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F991%252Fb2100ac1a9524f2481638bf552aecc1d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/991/b2100ac1a9524f2481638bf552aecc1d/images/large/1.jpg not downloaded yet
2026-03-27 13:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with identifier: 1987025
2026-03-27 13:34:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with identifier: 1987025
2026-03-27 13:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with identifier: 1987025 to the API
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/643/d971cb8bdbb3429fb7924950eb540dc5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Azul celebes',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '13dedd9a-073d-5d0d-8e49-b950df5b3d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 147976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dedd9a-073d-5d0d-8e49-b950df5b3d8d/13dedd9a-073d-5d0d-8e49-b950df5b3d8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/643/d971cb8bdbb3429fb7924950eb540dc5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987025%27 HTTP/1.1" 200 None
2026-03-27 13:34:36 [ayvens.es] INFO: Saving data for 1987025: {'created_time': 1774618476.652334, 'last_price_update_time': 1774618476.652345, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987025') HTTP/1.1" 204 0
2026-03-27 13:34:36 [ayvens.es] INFO: Found listing with ID: 1987035
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987035%27 HTTP/1.1" 200 None
2026-03-27 13:34:36 [ayvens.es] INFO: Scrape type for 1987035: 1
2026-03-27 13:34:36 [ayvens.es] INFO: Extracting data for car ID: 1987035
2026-03-27 13:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0631e652-351b-5515-841f-6a59d7d06844 with identifier: 1987035
2026-03-27 13:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0631e652-351b-5515-841f-6a59d7d06844 with scrape type 1
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0631e652-351b-5515-841f-6a59d7d06844
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252F3d2ded37456d4b8a9fbcc5d96cb63cd8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/3d2ded37456d4b8a9fbcc5d96cb63cd8/images/large/1.jpg not downloaded yet
2026-03-27 13:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/956/f3616e1dfe8b44a29e0afcbc99eb3131/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295797d50>
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137f8a31-f6c2-5462-9b54-5e6e7b187518/137f8a31-f6c2-5462-9b54-5e6e7b187518_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252F7f80780e5b224fb198e8ca70b62621e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/7f80780e5b224fb198e8ca70b62621e5/images/large/1.jpg saved to cache
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 137f8a31-f6c2-5462-9b54-5e6e7b187518
2026-03-27 13:34:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 137f8a31-f6c2-5462-9b54-5e6e7b187518, skipping ID generation
2026-03-27 13:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137f8a31-f6c2-5462-9b54-5e6e7b187518 with scrape type 1
2026-03-27 13:34:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 137f8a31-f6c2-5462-9b54-5e6e7b187518 sending to next pipeline
2026-03-27 13:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 137f8a31-f6c2-5462-9b54-5e6e7b187518, identifier: 1987027
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52981cbb50>
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_492d12b0-fc44-5ac4-97e7-609de8a37ed7/492d12b0-fc44-5ac4-97e7-609de8a37ed7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F159%252Fc61549c73e2a468b82abc835d853e23c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/159/c61549c73e2a468b82abc835d853e23c/images/large/1.jpg saved to cache
2026-03-27 13:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7
2026-03-27 13:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 492d12b0-fc44-5ac4-97e7-609de8a37ed7, skipping ID generation
2026-03-27 13:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with scrape type 1
2026-03-27 13:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7 sending to next pipeline
2026-03-27 13:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 492d12b0-fc44-5ac4-97e7-609de8a37ed7, identifier: 1987028
2026-03-27 13:34:37 [ayvens.es] INFO: Found listing with ID: 1987036
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987036%27 HTTP/1.1" 200 None
2026-03-27 13:34:37 [ayvens.es] INFO: Scrape type for 1987036: 1
2026-03-27 13:34:37 [ayvens.es] INFO: Extracting data for car ID: 1987036
2026-03-27 13:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4725a93-eb09-579e-b6cf-15293943c2c4 with identifier: 1987036
2026-03-27 13:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4725a93-eb09-579e-b6cf-15293943c2c4 with scrape type 1
2026-03-27 13:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c4725a93-eb09-579e-b6cf-15293943c2c4
2026-03-27 13:34:37 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c4725a93-eb09-579e-b6cf-15293943c2c4
2026-03-27 13:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c4725a93-eb09-579e-b6cf-15293943c2c4, identifier: 1987036
2026-03-27 13:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 137f8a31-f6c2-5462-9b54-5e6e7b187518 with identifier: 1987027
2026-03-27 13:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 137f8a31-f6c2-5462-9b54-5e6e7b187518 with identifier: 1987027
2026-03-27 13:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 137f8a31-f6c2-5462-9b54-5e6e7b187518 with identifier: 1987027 to the API
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/110/7f80780e5b224fb198e8ca70b62621e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '137f8a31-f6c2-5462-9b54-5e6e7b187518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 86697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137f8a31-f6c2-5462-9b54-5e6e7b187518/137f8a31-f6c2-5462-9b54-5e6e7b187518_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/110/7f80780e5b224fb198e8ca70b62621e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987027%27 HTTP/1.1" 200 None
2026-03-27 13:34:37 [ayvens.es] INFO: Saving data for 1987027: {'created_time': 1774618477.519549, 'last_price_update_time': 1774618477.519563, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987027') HTTP/1.1" 204 0
2026-03-27 13:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with identifier: 1987028
2026-03-27 13:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with identifier: 1987028
2026-03-27 13:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with identifier: 1987028 to the API
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/159/c61549c73e2a468b82abc835d853e23c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '492d12b0-fc44-5ac4-97e7-609de8a37ed7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 137314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_492d12b0-fc44-5ac4-97e7-609de8a37ed7/492d12b0-fc44-5ac4-97e7-609de8a37ed7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/159/c61549c73e2a468b82abc835d853e23c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER Access Standard BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Access Standard BlueHDi 73kW',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987028%27 HTTP/1.1" 200 None
2026-03-27 13:34:37 [ayvens.es] INFO: Saving data for 1987028: {'created_time': 1774618477.83732, 'last_price_update_time': 1774618477.837331, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987028') HTTP/1.1" 204 0
2026-03-27 13:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/573/eea699a079c24665a33889f801f34e11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c4725a93-eb09-579e-b6cf-15293943c2c4 with identifier: 1987036
2026-03-27 13:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c4725a93-eb09-579e-b6cf-15293943c2c4 with identifier: 1987036
2026-03-27 13:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c4725a93-eb09-579e-b6cf-15293943c2c4 with identifier: 1987036 to the API
2026-03-27 13:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c4725a93-eb09-579e-b6cf-15293943c2c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NAVARA',
 'odometer': 108556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN NAVARA D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'transmission': 'manual',
 'trim': 'D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987036%27 HTTP/1.1" 200 None
2026-03-27 13:34:38 [ayvens.es] INFO: Saving data for 1987036: {'created_time': 1774618478.206487, 'last_price_update_time': 1774618478.206498, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987036') HTTP/1.1" 204 0
2026-03-27 13:34:38 [ayvens.es] INFO: Found listing with ID: 1987037
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987037%27 HTTP/1.1" 200 None
2026-03-27 13:34:38 [ayvens.es] INFO: Scrape type for 1987037: 1
2026-03-27 13:34:38 [ayvens.es] INFO: Extracting data for car ID: 1987037
2026-03-27 13:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with identifier: 1987037
2026-03-27 13:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with scrape type 1
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F455%252F21fda7a1953548978a28a74d90c9d7f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/455/21fda7a1953548978a28a74d90c9d7f5/images/large/1.jpg not downloaded yet
2026-03-27 13:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/495/d20226aa3bf347ecab9f6873b7c4e46e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/859/458dd2ff80b2480bb8170456378eaacd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:38 [ayvens.es] INFO: Found listing with ID: 1987038
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987038%27 HTTP/1.1" 200 None
2026-03-27 13:34:38 [ayvens.es] INFO: Scrape type for 1987038: 1
2026-03-27 13:34:38 [ayvens.es] INFO: Extracting data for car ID: 1987038
2026-03-27 13:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with identifier: 1987038
2026-03-27 13:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with scrape type 1
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252Fcba840744a9049c0a7e5e2d7c4964c83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/cba840744a9049c0a7e5e2d7c4964c83/images/large/1.jpg not downloaded yet
2026-03-27 13:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295767110>
2026-03-27 13:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a5e38c-6a6f-5139-8d3e-1642ed893514/99a5e38c-6a6f-5139-8d3e-1642ed893514_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F956%252Ff3616e1dfe8b44a29e0afcbc99eb3131%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/956/f3616e1dfe8b44a29e0afcbc99eb3131/images/large/1.jpg saved to cache
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99a5e38c-6a6f-5139-8d3e-1642ed893514
2026-03-27 13:34:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99a5e38c-6a6f-5139-8d3e-1642ed893514, skipping ID generation
2026-03-27 13:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a5e38c-6a6f-5139-8d3e-1642ed893514 with scrape type 1
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99a5e38c-6a6f-5139-8d3e-1642ed893514 sending to next pipeline
2026-03-27 13:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99a5e38c-6a6f-5139-8d3e-1642ed893514, identifier: 1987030
2026-03-27 13:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4ce90>
2026-03-27 13:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5add81-0576-58bd-bd54-373c60b9f22f/2a5add81-0576-58bd-bd54-373c60b9f22f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252Feea699a079c24665a33889f801f34e11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/eea699a079c24665a33889f801f34e11/images/large/1.jpg saved to cache
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a5add81-0576-58bd-bd54-373c60b9f22f
2026-03-27 13:34:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a5add81-0576-58bd-bd54-373c60b9f22f, skipping ID generation
2026-03-27 13:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a5add81-0576-58bd-bd54-373c60b9f22f with scrape type 1
2026-03-27 13:34:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a5add81-0576-58bd-bd54-373c60b9f22f sending to next pipeline
2026-03-27 13:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2a5add81-0576-58bd-bd54-373c60b9f22f, identifier: 1987029
2026-03-27 13:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99a5e38c-6a6f-5139-8d3e-1642ed893514 with identifier: 1987030
2026-03-27 13:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99a5e38c-6a6f-5139-8d3e-1642ed893514 with identifier: 1987030
2026-03-27 13:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99a5e38c-6a6f-5139-8d3e-1642ed893514 with identifier: 1987030 to the API
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/956/f3616e1dfe8b44a29e0afcbc99eb3131/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '99a5e38c-6a6f-5139-8d3e-1642ed893514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPER',
 'odometer': 89173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a5e38c-6a6f-5139-8d3e-1642ed893514/99a5e38c-6a6f-5139-8d3e-1642ed893514_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/956/f3616e1dfe8b44a29e0afcbc99eb3131/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPER BlueHDi 103KW (140CV) Furgon 35L2H2',
 'transmission': 'manual',
 'trim': 'BlueHDi 103KW (140CV) Furgon 35L2H2',
 'vin': None,
 'year': 2023}
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987030%27 HTTP/1.1" 200 None
2026-03-27 13:34:39 [ayvens.es] INFO: Saving data for 1987030: {'created_time': 1774618479.101654, 'last_price_update_time': 1774618479.101665, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987030') HTTP/1.1" 204 0
2026-03-27 13:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2a5add81-0576-58bd-bd54-373c60b9f22f with identifier: 1987029
2026-03-27 13:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2a5add81-0576-58bd-bd54-373c60b9f22f with identifier: 1987029
2026-03-27 13:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2a5add81-0576-58bd-bd54-373c60b9f22f with identifier: 1987029 to the API
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/573/eea699a079c24665a33889f801f34e11/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '2a5add81-0576-58bd-bd54-373c60b9f22f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 70584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a5add81-0576-58bd-bd54-373c60b9f22f/2a5add81-0576-58bd-bd54-373c60b9f22f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/573/eea699a079c24665a33889f801f34e11/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 90',
 'transmission': 'manual',
 'trim': 'Intens TCe 90',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987029%27 HTTP/1.1" 200 None
2026-03-27 13:34:39 [ayvens.es] INFO: Saving data for 1987029: {'created_time': 1774618479.41861, 'last_price_update_time': 1774618479.41862, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987029') HTTP/1.1" 204 0
2026-03-27 13:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/627/4755366ebb334f1f9261f56e601a4292/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:39 [ayvens.es] INFO: Found listing with ID: 1987039
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987039%27 HTTP/1.1" 200 None
2026-03-27 13:34:39 [ayvens.es] INFO: Scrape type for 1987039: 1
2026-03-27 13:34:39 [ayvens.es] INFO: Extracting data for car ID: 1987039
2026-03-27 13:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce171ac2-d3e1-5969-9dac-d7960bebf490 with identifier: 1987039
2026-03-27 13:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce171ac2-d3e1-5969-9dac-d7960bebf490 with scrape type 1
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce171ac2-d3e1-5969-9dac-d7960bebf490
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252Fa5413c7e21054f98baf5ccda041c6893%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/a5413c7e21054f98baf5ccda041c6893/images/large/1.jpg not downloaded yet
2026-03-27 13:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957969d0>
2026-03-27 13:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f88e601f-9fed-51f9-ac1c-6ec477ef7856/f88e601f-9fed-51f9-ac1c-6ec477ef7856_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252Fd20226aa3bf347ecab9f6873b7c4e46e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/d20226aa3bf347ecab9f6873b7c4e46e/images/large/1.jpg saved to cache
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f88e601f-9fed-51f9-ac1c-6ec477ef7856
2026-03-27 13:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f88e601f-9fed-51f9-ac1c-6ec477ef7856, skipping ID generation
2026-03-27 13:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88e601f-9fed-51f9-ac1c-6ec477ef7856 with scrape type 1
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f88e601f-9fed-51f9-ac1c-6ec477ef7856 sending to next pipeline
2026-03-27 13:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f88e601f-9fed-51f9-ac1c-6ec477ef7856, identifier: 1987032
2026-03-27 13:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962c9f10>
2026-03-27 13:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374b89c4-10d9-5072-8b28-cf10967ec142/374b89c4-10d9-5072-8b28-cf10967ec142_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F859%252F458dd2ff80b2480bb8170456378eaacd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/859/458dd2ff80b2480bb8170456378eaacd/images/large/1.jpg saved to cache
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 374b89c4-10d9-5072-8b28-cf10967ec142
2026-03-27 13:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 374b89c4-10d9-5072-8b28-cf10967ec142, skipping ID generation
2026-03-27 13:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374b89c4-10d9-5072-8b28-cf10967ec142 with scrape type 1
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 374b89c4-10d9-5072-8b28-cf10967ec142 sending to next pipeline
2026-03-27 13:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 374b89c4-10d9-5072-8b28-cf10967ec142, identifier: 1987031
2026-03-27 13:34:39 [ayvens.es] INFO: Found listing with ID: 1987040
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987040%27 HTTP/1.1" 200 None
2026-03-27 13:34:39 [ayvens.es] INFO: Scrape type for 1987040: 1
2026-03-27 13:34:39 [ayvens.es] INFO: Extracting data for car ID: 1987040
2026-03-27 13:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with identifier: 1987040
2026-03-27 13:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with scrape type 1
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252Fed30b4c093f245018b2abd37583f0b86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/ed30b4c093f245018b2abd37583f0b86/images/large/1.jpg not downloaded yet
2026-03-27 13:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f88e601f-9fed-51f9-ac1c-6ec477ef7856 with identifier: 1987032
2026-03-27 13:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f88e601f-9fed-51f9-ac1c-6ec477ef7856 with identifier: 1987032
2026-03-27 13:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f88e601f-9fed-51f9-ac1c-6ec477ef7856 with identifier: 1987032 to the API
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/495/d20226aa3bf347ecab9f6873b7c4e46e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Corporativo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f88e601f-9fed-51f9-ac1c-6ec477ef7856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 51552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f88e601f-9fed-51f9-ac1c-6ec477ef7856/f88e601f-9fed-51f9-ac1c-6ec477ef7856_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/495/d20226aa3bf347ecab9f6873b7c4e46e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE BlueHDi 73kW (100CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE BlueHDi 73kW (100CV)',
 'vin': None,
 'year': 2018}
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987032%27 HTTP/1.1" 200 None
2026-03-27 13:34:40 [ayvens.es] INFO: Saving data for 1987032: {'created_time': 1774618480.236544, 'last_price_update_time': 1774618480.236556, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987032') HTTP/1.1" 204 0
2026-03-27 13:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 374b89c4-10d9-5072-8b28-cf10967ec142 with identifier: 1987031
2026-03-27 13:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 374b89c4-10d9-5072-8b28-cf10967ec142 with identifier: 1987031
2026-03-27 13:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 374b89c4-10d9-5072-8b28-cf10967ec142 with identifier: 1987031 to the API
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/859/458dd2ff80b2480bb8170456378eaacd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '374b89c4-10d9-5072-8b28-cf10967ec142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 126829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374b89c4-10d9-5072-8b28-cf10967ec142/374b89c4-10d9-5072-8b28-cf10967ec142_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/859/458dd2ff80b2480bb8170456378eaacd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-25',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM (O) Kombi 2.0 TDCI 110kW 320 L1 Trend MH',
 'transmission': 'manual',
 'trim': '(O) Kombi 2.0 TDCI 110kW 320 L1 Trend MH',
 'vin': None,
 'year': 2023}
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987031%27 HTTP/1.1" 200 None
2026-03-27 13:34:40 [ayvens.es] INFO: Saving data for 1987031: {'created_time': 1774618480.546805, 'last_price_update_time': 1774618480.546815, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987031') HTTP/1.1" 204 0
2026-03-27 13:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/991/b2100ac1a9524f2481638bf552aecc1d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:40 [ayvens.es] INFO: Found listing with ID: 1987041
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987041%27 HTTP/1.1" 200 None
2026-03-27 13:34:40 [ayvens.es] INFO: Scrape type for 1987041: 1
2026-03-27 13:34:40 [ayvens.es] INFO: Extracting data for car ID: 1987041
2026-03-27 13:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4446c2-df01-520e-a904-bd3ebaa33134 with identifier: 1987041
2026-03-27 13:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4446c2-df01-520e-a904-bd3ebaa33134 with scrape type 1
2026-03-27 13:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb4446c2-df01-520e-a904-bd3ebaa33134
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252Ff5442c1dadeb4ebd8a8d22a2c77fc0cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/f5442c1dadeb4ebd8a8d22a2c77fc0cf/images/large/1.jpg not downloaded yet
2026-03-27 13:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529672fa90>
2026-03-27 13:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9e8706-981c-5e84-80e4-20e542c019e1/dc9e8706-981c-5e84-80e4-20e542c019e1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F627%252F4755366ebb334f1f9261f56e601a4292%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/627/4755366ebb334f1f9261f56e601a4292/images/large/1.jpg saved to cache
2026-03-27 13:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc9e8706-981c-5e84-80e4-20e542c019e1
2026-03-27 13:34:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc9e8706-981c-5e84-80e4-20e542c019e1, skipping ID generation
2026-03-27 13:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9e8706-981c-5e84-80e4-20e542c019e1 with scrape type 1
2026-03-27 13:34:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc9e8706-981c-5e84-80e4-20e542c019e1 sending to next pipeline
2026-03-27 13:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc9e8706-981c-5e84-80e4-20e542c019e1, identifier: 1987033
2026-03-27 13:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc9e8706-981c-5e84-80e4-20e542c019e1 with identifier: 1987033
2026-03-27 13:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc9e8706-981c-5e84-80e4-20e542c019e1 with identifier: 1987033
2026-03-27 13:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc9e8706-981c-5e84-80e4-20e542c019e1 with identifier: 1987033 to the API
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/627/4755366ebb334f1f9261f56e601a4292/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc9e8706-981c-5e84-80e4-20e542c019e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 171432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9e8706-981c-5e84-80e4-20e542c019e1/dc9e8706-981c-5e84-80e4-20e542c019e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/627/4755366ebb334f1f9261f56e601a4292/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987033%27 HTTP/1.1" 200 None
2026-03-27 13:34:41 [ayvens.es] INFO: Saving data for 1987033: {'created_time': 1774618481.107475, 'last_price_update_time': 1774618481.107486, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987033') HTTP/1.1" 204 0
2026-03-27 13:34:41 [ayvens.es] INFO: Found listing with ID: 1987042
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987042%27 HTTP/1.1" 200 None
2026-03-27 13:34:41 [ayvens.es] INFO: Scrape type for 1987042: 1
2026-03-27 13:34:41 [ayvens.es] INFO: Extracting data for car ID: 1987042
2026-03-27 13:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c2cad8c-a7a4-5b44-9223-95518937f347 with identifier: 1987042
2026-03-27 13:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c2cad8c-a7a4-5b44-9223-95518937f347 with scrape type 1
2026-03-27 13:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 0c2cad8c-a7a4-5b44-9223-95518937f347
2026-03-27 13:34:41 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 0c2cad8c-a7a4-5b44-9223-95518937f347
2026-03-27 13:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c2cad8c-a7a4-5b44-9223-95518937f347, identifier: 1987042
2026-03-27 13:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c2cad8c-a7a4-5b44-9223-95518937f347 with identifier: 1987042
2026-03-27 13:34:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c2cad8c-a7a4-5b44-9223-95518937f347 with identifier: 1987042
2026-03-27 13:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0c2cad8c-a7a4-5b44-9223-95518937f347 with identifier: 1987042 to the API
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Rojo absolute nacara',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c2cad8c-a7a4-5b44-9223-95518937f347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 247067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi 132kW (180CV) Auto. GRAND '
          'CHIC',
 'transmission': 'manual',
 'trim': 'BlueHDi 132kW (180CV) Auto. GRAND CHIC',
 'vin': None,
 'year': 2019}
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987042%27 HTTP/1.1" 200 None
2026-03-27 13:34:41 [ayvens.es] INFO: Saving data for 1987042: {'created_time': 1774618481.649447, 'last_price_update_time': 1774618481.649457, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987042') HTTP/1.1" 204 0
2026-03-27 13:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b3a90>
2026-03-27 13:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d628e6-0a8f-5784-adff-3691a0e45cfe/97d628e6-0a8f-5784-adff-3691a0e45cfe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F991%252Fb2100ac1a9524f2481638bf552aecc1d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/991/b2100ac1a9524f2481638bf552aecc1d/images/large/1.jpg saved to cache
2026-03-27 13:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97d628e6-0a8f-5784-adff-3691a0e45cfe
2026-03-27 13:34:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97d628e6-0a8f-5784-adff-3691a0e45cfe, skipping ID generation
2026-03-27 13:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97d628e6-0a8f-5784-adff-3691a0e45cfe with scrape type 1
2026-03-27 13:34:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97d628e6-0a8f-5784-adff-3691a0e45cfe sending to next pipeline
2026-03-27 13:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 97d628e6-0a8f-5784-adff-3691a0e45cfe, identifier: 1987034
2026-03-27 13:34:41 [ayvens.es] INFO: Found listing with ID: 1987043
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987043%27 HTTP/1.1" 200 None
2026-03-27 13:34:41 [ayvens.es] INFO: Scrape type for 1987043: 1
2026-03-27 13:34:41 [ayvens.es] INFO: Extracting data for car ID: 1987043
2026-03-27 13:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with identifier: 1987043
2026-03-27 13:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with scrape type 1
2026-03-27 13:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F5ff79205cea241298ed37820292d8aa6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/5ff79205cea241298ed37820292d8aa6/images/large/1.jpg not downloaded yet
2026-03-27 13:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 97d628e6-0a8f-5784-adff-3691a0e45cfe with identifier: 1987034
2026-03-27 13:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 97d628e6-0a8f-5784-adff-3691a0e45cfe with identifier: 1987034
2026-03-27 13:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 97d628e6-0a8f-5784-adff-3691a0e45cfe with identifier: 1987034 to the API
2026-03-27 13:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/991/b2100ac1a9524f2481638bf552aecc1d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '97d628e6-0a8f-5784-adff-3691a0e45cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 162240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d628e6-0a8f-5784-adff-3691a0e45cfe/97d628e6-0a8f-5784-adff-3691a0e45cfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/991/b2100ac1a9524f2481638bf552aecc1d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D204 R-Dynamic SE AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D204 R-Dynamic SE AUTO 4WD MHEV',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987034%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [ayvens.es] INFO: Saving data for 1987034: {'created_time': 1774618482.198701, 'last_price_update_time': 1774618482.198711, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987034') HTTP/1.1" 204 0
2026-03-27 13:34:42 [ayvens.es] INFO: Found listing with ID: 1987044
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987044%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [ayvens.es] INFO: Scrape type for 1987044: 1
2026-03-27 13:34:42 [ayvens.es] INFO: Extracting data for car ID: 1987044
2026-03-27 13:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de83ad14-f445-5090-bac1-060c12e6776c with identifier: 1987044
2026-03-27 13:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de83ad14-f445-5090-bac1-060c12e6776c with scrape type 1
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de83ad14-f445-5090-bac1-060c12e6776c
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252F86b48ce4881847e180349f907fdb0bf5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/86b48ce4881847e180349f907fdb0bf5/images/large/1.jpg not downloaded yet
2026-03-27 13:34:42 [ayvens.es] INFO: Found listing with ID: 1987045
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987045%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [ayvens.es] INFO: Scrape type for 1987045: 1
2026-03-27 13:34:42 [ayvens.es] INFO: Extracting data for car ID: 1987045
2026-03-27 13:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba69d158-f311-53fc-8732-928cc259181d with identifier: 1987045
2026-03-27 13:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba69d158-f311-53fc-8732-928cc259181d with scrape type 1
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ba69d158-f311-53fc-8732-928cc259181d
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F2388fdf660314c44b5d735f8ff1a1816%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/2388fdf660314c44b5d735f8ff1a1816/images/large/1.jpg not downloaded yet
2026-03-27 13:34:42 [ayvens.es] INFO: Found listing with ID: 1987046
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987046%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [ayvens.es] INFO: Scrape type for 1987046: 1
2026-03-27 13:34:42 [ayvens.es] INFO: Extracting data for car ID: 1987046
2026-03-27 13:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eee2c01-d124-5729-b1ad-38e1400219d5 with identifier: 1987046
2026-03-27 13:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eee2c01-d124-5729-b1ad-38e1400219d5 with scrape type 1
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8eee2c01-d124-5729-b1ad-38e1400219d5
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F909%252F22b1695469b54963aa720e26537a3f06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/909/22b1695469b54963aa720e26537a3f06/images/large/1.jpg not downloaded yet
2026-03-27 13:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/646/3d2ded37456d4b8a9fbcc5d96cb63cd8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:42 [ayvens.es] INFO: Found listing with ID: 1987047
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987047%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [ayvens.es] INFO: Scrape type for 1987047: 1
2026-03-27 13:34:42 [ayvens.es] INFO: Extracting data for car ID: 1987047
2026-03-27 13:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with identifier: 1987047
2026-03-27 13:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with scrape type 1
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F509%252Fb60a8658f9414c2daec3e784bb100395%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/509/b60a8658f9414c2daec3e784bb100395/images/large/1.jpg not downloaded yet
2026-03-27 13:34:42 [ayvens.es] INFO: Found listing with ID: 1987048
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987048%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [ayvens.es] INFO: Scrape type for 1987048: 1
2026-03-27 13:34:42 [ayvens.es] INFO: Extracting data for car ID: 1987048
2026-03-27 13:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d5876e-7084-5be1-8c53-b6baca082c2c with identifier: 1987048
2026-03-27 13:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d5876e-7084-5be1-8c53-b6baca082c2c with scrape type 1
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9d5876e-7084-5be1-8c53-b6baca082c2c
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F043%252F22d0867197724814b19f05068391d273%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/043/22d0867197724814b19f05068391d273/images/large/1.jpg not downloaded yet
2026-03-27 13:34:42 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-27 13:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960cf590>
2026-03-27 13:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0631e652-351b-5515-841f-6a59d7d06844/0631e652-351b-5515-841f-6a59d7d06844_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252F3d2ded37456d4b8a9fbcc5d96cb63cd8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/3d2ded37456d4b8a9fbcc5d96cb63cd8/images/large/1.jpg saved to cache
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0631e652-351b-5515-841f-6a59d7d06844
2026-03-27 13:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0631e652-351b-5515-841f-6a59d7d06844, skipping ID generation
2026-03-27 13:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0631e652-351b-5515-841f-6a59d7d06844 with scrape type 1
2026-03-27 13:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0631e652-351b-5515-841f-6a59d7d06844 sending to next pipeline
2026-03-27 13:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0631e652-351b-5515-841f-6a59d7d06844, identifier: 1987035
2026-03-27 13:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0631e652-351b-5515-841f-6a59d7d06844 with identifier: 1987035
2026-03-27 13:34:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0631e652-351b-5515-841f-6a59d7d06844 with identifier: 1987035
2026-03-27 13:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0631e652-351b-5515-841f-6a59d7d06844 with identifier: 1987035 to the API
2026-03-27 13:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/646/3d2ded37456d4b8a9fbcc5d96cb63cd8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Deep crystal blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '0631e652-351b-5515-841f-6a59d7d06844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-30',
 'odometer': 56809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0631e652-351b-5515-841f-6a59d7d06844/0631e652-351b-5515-841f-6a59d7d06844_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/646/3d2ded37456d4b8a9fbcc5d96cb63cd8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-30 e-SKYACTIV-G 2.0 90 kW 2WD Evolution',
 'transmission': 'manual',
 'trim': 'e-SKYACTIV-G 2.0 90 kW 2WD Evolution',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987035%27 HTTP/1.1" 200 None
2026-03-27 13:34:43 [ayvens.es] INFO: Saving data for 1987035: {'created_time': 1774618483.125116, 'last_price_update_time': 1774618483.125126, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987035') HTTP/1.1" 204 0
2026-03-27 13:34:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 13:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/455/21fda7a1953548978a28a74d90c9d7f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/933/2388fdf660314c44b5d735f8ff1a1816/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/478/f5442c1dadeb4ebd8a8d22a2c77fc0cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/406/cba840744a9049c0a7e5e2d7c4964c83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/382/ed30b4c093f245018b2abd37583f0b86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/595/a5413c7e21054f98baf5ccda041c6893/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c9d50>
2026-03-27 13:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce8c67b2-2ffa-5c00-90e0-9caf7feda18e/ce8c67b2-2ffa-5c00-90e0-9caf7feda18e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F455%252F21fda7a1953548978a28a74d90c9d7f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/455/21fda7a1953548978a28a74d90c9d7f5/images/large/1.jpg saved to cache
2026-03-27 13:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e
2026-03-27 13:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e, skipping ID generation
2026-03-27 13:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with scrape type 1
2026-03-27 13:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e sending to next pipeline
2026-03-27 13:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e, identifier: 1987037
2026-03-27 13:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with identifier: 1987037
2026-03-27 13:34:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with identifier: 1987037
2026-03-27 13:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with identifier: 1987037 to the API
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/455/21fda7a1953548978a28a74d90c9d7f5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Azul metalico',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce8c67b2-2ffa-5c00-90e0-9caf7feda18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 209346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce8c67b2-2ffa-5c00-90e0-9caf7feda18e/ce8c67b2-2ffa-5c00-90e0-9caf7feda18e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/455/21fda7a1953548978a28a74d90c9d7f5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW Titanium PowShift SB',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW Titanium PowShift SB',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987037%27 HTTP/1.1" 200 None
2026-03-27 13:34:43 [ayvens.es] INFO: Saving data for 1987037: {'created_time': 1774618483.811411, 'last_price_update_time': 1774618483.811421, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987037') HTTP/1.1" 204 0
2026-03-27 13:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529618f010>
2026-03-27 13:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69d158-f311-53fc-8732-928cc259181d/ba69d158-f311-53fc-8732-928cc259181d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F2388fdf660314c44b5d735f8ff1a1816%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/2388fdf660314c44b5d735f8ff1a1816/images/large/1.jpg saved to cache
2026-03-27 13:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba69d158-f311-53fc-8732-928cc259181d
2026-03-27 13:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba69d158-f311-53fc-8732-928cc259181d, skipping ID generation
2026-03-27 13:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba69d158-f311-53fc-8732-928cc259181d with scrape type 1
2026-03-27 13:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba69d158-f311-53fc-8732-928cc259181d sending to next pipeline
2026-03-27 13:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ba69d158-f311-53fc-8732-928cc259181d, identifier: 1987045
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963cc190>
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4446c2-df01-520e-a904-bd3ebaa33134/eb4446c2-df01-520e-a904-bd3ebaa33134_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252Ff5442c1dadeb4ebd8a8d22a2c77fc0cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/f5442c1dadeb4ebd8a8d22a2c77fc0cf/images/large/1.jpg saved to cache
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb4446c2-df01-520e-a904-bd3ebaa33134
2026-03-27 13:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb4446c2-df01-520e-a904-bd3ebaa33134, skipping ID generation
2026-03-27 13:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4446c2-df01-520e-a904-bd3ebaa33134 with scrape type 1
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb4446c2-df01-520e-a904-bd3ebaa33134 sending to next pipeline
2026-03-27 13:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eb4446c2-df01-520e-a904-bd3ebaa33134, identifier: 1987041
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f5c2d0>
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c/45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252Fcba840744a9049c0a7e5e2d7c4964c83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/cba840744a9049c0a7e5e2d7c4964c83/images/large/1.jpg saved to cache
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c
2026-03-27 13:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c, skipping ID generation
2026-03-27 13:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with scrape type 1
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c sending to next pipeline
2026-03-27 13:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c, identifier: 1987038
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529575d210>
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3479c-52c3-5ed5-8b49-1d5d1179e4e9/5da3479c-52c3-5ed5-8b49-1d5d1179e4e9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252Fed30b4c093f245018b2abd37583f0b86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/ed30b4c093f245018b2abd37583f0b86/images/large/1.jpg saved to cache
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9
2026-03-27 13:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9, skipping ID generation
2026-03-27 13:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with scrape type 1
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 sending to next pipeline
2026-03-27 13:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9, identifier: 1987040
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295721dd0>
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce171ac2-d3e1-5969-9dac-d7960bebf490/ce171ac2-d3e1-5969-9dac-d7960bebf490_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252Fa5413c7e21054f98baf5ccda041c6893%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/a5413c7e21054f98baf5ccda041c6893/images/large/1.jpg saved to cache
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce171ac2-d3e1-5969-9dac-d7960bebf490
2026-03-27 13:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce171ac2-d3e1-5969-9dac-d7960bebf490, skipping ID generation
2026-03-27 13:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce171ac2-d3e1-5969-9dac-d7960bebf490 with scrape type 1
2026-03-27 13:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce171ac2-d3e1-5969-9dac-d7960bebf490 sending to next pipeline
2026-03-27 13:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce171ac2-d3e1-5969-9dac-d7960bebf490, identifier: 1987039
2026-03-27 13:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ba69d158-f311-53fc-8732-928cc259181d with identifier: 1987045
2026-03-27 13:34:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ba69d158-f311-53fc-8732-928cc259181d with identifier: 1987045
2026-03-27 13:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ba69d158-f311-53fc-8732-928cc259181d with identifier: 1987045 to the API
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/933/2388fdf660314c44b5d735f8ff1a1816/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Phytonicblau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ba69d158-f311-53fc-8732-928cc259181d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 154621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69d158-f311-53fc-8732-928cc259181d/ba69d158-f311-53fc-8732-928cc259181d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/933/2388fdf660314c44b5d735f8ff1a1816/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987045%27 HTTP/1.1" 200 None
2026-03-27 13:34:45 [ayvens.es] INFO: Saving data for 1987045: {'created_time': 1774618485.097354, 'last_price_update_time': 1774618485.097363, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987045') HTTP/1.1" 204 0
2026-03-27 13:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eb4446c2-df01-520e-a904-bd3ebaa33134 with identifier: 1987041
2026-03-27 13:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eb4446c2-df01-520e-a904-bd3ebaa33134 with identifier: 1987041
2026-03-27 13:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eb4446c2-df01-520e-a904-bd3ebaa33134 with identifier: 1987041 to the API
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/478/f5442c1dadeb4ebd8a8d22a2c77fc0cf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eb4446c2-df01-520e-a904-bd3ebaa33134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 171413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4446c2-df01-520e-a904-bd3ebaa33134/eb4446c2-df01-520e-a904-bd3ebaa33134_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/478/f5442c1dadeb4ebd8a8d22a2c77fc0cf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S GT Line EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S GT Line EAT8',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987041%27 HTTP/1.1" 200 None
2026-03-27 13:34:45 [ayvens.es] INFO: Saving data for 1987041: {'created_time': 1774618485.404706, 'last_price_update_time': 1774618485.404717, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987041') HTTP/1.1" 204 0
2026-03-27 13:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with identifier: 1987038
2026-03-27 13:34:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with identifier: 1987038
2026-03-27 13:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with identifier: 1987038 to the API
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/406/cba840744a9049c0a7e5e2d7c4964c83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Loire blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'F-PACE',
 'odometer': 157048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c/45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/406/cba840744a9049c0a7e5e2d7c4964c83/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR F-PACE (O) 2.0L i4D AWD Automatico Prestige',
 'transmission': 'manual',
 'trim': '(O) 2.0L i4D AWD Automatico Prestige',
 'vin': None,
 'year': 2018}
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987038%27 HTTP/1.1" 200 None
2026-03-27 13:34:45 [ayvens.es] INFO: Saving data for 1987038: {'created_time': 1774618485.721877, 'last_price_update_time': 1774618485.721888, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987038') HTTP/1.1" 204 0
2026-03-27 13:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with identifier: 1987040
2026-03-27 13:34:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with identifier: 1987040
2026-03-27 13:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with identifier: 1987040 to the API
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/382/ed30b4c093f245018b2abd37583f0b86/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Plata hightech meta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5da3479c-52c3-5ed5-8b49-1d5d1179e4e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 138341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3479c-52c3-5ed5-8b49-1d5d1179e4e9/5da3479c-52c3-5ed5-8b49-1d5d1179e4e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/382/ed30b4c093f245018b2abd37583f0b86/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 220 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 220 d 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987040%27 HTTP/1.1" 200 None
2026-03-27 13:34:46 [ayvens.es] INFO: Saving data for 1987040: {'created_time': 1774618486.05824, 'last_price_update_time': 1774618486.058251, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987040') HTTP/1.1" 204 0
2026-03-27 13:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce171ac2-d3e1-5969-9dac-d7960bebf490 with identifier: 1987039
2026-03-27 13:34:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce171ac2-d3e1-5969-9dac-d7960bebf490 with identifier: 1987039
2026-03-27 13:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce171ac2-d3e1-5969-9dac-d7960bebf490 with identifier: 1987039 to the API
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/595/a5413c7e21054f98baf5ccda041c6893/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ce171ac2-d3e1-5969-9dac-d7960bebf490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'CEED',
 'odometer': 60091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce171ac2-d3e1-5969-9dac-d7960bebf490/ce171ac2-d3e1-5969-9dac-d7960bebf490_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/595/a5413c7e21054f98baf5ccda041c6893/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA CEED 1.0 T-GDi 74kW (100CV) Concept',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 74kW (100CV) Concept',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987039%27 HTTP/1.1" 200 None
2026-03-27 13:34:46 [ayvens.es] INFO: Saving data for 1987039: {'created_time': 1774618486.390438, 'last_price_update_time': 1774618486.390452, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987039') HTTP/1.1" 204 0
2026-03-27 13:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/509/b60a8658f9414c2daec3e784bb100395/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/909/22b1695469b54963aa720e26537a3f06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/043/22d0867197724814b19f05068391d273/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/805/86b48ce4881847e180349f907fdb0bf5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/161/5ff79205cea241298ed37820292d8aa6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296097a10>
2026-03-27 13:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc2ca58-218a-51ba-8cf0-ccccf8f48d50/bbc2ca58-218a-51ba-8cf0-ccccf8f48d50_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F509%252Fb60a8658f9414c2daec3e784bb100395%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/509/b60a8658f9414c2daec3e784bb100395/images/large/1.jpg saved to cache
2026-03-27 13:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50
2026-03-27 13:34:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50, skipping ID generation
2026-03-27 13:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with scrape type 1
2026-03-27 13:34:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 sending to next pipeline
2026-03-27 13:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50, identifier: 1987047
2026-03-27 13:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with identifier: 1987047
2026-03-27 13:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with identifier: 1987047
2026-03-27 13:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with identifier: 1987047 to the API
2026-03-27 13:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/509/b60a8658f9414c2daec3e784bb100395/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bbc2ca58-218a-51ba-8cf0-ccccf8f48d50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 110411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc2ca58-218a-51ba-8cf0-ccccf8f48d50/bbc2ca58-218a-51ba-8cf0-ccccf8f48d50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/509/b60a8658f9414c2daec3e784bb100395/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987047%27 HTTP/1.1" 200 None
2026-03-27 13:34:47 [ayvens.es] INFO: Saving data for 1987047: {'created_time': 1774618487.158369, 'last_price_update_time': 1774618487.158379, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987047') HTTP/1.1" 204 0
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bd5350>
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eee2c01-d124-5729-b1ad-38e1400219d5/8eee2c01-d124-5729-b1ad-38e1400219d5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F909%252F22b1695469b54963aa720e26537a3f06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/909/22b1695469b54963aa720e26537a3f06/images/large/1.jpg saved to cache
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8eee2c01-d124-5729-b1ad-38e1400219d5
2026-03-27 13:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8eee2c01-d124-5729-b1ad-38e1400219d5, skipping ID generation
2026-03-27 13:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eee2c01-d124-5729-b1ad-38e1400219d5 with scrape type 1
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8eee2c01-d124-5729-b1ad-38e1400219d5 sending to next pipeline
2026-03-27 13:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8eee2c01-d124-5729-b1ad-38e1400219d5, identifier: 1987046
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c2e150>
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d5876e-7084-5be1-8c53-b6baca082c2c/b9d5876e-7084-5be1-8c53-b6baca082c2c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F043%252F22d0867197724814b19f05068391d273%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/043/22d0867197724814b19f05068391d273/images/large/1.jpg saved to cache
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9d5876e-7084-5be1-8c53-b6baca082c2c
2026-03-27 13:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9d5876e-7084-5be1-8c53-b6baca082c2c, skipping ID generation
2026-03-27 13:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d5876e-7084-5be1-8c53-b6baca082c2c with scrape type 1
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9d5876e-7084-5be1-8c53-b6baca082c2c sending to next pipeline
2026-03-27 13:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9d5876e-7084-5be1-8c53-b6baca082c2c, identifier: 1987048
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296408490>
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de83ad14-f445-5090-bac1-060c12e6776c/de83ad14-f445-5090-bac1-060c12e6776c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252F86b48ce4881847e180349f907fdb0bf5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/86b48ce4881847e180349f907fdb0bf5/images/large/1.jpg saved to cache
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de83ad14-f445-5090-bac1-060c12e6776c
2026-03-27 13:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de83ad14-f445-5090-bac1-060c12e6776c, skipping ID generation
2026-03-27 13:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de83ad14-f445-5090-bac1-060c12e6776c with scrape type 1
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de83ad14-f445-5090-bac1-060c12e6776c sending to next pipeline
2026-03-27 13:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de83ad14-f445-5090-bac1-060c12e6776c, identifier: 1987044
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960ac990>
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4/e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F5ff79205cea241298ed37820292d8aa6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/5ff79205cea241298ed37820292d8aa6/images/large/1.jpg saved to cache
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4
2026-03-27 13:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4, skipping ID generation
2026-03-27 13:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with scrape type 1
2026-03-27 13:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 sending to next pipeline
2026-03-27 13:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4, identifier: 1987043
2026-03-27 13:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8eee2c01-d124-5729-b1ad-38e1400219d5 with identifier: 1987046
2026-03-27 13:34:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8eee2c01-d124-5729-b1ad-38e1400219d5 with identifier: 1987046
2026-03-27 13:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8eee2c01-d124-5729-b1ad-38e1400219d5 with identifier: 1987046 to the API
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/909/22b1695469b54963aa720e26537a3f06/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata perla moondust',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '8eee2c01-d124-5729-b1ad-38e1400219d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 36733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eee2c01-d124-5729-b1ad-38e1400219d5/8eee2c01-d124-5729-b1ad-38e1400219d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/909/22b1695469b54963aa720e26537a3f06/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987046%27 HTTP/1.1" 200 None
2026-03-27 13:34:48 [ayvens.es] INFO: Saving data for 1987046: {'created_time': 1774618488.26077, 'last_price_update_time': 1774618488.260782, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987046') HTTP/1.1" 204 0
2026-03-27 13:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9d5876e-7084-5be1-8c53-b6baca082c2c with identifier: 1987048
2026-03-27 13:34:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9d5876e-7084-5be1-8c53-b6baca082c2c with identifier: 1987048
2026-03-27 13:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9d5876e-7084-5be1-8c53-b6baca082c2c with identifier: 1987048 to the API
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/043/22d0867197724814b19f05068391d273/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'Gris indium',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b9d5876e-7084-5be1-8c53-b6baca082c2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ALHAMBRA',
 'odometer': 60466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d5876e-7084-5be1-8c53-b6baca082c2c/b9d5876e-7084-5be1-8c53-b6baca082c2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/043/22d0867197724814b19f05068391d273/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SEAT ALHAMBRA 1.4 TSI 110kW DSG St&Sp Style GO',
 'transmission': 'manual',
 'trim': '1.4 TSI 110kW DSG St&Sp Style GO',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987048%27 HTTP/1.1" 200 None
2026-03-27 13:34:48 [ayvens.es] INFO: Saving data for 1987048: {'created_time': 1774618488.581797, 'last_price_update_time': 1774618488.581807, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987048') HTTP/1.1" 204 0
2026-03-27 13:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de83ad14-f445-5090-bac1-060c12e6776c with identifier: 1987044
2026-03-27 13:34:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de83ad14-f445-5090-bac1-060c12e6776c with identifier: 1987044
2026-03-27 13:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de83ad14-f445-5090-bac1-060c12e6776c with identifier: 1987044 to the API
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/805/86b48ce4881847e180349f907fdb0bf5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'B',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de83ad14-f445-5090-bac1-060c12e6776c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 1',
 'odometer': 101633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de83ad14-f445-5090-bac1-060c12e6776c/de83ad14-f445-5090-bac1-060c12e6776c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/805/86b48ce4881847e180349f907fdb0bf5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 1 116d',
 'transmission': 'manual',
 'trim': '116d',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987044%27 HTTP/1.1" 200 None
2026-03-27 13:34:48 [ayvens.es] INFO: Saving data for 1987044: {'created_time': 1774618488.977759, 'last_price_update_time': 1774618488.977769, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987044') HTTP/1.1" 204 0
2026-03-27 13:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with identifier: 1987043
2026-03-27 13:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with identifier: 1987043
2026-03-27 13:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with identifier: 1987043 to the API
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/161/5ff79205cea241298ed37820292d8aa6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 214767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4/e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/161/5ff79205cea241298ed37820292d8aa6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 110kW (150CV) DSG S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG S&S Style Go',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987043%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [ayvens.es] INFO: Saving data for 1987043: {'created_time': 1774618489.311356, 'last_price_update_time': 1774618489.311365, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987043') HTTP/1.1" 204 0
2026-03-27 13:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 13:34:49 [ayvens.es] INFO: Found listing with ID: 1987049
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987049%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [ayvens.es] INFO: Scrape type for 1987049: 1
2026-03-27 13:34:49 [ayvens.es] INFO: Extracting data for car ID: 1987049
2026-03-27 13:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c982ae06-f8d2-5277-be3d-27d61bf4dec1 with identifier: 1987049
2026-03-27 13:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c982ae06-f8d2-5277-be3d-27d61bf4dec1 with scrape type 1
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c982ae06-f8d2-5277-be3d-27d61bf4dec1
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252Fe544a68fa48c49fdb6d2aa81ae950c83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/e544a68fa48c49fdb6d2aa81ae950c83/images/large/1.jpg not downloaded yet
2026-03-27 13:34:49 [ayvens.es] INFO: Found listing with ID: 1987050
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987050%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [ayvens.es] INFO: Scrape type for 1987050: 1
2026-03-27 13:34:49 [ayvens.es] INFO: Extracting data for car ID: 1987050
2026-03-27 13:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f665c6-b78e-5838-8359-c8f5f8d0b67b with identifier: 1987050
2026-03-27 13:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b with scrape type 1
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252F96b3cbbdbe034172a72238340c2286d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/96b3cbbdbe034172a72238340c2286d9/images/large/1.jpg not downloaded yet
2026-03-27 13:34:49 [ayvens.es] INFO: Found listing with ID: 1987051
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987051%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [ayvens.es] INFO: Scrape type for 1987051: 1
2026-03-27 13:34:49 [ayvens.es] INFO: Extracting data for car ID: 1987051
2026-03-27 13:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5acdde55-82d3-576b-b949-10d37fc6cd39 with identifier: 1987051
2026-03-27 13:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acdde55-82d3-576b-b949-10d37fc6cd39 with scrape type 1
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5acdde55-82d3-576b-b949-10d37fc6cd39
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252Fd567578740fb43a0bdf19790784988b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/d567578740fb43a0bdf19790784988b4/images/large/1.jpg not downloaded yet
2026-03-27 13:34:49 [ayvens.es] INFO: Found listing with ID: 1987052
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987052%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [ayvens.es] INFO: Scrape type for 1987052: 1
2026-03-27 13:34:49 [ayvens.es] INFO: Extracting data for car ID: 1987052
2026-03-27 13:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fcfd416-b160-5f84-a56f-872cfad01d1c with identifier: 1987052
2026-03-27 13:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fcfd416-b160-5f84-a56f-872cfad01d1c with scrape type 1
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3fcfd416-b160-5f84-a56f-872cfad01d1c
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252Fcee22b4dea0b46e3bb5c312d04403d67%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/cee22b4dea0b46e3bb5c312d04403d67/images/large/1.jpg not downloaded yet
2026-03-27 13:34:49 [ayvens.es] INFO: Found listing with ID: 1987053
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987053%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [ayvens.es] INFO: Scrape type for 1987053: 1
2026-03-27 13:34:49 [ayvens.es] INFO: Extracting data for car ID: 1987053
2026-03-27 13:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c17077e-6c33-5043-914a-587f09533b8d with identifier: 1987053
2026-03-27 13:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c17077e-6c33-5043-914a-587f09533b8d with scrape type 1
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c17077e-6c33-5043-914a-587f09533b8d
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F155%252F700d98251eff4e608827707bc724d266%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/155/700d98251eff4e608827707bc724d266/images/large/1.jpg not downloaded yet
2026-03-27 13:34:49 [ayvens.es] INFO: Found listing with ID: 1987054
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987054%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [ayvens.es] INFO: Scrape type for 1987054: 1
2026-03-27 13:34:49 [ayvens.es] INFO: Extracting data for car ID: 1987054
2026-03-27 13:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0707208e-e750-5e7c-bdfc-56e185672570 with identifier: 1987054
2026-03-27 13:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0707208e-e750-5e7c-bdfc-56e185672570 with scrape type 1
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0707208e-e750-5e7c-bdfc-56e185672570
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F116fbdd88e4047ba91fb27befdab0308%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/116fbdd88e4047ba91fb27befdab0308/images/large/1.jpg not downloaded yet
2026-03-27 13:34:49 [ayvens.es] INFO: Found listing with ID: 1987055
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987055%27 HTTP/1.1" 200 None
2026-03-27 13:34:49 [ayvens.es] INFO: Scrape type for 1987055: 1
2026-03-27 13:34:49 [ayvens.es] INFO: Extracting data for car ID: 1987055
2026-03-27 13:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac with identifier: 1987055
2026-03-27 13:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac with scrape type 1
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac
2026-03-27 13:34:49 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac
2026-03-27 13:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac, identifier: 1987055
2026-03-27 13:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac with identifier: 1987055
2026-03-27 13:34:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac with identifier: 1987055
2026-03-27 13:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac with identifier: 1987055 to the API
2026-03-27 13:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Saphirschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e1ef7f18-f6bb-58a7-9588-1a5a6f3b7fac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 200433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 318d Auto.Touring',
 'transmission': 'manual',
 'trim': '318d Auto.Touring',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987055%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [ayvens.es] INFO: Saving data for 1987055: {'created_time': 1774618490.193456, 'last_price_update_time': 1774618490.193466, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987055') HTTP/1.1" 204 0
2026-03-27 13:34:50 [ayvens.es] INFO: Found listing with ID: 1987056
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987056%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [ayvens.es] INFO: Scrape type for 1987056: 1
2026-03-27 13:34:50 [ayvens.es] INFO: Extracting data for car ID: 1987056
2026-03-27 13:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4629a284-38c4-5756-9b8e-221ff331da09 with identifier: 1987056
2026-03-27 13:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4629a284-38c4-5756-9b8e-221ff331da09 with scrape type 1
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4629a284-38c4-5756-9b8e-221ff331da09
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252F08831782b1314494af8eeb95b96c0afd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/08831782b1314494af8eeb95b96c0afd/images/large/1.jpg not downloaded yet
2026-03-27 13:34:50 [ayvens.es] INFO: Found listing with ID: 1987057
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987057%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [ayvens.es] INFO: Scrape type for 1987057: 1
2026-03-27 13:34:50 [ayvens.es] INFO: Extracting data for car ID: 1987057
2026-03-27 13:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31daa97e-ea2c-521e-976b-56fce830e864 with identifier: 1987057
2026-03-27 13:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31daa97e-ea2c-521e-976b-56fce830e864 with scrape type 1
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 31daa97e-ea2c-521e-976b-56fce830e864
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252F2f77e26fc6da469b8dff1e369320e9b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/2f77e26fc6da469b8dff1e369320e9b8/images/large/1.jpg not downloaded yet
2026-03-27 13:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/629/e544a68fa48c49fdb6d2aa81ae950c83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:50 [ayvens.es] INFO: Found listing with ID: 1987058
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987058%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [ayvens.es] INFO: Scrape type for 1987058: 1
2026-03-27 13:34:50 [ayvens.es] INFO: Extracting data for car ID: 1987058
2026-03-27 13:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff32e529-c514-538b-addf-149a77d97328 with identifier: 1987058
2026-03-27 13:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff32e529-c514-538b-addf-149a77d97328 with scrape type 1
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff32e529-c514-538b-addf-149a77d97328
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252F622f4c1021c445fb828ba7ada2e67bca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/622f4c1021c445fb828ba7ada2e67bca/images/large/1.jpg not downloaded yet
2026-03-27 13:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/937/cee22b4dea0b46e3bb5c312d04403d67/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/875/d567578740fb43a0bdf19790784988b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/155/700d98251eff4e608827707bc724d266/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:50 [ayvens.es] INFO: Found listing with ID: 1987059
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987059%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [ayvens.es] INFO: Scrape type for 1987059: 1
2026-03-27 13:34:50 [ayvens.es] INFO: Extracting data for car ID: 1987059
2026-03-27 13:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with identifier: 1987059
2026-03-27 13:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with scrape type 1
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F386%252Fac8267b204f84de68394d60ae76c557e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/386/ac8267b204f84de68394d60ae76c557e/images/large/1.jpg not downloaded yet
2026-03-27 13:34:50 [ayvens.es] INFO: Found listing with ID: 1987060
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987060%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [ayvens.es] INFO: Scrape type for 1987060: 1
2026-03-27 13:34:50 [ayvens.es] INFO: Extracting data for car ID: 1987060
2026-03-27 13:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab040a3c-a2ab-5335-abab-48cacb94932b with identifier: 1987060
2026-03-27 13:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab040a3c-a2ab-5335-abab-48cacb94932b with scrape type 1
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab040a3c-a2ab-5335-abab-48cacb94932b
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F359%252Fb989a951664b45368176cc4e637a92df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/359/b989a951664b45368176cc4e637a92df/images/large/1.jpg not downloaded yet
2026-03-27 13:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/357/96b3cbbdbe034172a72238340c2286d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:50 [ayvens.es] INFO: Found listing with ID: 1987061
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987061%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [ayvens.es] INFO: Scrape type for 1987061: 1
2026-03-27 13:34:50 [ayvens.es] INFO: Extracting data for car ID: 1987061
2026-03-27 13:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c214ccc5-2dff-5f40-a3a6-052893e65fc4 with identifier: 1987061
2026-03-27 13:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c214ccc5-2dff-5f40-a3a6-052893e65fc4 with scrape type 1
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c214ccc5-2dff-5f40-a3a6-052893e65fc4
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F185%252F0a70fc54fafd43dbb5fbd3c67d146306%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/185/0a70fc54fafd43dbb5fbd3c67d146306/images/large/1.jpg not downloaded yet
2026-03-27 13:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bfd790>
2026-03-27 13:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c982ae06-f8d2-5277-be3d-27d61bf4dec1/c982ae06-f8d2-5277-be3d-27d61bf4dec1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252Fe544a68fa48c49fdb6d2aa81ae950c83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/e544a68fa48c49fdb6d2aa81ae950c83/images/large/1.jpg saved to cache
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c982ae06-f8d2-5277-be3d-27d61bf4dec1
2026-03-27 13:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c982ae06-f8d2-5277-be3d-27d61bf4dec1, skipping ID generation
2026-03-27 13:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c982ae06-f8d2-5277-be3d-27d61bf4dec1 with scrape type 1
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c982ae06-f8d2-5277-be3d-27d61bf4dec1 sending to next pipeline
2026-03-27 13:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c982ae06-f8d2-5277-be3d-27d61bf4dec1, identifier: 1987049
2026-03-27 13:34:50 [ayvens.es] INFO: Found listing with ID: 1987062
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987062%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [ayvens.es] INFO: Scrape type for 1987062: 1
2026-03-27 13:34:50 [ayvens.es] INFO: Extracting data for car ID: 1987062
2026-03-27 13:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9daba332-e4fb-5c9e-90ec-db931433510e with identifier: 1987062
2026-03-27 13:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9daba332-e4fb-5c9e-90ec-db931433510e with scrape type 1
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9daba332-e4fb-5c9e-90ec-db931433510e
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252Ff0a40cbb0172435086e1c3729c7ff4ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/f0a40cbb0172435086e1c3729c7ff4ec/images/large/1.jpg not downloaded yet
2026-03-27 13:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c982ae06-f8d2-5277-be3d-27d61bf4dec1 with identifier: 1987049
2026-03-27 13:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c982ae06-f8d2-5277-be3d-27d61bf4dec1 with identifier: 1987049
2026-03-27 13:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c982ae06-f8d2-5277-be3d-27d61bf4dec1 with identifier: 1987049 to the API
2026-03-27 13:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/629/e544a68fa48c49fdb6d2aa81ae950c83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c982ae06-f8d2-5277-be3d-27d61bf4dec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 70680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c982ae06-f8d2-5277-be3d-27d61bf4dec1/c982ae06-f8d2-5277-be3d-27d61bf4dec1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/629/e544a68fa48c49fdb6d2aa81ae950c83/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.0 T-GDi Drive 88kW (120CV)',
 'transmission': 'manual',
 'trim': '1.0 T-GDi Drive 88kW (120CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987049%27 HTTP/1.1" 200 None
2026-03-27 13:34:51 [ayvens.es] INFO: Saving data for 1987049: {'created_time': 1774618491.644522, 'last_price_update_time': 1774618491.644533, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987049') HTTP/1.1" 204 0
2026-03-27 13:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/116fbdd88e4047ba91fb27befdab0308/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297d0ee50>
2026-03-27 13:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fcfd416-b160-5f84-a56f-872cfad01d1c/3fcfd416-b160-5f84-a56f-872cfad01d1c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252Fcee22b4dea0b46e3bb5c312d04403d67%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/cee22b4dea0b46e3bb5c312d04403d67/images/large/1.jpg saved to cache
2026-03-27 13:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fcfd416-b160-5f84-a56f-872cfad01d1c
2026-03-27 13:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fcfd416-b160-5f84-a56f-872cfad01d1c, skipping ID generation
2026-03-27 13:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fcfd416-b160-5f84-a56f-872cfad01d1c with scrape type 1
2026-03-27 13:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fcfd416-b160-5f84-a56f-872cfad01d1c sending to next pipeline
2026-03-27 13:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3fcfd416-b160-5f84-a56f-872cfad01d1c, identifier: 1987052
2026-03-27 13:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f21d10>
2026-03-27 13:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acdde55-82d3-576b-b949-10d37fc6cd39/5acdde55-82d3-576b-b949-10d37fc6cd39_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252Fd567578740fb43a0bdf19790784988b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/d567578740fb43a0bdf19790784988b4/images/large/1.jpg saved to cache
2026-03-27 13:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5acdde55-82d3-576b-b949-10d37fc6cd39
2026-03-27 13:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5acdde55-82d3-576b-b949-10d37fc6cd39, skipping ID generation
2026-03-27 13:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acdde55-82d3-576b-b949-10d37fc6cd39 with scrape type 1
2026-03-27 13:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5acdde55-82d3-576b-b949-10d37fc6cd39 sending to next pipeline
2026-03-27 13:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5acdde55-82d3-576b-b949-10d37fc6cd39, identifier: 1987051
2026-03-27 13:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945cb110>
2026-03-27 13:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c17077e-6c33-5043-914a-587f09533b8d/0c17077e-6c33-5043-914a-587f09533b8d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F155%252F700d98251eff4e608827707bc724d266%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/155/700d98251eff4e608827707bc724d266/images/large/1.jpg saved to cache
2026-03-27 13:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c17077e-6c33-5043-914a-587f09533b8d
2026-03-27 13:34:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c17077e-6c33-5043-914a-587f09533b8d, skipping ID generation
2026-03-27 13:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c17077e-6c33-5043-914a-587f09533b8d with scrape type 1
2026-03-27 13:34:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c17077e-6c33-5043-914a-587f09533b8d sending to next pipeline
2026-03-27 13:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c17077e-6c33-5043-914a-587f09533b8d, identifier: 1987053
2026-03-27 13:34:52 [ayvens.es] INFO: Found listing with ID: 1987063
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987063%27 HTTP/1.1" 200 None
2026-03-27 13:34:52 [ayvens.es] INFO: Scrape type for 1987063: 1
2026-03-27 13:34:52 [ayvens.es] INFO: Extracting data for car ID: 1987063
2026-03-27 13:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with identifier: 1987063
2026-03-27 13:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with scrape type 1
2026-03-27 13:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F542c5682a42f447a82c3bc3efd242bf4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/542c5682a42f447a82c3bc3efd242bf4/images/large/1.jpg not downloaded yet
2026-03-27 13:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3fcfd416-b160-5f84-a56f-872cfad01d1c with identifier: 1987052
2026-03-27 13:34:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3fcfd416-b160-5f84-a56f-872cfad01d1c with identifier: 1987052
2026-03-27 13:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3fcfd416-b160-5f84-a56f-872cfad01d1c with identifier: 1987052 to the API
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/937/cee22b4dea0b46e3bb5c312d04403d67/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Gris montana metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3fcfd416-b160-5f84-a56f-872cfad01d1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 152087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fcfd416-b160-5f84-a56f-872cfad01d1c/3fcfd416-b160-5f84-a56f-872cfad01d1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/937/cee22b4dea0b46e3bb5c312d04403d67/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 220 D 4MATIC',
 'transmission': 'manual',
 'trim': 'GLA 220 D 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987052%27 HTTP/1.1" 200 None
2026-03-27 13:34:52 [ayvens.es] INFO: Saving data for 1987052: {'created_time': 1774618492.550905, 'last_price_update_time': 1774618492.550916, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987052') HTTP/1.1" 204 0
2026-03-27 13:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5acdde55-82d3-576b-b949-10d37fc6cd39 with identifier: 1987051
2026-03-27 13:34:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5acdde55-82d3-576b-b949-10d37fc6cd39 with identifier: 1987051
2026-03-27 13:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5acdde55-82d3-576b-b949-10d37fc6cd39 with identifier: 1987051 to the API
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/875/d567578740fb43a0bdf19790784988b4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Aurora black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '5acdde55-82d3-576b-b949-10d37fc6cd39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'PICANTO',
 'odometer': 104755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acdde55-82d3-576b-b949-10d37fc6cd39/5acdde55-82d3-576b-b949-10d37fc6cd39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/875/d567578740fb43a0bdf19790784988b4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA PICANTO 1.0 DPi 49kW (67CV) Concept',
 'transmission': 'manual',
 'trim': '1.0 DPi 49kW (67CV) Concept',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987051%27 HTTP/1.1" 200 None
2026-03-27 13:34:52 [ayvens.es] INFO: Saving data for 1987051: {'created_time': 1774618492.870808, 'last_price_update_time': 1774618492.870819, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987051') HTTP/1.1" 204 0
2026-03-27 13:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c17077e-6c33-5043-914a-587f09533b8d with identifier: 1987053
2026-03-27 13:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c17077e-6c33-5043-914a-587f09533b8d with identifier: 1987053
2026-03-27 13:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0c17077e-6c33-5043-914a-587f09533b8d with identifier: 1987053 to the API
2026-03-27 13:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/155/700d98251eff4e608827707bc724d266/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c17077e-6c33-5043-914a-587f09533b8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 252334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c17077e-6c33-5043-914a-587f09533b8d/0c17077e-6c33-5043-914a-587f09533b8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/155/700d98251eff4e608827707bc724d266/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Zen dCi 66kW (90CV) -18+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': 'Zen dCi 66kW (90CV) -18+++Revisar peritacion+++',
 'vin': None,
 'year': 2018}
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987053%27 HTTP/1.1" 200 None
2026-03-27 13:34:53 [ayvens.es] INFO: Saving data for 1987053: {'created_time': 1774618493.183085, 'last_price_update_time': 1774618493.183095, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987053') HTTP/1.1" 204 0
2026-03-27 13:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957827d0>
2026-03-27 13:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f665c6-b78e-5838-8359-c8f5f8d0b67b/94f665c6-b78e-5838-8359-c8f5f8d0b67b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252F96b3cbbdbe034172a72238340c2286d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/96b3cbbdbe034172a72238340c2286d9/images/large/1.jpg saved to cache
2026-03-27 13:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b
2026-03-27 13:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94f665c6-b78e-5838-8359-c8f5f8d0b67b, skipping ID generation
2026-03-27 13:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b with scrape type 1
2026-03-27 13:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b sending to next pipeline
2026-03-27 13:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94f665c6-b78e-5838-8359-c8f5f8d0b67b, identifier: 1987050
2026-03-27 13:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/693/622f4c1021c445fb828ba7ada2e67bca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:53 [ayvens.es] INFO: Found listing with ID: 1987064
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987064%27 HTTP/1.1" 200 None
2026-03-27 13:34:53 [ayvens.es] INFO: Scrape type for 1987064: 1
2026-03-27 13:34:53 [ayvens.es] INFO: Extracting data for car ID: 1987064
2026-03-27 13:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e78caea-4347-54b9-9fca-42b45e2bdd81 with identifier: 1987064
2026-03-27 13:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e78caea-4347-54b9-9fca-42b45e2bdd81 with scrape type 1
2026-03-27 13:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e78caea-4347-54b9-9fca-42b45e2bdd81
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F974%252Ffdf6bd188fea43d7b713ad0bb2ae40e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/974/fdf6bd188fea43d7b713ad0bb2ae40e2/images/large/1.jpg not downloaded yet
2026-03-27 13:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94f665c6-b78e-5838-8359-c8f5f8d0b67b with identifier: 1987050
2026-03-27 13:34:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94f665c6-b78e-5838-8359-c8f5f8d0b67b with identifier: 1987050
2026-03-27 13:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94f665c6-b78e-5838-8359-c8f5f8d0b67b with identifier: 1987050 to the API
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/357/96b3cbbdbe034172a72238340c2286d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Gris titanium',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '94f665c6-b78e-5838-8359-c8f5f8d0b67b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 199444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f665c6-b78e-5838-8359-c8f5f8d0b67b/94f665c6-b78e-5838-8359-c8f5f8d0b67b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/357/96b3cbbdbe034172a72238340c2286d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Sp. Tou. Limited Energy dCi 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Sp. Tou. Limited Energy dCi 81kW (110CV)',
 'vin': None,
 'year': 2018}
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987050%27 HTTP/1.1" 200 None
2026-03-27 13:34:53 [ayvens.es] INFO: Saving data for 1987050: {'created_time': 1774618493.705498, 'last_price_update_time': 1774618493.705508, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987050') HTTP/1.1" 204 0
2026-03-27 13:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956cad10>
2026-03-27 13:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0707208e-e750-5e7c-bdfc-56e185672570/0707208e-e750-5e7c-bdfc-56e185672570_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F116fbdd88e4047ba91fb27befdab0308%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/116fbdd88e4047ba91fb27befdab0308/images/large/1.jpg saved to cache
2026-03-27 13:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0707208e-e750-5e7c-bdfc-56e185672570
2026-03-27 13:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0707208e-e750-5e7c-bdfc-56e185672570, skipping ID generation
2026-03-27 13:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0707208e-e750-5e7c-bdfc-56e185672570 with scrape type 1
2026-03-27 13:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0707208e-e750-5e7c-bdfc-56e185672570 sending to next pipeline
2026-03-27 13:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0707208e-e750-5e7c-bdfc-56e185672570, identifier: 1987054
2026-03-27 13:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0707208e-e750-5e7c-bdfc-56e185672570 with identifier: 1987054
2026-03-27 13:34:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0707208e-e750-5e7c-bdfc-56e185672570 with identifier: 1987054
2026-03-27 13:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0707208e-e750-5e7c-bdfc-56e185672570 with identifier: 1987054 to the API
2026-03-27 13:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/735/116fbdd88e4047ba91fb27befdab0308/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco bila',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0707208e-e750-5e7c-bdfc-56e185672570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 41476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0707208e-e750-5e7c-bdfc-56e185672570/0707208e-e750-5e7c-bdfc-56e185672570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/116fbdd88e4047ba91fb27befdab0308/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 85kW (115CV) S&S Style Go M',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) S&S Style Go M',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987054%27 HTTP/1.1" 200 None
2026-03-27 13:34:54 [ayvens.es] INFO: Saving data for 1987054: {'created_time': 1774618494.202008, 'last_price_update_time': 1774618494.202018, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987054') HTTP/1.1" 204 0
2026-03-27 13:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/386/ac8267b204f84de68394d60ae76c557e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:54 [ayvens.es] INFO: Found listing with ID: 1987065
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987065%27 HTTP/1.1" 200 None
2026-03-27 13:34:54 [ayvens.es] INFO: Scrape type for 1987065: 1
2026-03-27 13:34:54 [ayvens.es] INFO: Extracting data for car ID: 1987065
2026-03-27 13:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21885d57-3238-50eb-9785-950dafa1429e with identifier: 1987065
2026-03-27 13:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21885d57-3238-50eb-9785-950dafa1429e with scrape type 1
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21885d57-3238-50eb-9785-950dafa1429e
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F362%252Fb83b03fecdc44f28820b054bfd5e39c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/362/b83b03fecdc44f28820b054bfd5e39c4/images/large/1.jpg not downloaded yet
2026-03-27 13:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/793/08831782b1314494af8eeb95b96c0afd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/359/b989a951664b45368176cc4e637a92df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ff3fd0>
2026-03-27 13:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff32e529-c514-538b-addf-149a77d97328/ff32e529-c514-538b-addf-149a77d97328_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252F622f4c1021c445fb828ba7ada2e67bca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/622f4c1021c445fb828ba7ada2e67bca/images/large/1.jpg saved to cache
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff32e529-c514-538b-addf-149a77d97328
2026-03-27 13:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff32e529-c514-538b-addf-149a77d97328, skipping ID generation
2026-03-27 13:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff32e529-c514-538b-addf-149a77d97328 with scrape type 1
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff32e529-c514-538b-addf-149a77d97328 sending to next pipeline
2026-03-27 13:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff32e529-c514-538b-addf-149a77d97328, identifier: 1987058
2026-03-27 13:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/259/2f77e26fc6da469b8dff1e369320e9b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:54 [ayvens.es] INFO: Found listing with ID: 1987066
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987066%27 HTTP/1.1" 200 None
2026-03-27 13:34:54 [ayvens.es] INFO: Scrape type for 1987066: 1
2026-03-27 13:34:54 [ayvens.es] INFO: Extracting data for car ID: 1987066
2026-03-27 13:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with identifier: 1987066
2026-03-27 13:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with scrape type 1
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F51bec064e176498b8b139d23ff575c5c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/51bec064e176498b8b139d23ff575c5c/images/large/1.jpg not downloaded yet
2026-03-27 13:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff32e529-c514-538b-addf-149a77d97328 with identifier: 1987058
2026-03-27 13:34:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff32e529-c514-538b-addf-149a77d97328 with identifier: 1987058
2026-03-27 13:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ff32e529-c514-538b-addf-149a77d97328 with identifier: 1987058 to the API
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/693/622f4c1021c445fb828ba7ada2e67bca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Crystal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff32e529-c514-538b-addf-149a77d97328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 63527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff32e529-c514-538b-addf-149a77d97328/ff32e529-c514-538b-addf-149a77d97328_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/693/622f4c1021c445fb828ba7ada2e67bca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 BlueHDi 130 auto BASTILLE +',
 'transmission': 'manual',
 'trim': 'BlueHDi 130 auto BASTILLE +',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987058%27 HTTP/1.1" 200 None
2026-03-27 13:34:54 [ayvens.es] INFO: Saving data for 1987058: {'created_time': 1774618494.768503, 'last_price_update_time': 1774618494.768514, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987058') HTTP/1.1" 204 0
2026-03-27 13:34:54 [ayvens.es] INFO: Found listing with ID: 1987067
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987067%27 HTTP/1.1" 200 None
2026-03-27 13:34:54 [ayvens.es] INFO: Scrape type for 1987067: 1
2026-03-27 13:34:54 [ayvens.es] INFO: Extracting data for car ID: 1987067
2026-03-27 13:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 220d33e6-f3d5-5693-9c9c-4a09071c9284 with identifier: 1987067
2026-03-27 13:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 220d33e6-f3d5-5693-9c9c-4a09071c9284 with scrape type 1
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 220d33e6-f3d5-5693-9c9c-4a09071c9284
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F093%252F9c7fbd4066b94d51bfec917c871f60d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/093/9c7fbd4066b94d51bfec917c871f60d3/images/large/1.jpg not downloaded yet
2026-03-27 13:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/185/0a70fc54fafd43dbb5fbd3c67d146306/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/026/f0a40cbb0172435086e1c3729c7ff4ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529600b950>
2026-03-27 13:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40136e21-40ef-58c7-a992-ad6d1f49a7c2/40136e21-40ef-58c7-a992-ad6d1f49a7c2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F386%252Fac8267b204f84de68394d60ae76c557e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/386/ac8267b204f84de68394d60ae76c557e/images/large/1.jpg saved to cache
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2
2026-03-27 13:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40136e21-40ef-58c7-a992-ad6d1f49a7c2, skipping ID generation
2026-03-27 13:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with scrape type 1
2026-03-27 13:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2 sending to next pipeline
2026-03-27 13:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 40136e21-40ef-58c7-a992-ad6d1f49a7c2, identifier: 1987059
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295742790>
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4629a284-38c4-5756-9b8e-221ff331da09/4629a284-38c4-5756-9b8e-221ff331da09_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252F08831782b1314494af8eeb95b96c0afd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/08831782b1314494af8eeb95b96c0afd/images/large/1.jpg saved to cache
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4629a284-38c4-5756-9b8e-221ff331da09
2026-03-27 13:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4629a284-38c4-5756-9b8e-221ff331da09, skipping ID generation
2026-03-27 13:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4629a284-38c4-5756-9b8e-221ff331da09 with scrape type 1
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4629a284-38c4-5756-9b8e-221ff331da09 sending to next pipeline
2026-03-27 13:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4629a284-38c4-5756-9b8e-221ff331da09, identifier: 1987056
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f22cd0>
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab040a3c-a2ab-5335-abab-48cacb94932b/ab040a3c-a2ab-5335-abab-48cacb94932b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F359%252Fb989a951664b45368176cc4e637a92df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/359/b989a951664b45368176cc4e637a92df/images/large/1.jpg saved to cache
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab040a3c-a2ab-5335-abab-48cacb94932b
2026-03-27 13:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab040a3c-a2ab-5335-abab-48cacb94932b, skipping ID generation
2026-03-27 13:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab040a3c-a2ab-5335-abab-48cacb94932b with scrape type 1
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab040a3c-a2ab-5335-abab-48cacb94932b sending to next pipeline
2026-03-27 13:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab040a3c-a2ab-5335-abab-48cacb94932b, identifier: 1987060
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529615d9d0>
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31daa97e-ea2c-521e-976b-56fce830e864/31daa97e-ea2c-521e-976b-56fce830e864_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252F2f77e26fc6da469b8dff1e369320e9b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/2f77e26fc6da469b8dff1e369320e9b8/images/large/1.jpg saved to cache
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31daa97e-ea2c-521e-976b-56fce830e864
2026-03-27 13:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31daa97e-ea2c-521e-976b-56fce830e864, skipping ID generation
2026-03-27 13:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31daa97e-ea2c-521e-976b-56fce830e864 with scrape type 1
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31daa97e-ea2c-521e-976b-56fce830e864 sending to next pipeline
2026-03-27 13:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 31daa97e-ea2c-521e-976b-56fce830e864, identifier: 1987057
2026-03-27 13:34:55 [ayvens.es] INFO: Found listing with ID: 1987068
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987068%27 HTTP/1.1" 200 None
2026-03-27 13:34:55 [ayvens.es] INFO: Scrape type for 1987068: 1
2026-03-27 13:34:55 [ayvens.es] INFO: Extracting data for car ID: 1987068
2026-03-27 13:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8 with identifier: 1987068
2026-03-27 13:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8 with scrape type 1
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F616%252F2152701208a841d59302c38b71a2405e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/616/2152701208a841d59302c38b71a2405e/images/large/1.jpg not downloaded yet
2026-03-27 13:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with identifier: 1987059
2026-03-27 13:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with identifier: 1987059
2026-03-27 13:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with identifier: 1987059 to the API
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/386/ac8267b204f84de68394d60ae76c557e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '40136e21-40ef-58c7-a992-ad6d1f49a7c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'PANDA',
 'odometer': 52416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40136e21-40ef-58c7-a992-ad6d1f49a7c2/40136e21-40ef-58c7-a992-ad6d1f49a7c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/386/ac8267b204f84de68394d60ae76c557e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT PANDA Van Hybrid 1.0 GSE 52kW (70 CV) 2 plazas',
 'transmission': 'manual',
 'trim': 'Van Hybrid 1.0 GSE 52kW (70 CV) 2 plazas',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987059%27 HTTP/1.1" 200 None
2026-03-27 13:34:55 [ayvens.es] INFO: Saving data for 1987059: {'created_time': 1774618495.943917, 'last_price_update_time': 1774618495.943928, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987059') HTTP/1.1" 204 0
2026-03-27 13:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4629a284-38c4-5756-9b8e-221ff331da09 with identifier: 1987056
2026-03-27 13:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4629a284-38c4-5756-9b8e-221ff331da09 with identifier: 1987056
2026-03-27 13:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4629a284-38c4-5756-9b8e-221ff331da09 with identifier: 1987056 to the API
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/793/08831782b1314494af8eeb95b96c0afd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4629a284-38c4-5756-9b8e-221ff331da09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 AIRCROSS',
 'odometer': 240862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4629a284-38c4-5756-9b8e-221ff331da09/4629a284-38c4-5756-9b8e-221ff331da09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/793/08831782b1314494af8eeb95b96c0afd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 AIRCROSS HDi 115 Stop & Start 6v 4WD Shine+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'HDi 115 Stop & Start 6v 4WD Shine+++Revisar peritacion+++',
 'vin': None,
 'year': 2017}
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987056%27 HTTP/1.1" 200 None
2026-03-27 13:34:56 [ayvens.es] INFO: Saving data for 1987056: {'created_time': 1774618496.287161, 'last_price_update_time': 1774618496.287171, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987056') HTTP/1.1" 204 0
2026-03-27 13:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab040a3c-a2ab-5335-abab-48cacb94932b with identifier: 1987060
2026-03-27 13:34:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab040a3c-a2ab-5335-abab-48cacb94932b with identifier: 1987060
2026-03-27 13:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab040a3c-a2ab-5335-abab-48cacb94932b with identifier: 1987060 to the API
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/359/b989a951664b45368176cc4e637a92df/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Saphirschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab040a3c-a2ab-5335-abab-48cacb94932b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 1',
 'odometer': 82176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab040a3c-a2ab-5335-abab-48cacb94932b/ab040a3c-a2ab-5335-abab-48cacb94932b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/359/b989a951664b45368176cc4e637a92df/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 1 118d',
 'transmission': 'manual',
 'trim': '118d',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987060%27 HTTP/1.1" 200 None
2026-03-27 13:34:56 [ayvens.es] INFO: Saving data for 1987060: {'created_time': 1774618496.616315, 'last_price_update_time': 1774618496.616325, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987060') HTTP/1.1" 204 0
2026-03-27 13:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 31daa97e-ea2c-521e-976b-56fce830e864 with identifier: 1987057
2026-03-27 13:34:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 31daa97e-ea2c-521e-976b-56fce830e864 with identifier: 1987057
2026-03-27 13:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 31daa97e-ea2c-521e-976b-56fce830e864 with identifier: 1987057 to the API
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/259/2f77e26fc6da469b8dff1e369320e9b8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco ibis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '31daa97e-ea2c-521e-976b-56fce830e864',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 90870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31daa97e-ea2c-521e-976b-56fce830e864/31daa97e-ea2c-521e-976b-56fce830e864_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/259/2f77e26fc6da469b8dff1e369320e9b8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2022}
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987057%27 HTTP/1.1" 200 None
2026-03-27 13:34:56 [ayvens.es] INFO: Saving data for 1987057: {'created_time': 1774618496.960904, 'last_price_update_time': 1774618496.960914, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987057') HTTP/1.1" 204 0
2026-03-27 13:34:56 [ayvens.es] INFO: Found listing with ID: 1987069
2026-03-27 13:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987069%27 HTTP/1.1" 200 None
2026-03-27 13:34:57 [ayvens.es] INFO: Scrape type for 1987069: 1
2026-03-27 13:34:57 [ayvens.es] INFO: Extracting data for car ID: 1987069
2026-03-27 13:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c with identifier: 1987069
2026-03-27 13:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c with scrape type 1
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F255%252Ff75be681fbff488a9561bad628594ed9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/255/f75be681fbff488a9561bad628594ed9/images/large/1.jpg not downloaded yet
2026-03-27 13:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/974/fdf6bd188fea43d7b713ad0bb2ae40e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529577c510>
2026-03-27 13:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c214ccc5-2dff-5f40-a3a6-052893e65fc4/c214ccc5-2dff-5f40-a3a6-052893e65fc4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F185%252F0a70fc54fafd43dbb5fbd3c67d146306%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/185/0a70fc54fafd43dbb5fbd3c67d146306/images/large/1.jpg saved to cache
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c214ccc5-2dff-5f40-a3a6-052893e65fc4
2026-03-27 13:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c214ccc5-2dff-5f40-a3a6-052893e65fc4, skipping ID generation
2026-03-27 13:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c214ccc5-2dff-5f40-a3a6-052893e65fc4 with scrape type 1
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c214ccc5-2dff-5f40-a3a6-052893e65fc4 sending to next pipeline
2026-03-27 13:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c214ccc5-2dff-5f40-a3a6-052893e65fc4, identifier: 1987061
2026-03-27 13:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297947c10>
2026-03-27 13:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9daba332-e4fb-5c9e-90ec-db931433510e/9daba332-e4fb-5c9e-90ec-db931433510e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252Ff0a40cbb0172435086e1c3729c7ff4ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/f0a40cbb0172435086e1c3729c7ff4ec/images/large/1.jpg saved to cache
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9daba332-e4fb-5c9e-90ec-db931433510e
2026-03-27 13:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9daba332-e4fb-5c9e-90ec-db931433510e, skipping ID generation
2026-03-27 13:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9daba332-e4fb-5c9e-90ec-db931433510e with scrape type 1
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9daba332-e4fb-5c9e-90ec-db931433510e sending to next pipeline
2026-03-27 13:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9daba332-e4fb-5c9e-90ec-db931433510e, identifier: 1987062
2026-03-27 13:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/948/542c5682a42f447a82c3bc3efd242bf4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:57 [ayvens.es] INFO: Found listing with ID: 1987070
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987070%27 HTTP/1.1" 200 None
2026-03-27 13:34:57 [ayvens.es] INFO: Scrape type for 1987070: 1
2026-03-27 13:34:57 [ayvens.es] INFO: Extracting data for car ID: 1987070
2026-03-27 13:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fd04e39-e527-597f-9c3d-eb87a28aa8c9 with identifier: 1987070
2026-03-27 13:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd04e39-e527-597f-9c3d-eb87a28aa8c9 with scrape type 1
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6fd04e39-e527-597f-9c3d-eb87a28aa8c9
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Fa9edc09f655a49bab7d40a397394f6c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/a9edc09f655a49bab7d40a397394f6c9/images/large/1.jpg not downloaded yet
2026-03-27 13:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c214ccc5-2dff-5f40-a3a6-052893e65fc4 with identifier: 1987061
2026-03-27 13:34:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c214ccc5-2dff-5f40-a3a6-052893e65fc4 with identifier: 1987061
2026-03-27 13:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c214ccc5-2dff-5f40-a3a6-052893e65fc4 with identifier: 1987061 to the API
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/185/0a70fc54fafd43dbb5fbd3c67d146306/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Gris selenita metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c214ccc5-2dff-5f40-a3a6-052893e65fc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 172881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c214ccc5-2dff-5f40-a3a6-052893e65fc4/c214ccc5-2dff-5f40-a3a6-052893e65fc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/185/0a70fc54fafd43dbb5fbd3c67d146306/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 300 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 d 4MATIC',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987061%27 HTTP/1.1" 200 None
2026-03-27 13:34:57 [ayvens.es] INFO: Saving data for 1987061: {'created_time': 1774618497.911192, 'last_price_update_time': 1774618497.911203, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987061') HTTP/1.1" 204 0
2026-03-27 13:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9daba332-e4fb-5c9e-90ec-db931433510e with identifier: 1987062
2026-03-27 13:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9daba332-e4fb-5c9e-90ec-db931433510e with identifier: 1987062
2026-03-27 13:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9daba332-e4fb-5c9e-90ec-db931433510e with identifier: 1987062 to the API
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/026/f0a40cbb0172435086e1c3729c7ff4ec/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '9daba332-e4fb-5c9e-90ec-db931433510e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 165462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9daba332-e4fb-5c9e-90ec-db931433510e/9daba332-e4fb-5c9e-90ec-db931433510e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/026/f0a40cbb0172435086e1c3729c7ff4ec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987062%27 HTTP/1.1" 200 None
2026-03-27 13:34:58 [ayvens.es] INFO: Saving data for 1987062: {'created_time': 1774618498.243271, 'last_price_update_time': 1774618498.243282, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987062') HTTP/1.1" 204 0
2026-03-27 13:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/362/b83b03fecdc44f28820b054bfd5e39c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:58 [ayvens.es] INFO: Found listing with ID: 1987071
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987071%27 HTTP/1.1" 200 None
2026-03-27 13:34:58 [ayvens.es] INFO: Scrape type for 1987071: 1
2026-03-27 13:34:58 [ayvens.es] INFO: Extracting data for car ID: 1987071
2026-03-27 13:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c6a1af2-05a0-506f-8587-50d4a25d5a0f with identifier: 1987071
2026-03-27 13:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6a1af2-05a0-506f-8587-50d4a25d5a0f with scrape type 1
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4c6a1af2-05a0-506f-8587-50d4a25d5a0f
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F609%252F0ec92e151a5d4a338dffde177a1d0fca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/609/0ec92e151a5d4a338dffde177a1d0fca/images/large/1.jpg not downloaded yet
2026-03-27 13:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/51bec064e176498b8b139d23ff575c5c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bfeed0>
2026-03-27 13:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e78caea-4347-54b9-9fca-42b45e2bdd81/3e78caea-4347-54b9-9fca-42b45e2bdd81_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F974%252Ffdf6bd188fea43d7b713ad0bb2ae40e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/974/fdf6bd188fea43d7b713ad0bb2ae40e2/images/large/1.jpg saved to cache
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e78caea-4347-54b9-9fca-42b45e2bdd81
2026-03-27 13:34:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e78caea-4347-54b9-9fca-42b45e2bdd81, skipping ID generation
2026-03-27 13:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e78caea-4347-54b9-9fca-42b45e2bdd81 with scrape type 1
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e78caea-4347-54b9-9fca-42b45e2bdd81 sending to next pipeline
2026-03-27 13:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e78caea-4347-54b9-9fca-42b45e2bdd81, identifier: 1987064
2026-03-27 13:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945ead50>
2026-03-27 13:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4d41d6-5421-5048-b19d-d79c0ff5c6a6/dd4d41d6-5421-5048-b19d-d79c0ff5c6a6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F542c5682a42f447a82c3bc3efd242bf4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/542c5682a42f447a82c3bc3efd242bf4/images/large/1.jpg saved to cache
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6
2026-03-27 13:34:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6, skipping ID generation
2026-03-27 13:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with scrape type 1
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 sending to next pipeline
2026-03-27 13:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6, identifier: 1987063
2026-03-27 13:34:58 [ayvens.es] INFO: Found listing with ID: 1987072
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987072%27 HTTP/1.1" 200 None
2026-03-27 13:34:58 [ayvens.es] INFO: Scrape type for 1987072: 1
2026-03-27 13:34:58 [ayvens.es] INFO: Extracting data for car ID: 1987072
2026-03-27 13:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8e77080-12f1-5880-86a5-8f2c80d2b068 with identifier: 1987072
2026-03-27 13:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8e77080-12f1-5880-86a5-8f2c80d2b068 with scrape type 1
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d8e77080-12f1-5880-86a5-8f2c80d2b068
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F789%252F28e8b989114043aaa69c8aa0c7e6b427%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/789/28e8b989114043aaa69c8aa0c7e6b427/images/large/1.jpg not downloaded yet
2026-03-27 13:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e78caea-4347-54b9-9fca-42b45e2bdd81 with identifier: 1987064
2026-03-27 13:34:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e78caea-4347-54b9-9fca-42b45e2bdd81 with identifier: 1987064
2026-03-27 13:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e78caea-4347-54b9-9fca-42b45e2bdd81 with identifier: 1987064 to the API
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/974/fdf6bd188fea43d7b713ad0bb2ae40e2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e78caea-4347-54b9-9fca-42b45e2bdd81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 183544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e78caea-4347-54b9-9fca-42b45e2bdd81/3e78caea-4347-54b9-9fca-42b45e2bdd81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/974/fdf6bd188fea43d7b713ad0bb2ae40e2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS Sedan A 200 d',
 'transmission': 'manual',
 'trim': 'Sedan A 200 d',
 'vin': None,
 'year': 2021}
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987064%27 HTTP/1.1" 200 None
2026-03-27 13:34:59 [ayvens.es] INFO: Saving data for 1987064: {'created_time': 1774618499.065908, 'last_price_update_time': 1774618499.065919, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987064') HTTP/1.1" 204 0
2026-03-27 13:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with identifier: 1987063
2026-03-27 13:34:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with identifier: 1987063
2026-03-27 13:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with identifier: 1987063 to the API
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/948/542c5682a42f447a82c3bc3efd242bf4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'Baltico azul s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dd4d41d6-5421-5048-b19d-d79c0ff5c6a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 58403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd4d41d6-5421-5048-b19d-d79c0ff5c6a6/dd4d41d6-5421-5048-b19d-d79c0ff5c6a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/948/542c5682a42f447a82c3bc3efd242bf4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-11',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Kombi 2.0 EcoBlue 110kW 320 L1 Trend',
 'transmission': 'manual',
 'trim': 'Kombi 2.0 EcoBlue 110kW 320 L1 Trend',
 'vin': None,
 'year': 2024}
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987063%27 HTTP/1.1" 200 None
2026-03-27 13:34:59 [ayvens.es] INFO: Saving data for 1987063: {'created_time': 1774618499.394097, 'last_price_update_time': 1774618499.394106, 'auction_closing_time': 1774868400.0}
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987063') HTTP/1.1" 204 0
2026-03-27 13:34:59 [ayvens.es] INFO: Found listing with ID: 1987073
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987073%27 HTTP/1.1" 200 None
2026-03-27 13:34:59 [ayvens.es] INFO: Scrape type for 1987073: 1
2026-03-27 13:34:59 [ayvens.es] INFO: Extracting data for car ID: 1987073
2026-03-27 13:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e41414e2-f23f-514d-b989-aeba76ff2be5 with identifier: 1987073
2026-03-27 13:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e41414e2-f23f-514d-b989-aeba76ff2be5 with scrape type 1
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e41414e2-f23f-514d-b989-aeba76ff2be5
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F224%252F809e3d3519314eb5b3f592d25545a3a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/224/809e3d3519314eb5b3f592d25545a3a9/images/large/1.jpg not downloaded yet
2026-03-27 13:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b3790>
2026-03-27 13:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21885d57-3238-50eb-9785-950dafa1429e/21885d57-3238-50eb-9785-950dafa1429e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F362%252Fb83b03fecdc44f28820b054bfd5e39c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/362/b83b03fecdc44f28820b054bfd5e39c4/images/large/1.jpg saved to cache
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21885d57-3238-50eb-9785-950dafa1429e
2026-03-27 13:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21885d57-3238-50eb-9785-950dafa1429e, skipping ID generation
2026-03-27 13:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21885d57-3238-50eb-9785-950dafa1429e with scrape type 1
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21885d57-3238-50eb-9785-950dafa1429e sending to next pipeline
2026-03-27 13:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 21885d57-3238-50eb-9785-950dafa1429e, identifier: 1987065
2026-03-27 13:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295faa4d0>
2026-03-27 13:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e73e61-55a3-5ca0-99ad-ca0dc26c227f/d9e73e61-55a3-5ca0-99ad-ca0dc26c227f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F51bec064e176498b8b139d23ff575c5c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/51bec064e176498b8b139d23ff575c5c/images/large/1.jpg saved to cache
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f
2026-03-27 13:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f, skipping ID generation
2026-03-27 13:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with scrape type 1
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f sending to next pipeline
2026-03-27 13:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f, identifier: 1987066
2026-03-27 13:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/093/9c7fbd4066b94d51bfec917c871f60d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:34:59 [ayvens.es] INFO: Found listing with ID: 1987074
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987074%27 HTTP/1.1" 200 None
2026-03-27 13:34:59 [ayvens.es] INFO: Scrape type for 1987074: 1
2026-03-27 13:34:59 [ayvens.es] INFO: Extracting data for car ID: 1987074
2026-03-27 13:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 597c1393-d297-5f8e-993d-5e2764cec8c2 with identifier: 1987074
2026-03-27 13:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 597c1393-d297-5f8e-993d-5e2764cec8c2 with scrape type 1
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 597c1393-d297-5f8e-993d-5e2764cec8c2
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F551%252Fab245d324dd3441eb3e5f3a002e5d374%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/551/ab245d324dd3441eb3e5f3a002e5d374/images/large/1.jpg not downloaded yet
2026-03-27 13:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 21885d57-3238-50eb-9785-950dafa1429e with identifier: 1987065
2026-03-27 13:34:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 21885d57-3238-50eb-9785-950dafa1429e with identifier: 1987065
2026-03-27 13:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 21885d57-3238-50eb-9785-950dafa1429e with identifier: 1987065 to the API
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/362/b83b03fecdc44f28820b054bfd5e39c4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '21885d57-3238-50eb-9785-950dafa1429e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 141361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21885d57-3238-50eb-9785-950dafa1429e/21885d57-3238-50eb-9785-950dafa1429e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/362/b83b03fecdc44f28820b054bfd5e39c4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987065%27 HTTP/1.1" 200 None
2026-03-27 13:35:00 [ayvens.es] INFO: Saving data for 1987065: {'created_time': 1774618500.265147, 'last_price_update_time': 1774618500.265157, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987065') HTTP/1.1" 204 0
2026-03-27 13:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with identifier: 1987066
2026-03-27 13:35:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with identifier: 1987066
2026-03-27 13:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with identifier: 1987066 to the API
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/51bec064e176498b8b139d23ff575c5c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco digital',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd9e73e61-55a3-5ca0-99ad-ca0dc26c227f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 142250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e73e61-55a3-5ca0-99ad-ca0dc26c227f/d9e73e61-55a3-5ca0-99ad-ca0dc26c227f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/51bec064e176498b8b139d23ff575c5c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS B 180 d',
 'transmission': 'manual',
 'trim': 'B 180 d',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987066%27 HTTP/1.1" 200 None
2026-03-27 13:35:00 [ayvens.es] INFO: Saving data for 1987066: {'created_time': 1774618500.582184, 'last_price_update_time': 1774618500.582195, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987066') HTTP/1.1" 204 0
2026-03-27 13:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/616/2152701208a841d59302c38b71a2405e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:00 [ayvens.es] INFO: Found listing with ID: 1987075
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987075%27 HTTP/1.1" 200 None
2026-03-27 13:35:00 [ayvens.es] INFO: Scrape type for 1987075: 1
2026-03-27 13:35:00 [ayvens.es] INFO: Extracting data for car ID: 1987075
2026-03-27 13:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315ac401-479d-5b06-8416-65bb2922bde4 with identifier: 1987075
2026-03-27 13:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315ac401-479d-5b06-8416-65bb2922bde4 with scrape type 1
2026-03-27 13:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 315ac401-479d-5b06-8416-65bb2922bde4
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F971%252F3fc5da49a2614246b424a42abcb7f0d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/971/3fc5da49a2614246b424a42abcb7f0d5/images/large/1.jpg not downloaded yet
2026-03-27 13:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/365/a9edc09f655a49bab7d40a397394f6c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b0a90>
2026-03-27 13:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_220d33e6-f3d5-5693-9c9c-4a09071c9284/220d33e6-f3d5-5693-9c9c-4a09071c9284_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F093%252F9c7fbd4066b94d51bfec917c871f60d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/093/9c7fbd4066b94d51bfec917c871f60d3/images/large/1.jpg saved to cache
2026-03-27 13:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 220d33e6-f3d5-5693-9c9c-4a09071c9284
2026-03-27 13:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 220d33e6-f3d5-5693-9c9c-4a09071c9284, skipping ID generation
2026-03-27 13:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 220d33e6-f3d5-5693-9c9c-4a09071c9284 with scrape type 1
2026-03-27 13:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 220d33e6-f3d5-5693-9c9c-4a09071c9284 sending to next pipeline
2026-03-27 13:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 220d33e6-f3d5-5693-9c9c-4a09071c9284, identifier: 1987067
2026-03-27 13:35:00 [ayvens.es] INFO: Found listing with ID: 1987076
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987076%27 HTTP/1.1" 200 None
2026-03-27 13:35:00 [ayvens.es] INFO: Scrape type for 1987076: 1
2026-03-27 13:35:00 [ayvens.es] INFO: Extracting data for car ID: 1987076
2026-03-27 13:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e664ab6d-541c-5640-9bf8-351c24c1e970 with identifier: 1987076
2026-03-27 13:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e664ab6d-541c-5640-9bf8-351c24c1e970 with scrape type 1
2026-03-27 13:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e664ab6d-541c-5640-9bf8-351c24c1e970
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F864%252Fe14f8414c1e24b1798da6f7175d7238b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/864/e14f8414c1e24b1798da6f7175d7238b/images/large/1.jpg not downloaded yet
2026-03-27 13:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 220d33e6-f3d5-5693-9c9c-4a09071c9284 with identifier: 1987067
2026-03-27 13:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 220d33e6-f3d5-5693-9c9c-4a09071c9284 with identifier: 1987067
2026-03-27 13:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 220d33e6-f3d5-5693-9c9c-4a09071c9284 with identifier: 1987067 to the API
2026-03-27 13:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/093/9c7fbd4066b94d51bfec917c871f60d3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '220d33e6-f3d5-5693-9c9c-4a09071c9284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 79970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_220d33e6-f3d5-5693-9c9c-4a09071c9284/220d33e6-f3d5-5693-9c9c-4a09071c9284_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/093/9c7fbd4066b94d51bfec917c871f60d3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 Energy BluedCi 88 kW+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 Energy BluedCi 88 kW+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987067%27 HTTP/1.1" 200 None
2026-03-27 13:35:01 [ayvens.es] INFO: Saving data for 1987067: {'created_time': 1774618501.24551, 'last_price_update_time': 1774618501.245524, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987067') HTTP/1.1" 204 0
2026-03-27 13:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/255/f75be681fbff488a9561bad628594ed9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:01 [ayvens.es] INFO: Found listing with ID: 1987077
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987077%27 HTTP/1.1" 200 None
2026-03-27 13:35:01 [ayvens.es] INFO: Scrape type for 1987077: 1
2026-03-27 13:35:01 [ayvens.es] INFO: Extracting data for car ID: 1987077
2026-03-27 13:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e56b3f9-2fd5-53e9-98e4-73d967794834 with identifier: 1987077
2026-03-27 13:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e56b3f9-2fd5-53e9-98e4-73d967794834 with scrape type 1
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e56b3f9-2fd5-53e9-98e4-73d967794834
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F689%252F68a4e11c8bc24f628910db6ad3f3dc7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/689/68a4e11c8bc24f628910db6ad3f3dc7b/images/large/1.jpg not downloaded yet
2026-03-27 13:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295794e90>
2026-03-27 13:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afaedd5-9f88-5e13-9af7-da1c60f0a2d8/2afaedd5-9f88-5e13-9af7-da1c60f0a2d8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F616%252F2152701208a841d59302c38b71a2405e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/616/2152701208a841d59302c38b71a2405e/images/large/1.jpg saved to cache
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8
2026-03-27 13:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8, skipping ID generation
2026-03-27 13:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8 with scrape type 1
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8 sending to next pipeline
2026-03-27 13:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8, identifier: 1987068
2026-03-27 13:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957967d0>
2026-03-27 13:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fd04e39-e527-597f-9c3d-eb87a28aa8c9/6fd04e39-e527-597f-9c3d-eb87a28aa8c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Fa9edc09f655a49bab7d40a397394f6c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/a9edc09f655a49bab7d40a397394f6c9/images/large/1.jpg saved to cache
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fd04e39-e527-597f-9c3d-eb87a28aa8c9
2026-03-27 13:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fd04e39-e527-597f-9c3d-eb87a28aa8c9, skipping ID generation
2026-03-27 13:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd04e39-e527-597f-9c3d-eb87a28aa8c9 with scrape type 1
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fd04e39-e527-597f-9c3d-eb87a28aa8c9 sending to next pipeline
2026-03-27 13:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6fd04e39-e527-597f-9c3d-eb87a28aa8c9, identifier: 1987070
2026-03-27 13:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/609/0ec92e151a5d4a338dffde177a1d0fca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/789/28e8b989114043aaa69c8aa0c7e6b427/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:01 [ayvens.es] INFO: Found listing with ID: 1987078
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987078%27 HTTP/1.1" 200 None
2026-03-27 13:35:01 [ayvens.es] INFO: Scrape type for 1987078: 1
2026-03-27 13:35:01 [ayvens.es] INFO: Extracting data for car ID: 1987078
2026-03-27 13:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68794803-2041-5083-9734-1baae125b195 with identifier: 1987078
2026-03-27 13:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68794803-2041-5083-9734-1baae125b195 with scrape type 1
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68794803-2041-5083-9734-1baae125b195
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F328%252F6924b96044c741099bf25baa81ba9929%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/328/6924b96044c741099bf25baa81ba9929/images/large/1.jpg not downloaded yet
2026-03-27 13:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8 with identifier: 1987068
2026-03-27 13:35:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8 with identifier: 1987068
2026-03-27 13:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2afaedd5-9f88-5e13-9af7-da1c60f0a2d8 with identifier: 1987068 to the API
2026-03-27 13:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/616/2152701208a841d59302c38b71a2405e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco jade',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2afaedd5-9f88-5e13-9af7-da1c60f0a2d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 62758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afaedd5-9f88-5e13-9af7-da1c60f0a2d8/2afaedd5-9f88-5e13-9af7-da1c60f0a2d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/616/2152701208a841d59302c38b71a2405e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Select L H1 1000kg+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Select L H1 1000kg+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987068%27 HTTP/1.1" 200 None
2026-03-27 13:35:02 [ayvens.es] INFO: Saving data for 1987068: {'created_time': 1774618502.203765, 'last_price_update_time': 1774618502.203778, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987068') HTTP/1.1" 204 0
2026-03-27 13:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6fd04e39-e527-597f-9c3d-eb87a28aa8c9 with identifier: 1987070
2026-03-27 13:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6fd04e39-e527-597f-9c3d-eb87a28aa8c9 with identifier: 1987070
2026-03-27 13:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6fd04e39-e527-597f-9c3d-eb87a28aa8c9 with identifier: 1987070 to the API
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/365/a9edc09f655a49bab7d40a397394f6c9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6fd04e39-e527-597f-9c3d-eb87a28aa8c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 185073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fd04e39-e527-597f-9c3d-eb87a28aa8c9/6fd04e39-e527-597f-9c3d-eb87a28aa8c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/365/a9edc09f655a49bab7d40a397394f6c9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L1H1 dCi 88kW (120CV) Euro 6+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon 29 L1H1 dCi 88kW (120CV) Euro 6+++Revisar peritacion+++',
 'vin': None,
 'year': 2018}
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987070%27 HTTP/1.1" 200 None
2026-03-27 13:35:02 [ayvens.es] INFO: Saving data for 1987070: {'created_time': 1774618502.663205, 'last_price_update_time': 1774618502.663217, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987070') HTTP/1.1" 204 0
2026-03-27 13:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/224/809e3d3519314eb5b3f592d25545a3a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:02 [ayvens.es] INFO: Found listing with ID: 1987079
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987079%27 HTTP/1.1" 200 None
2026-03-27 13:35:02 [ayvens.es] INFO: Scrape type for 1987079: 1
2026-03-27 13:35:02 [ayvens.es] INFO: Extracting data for car ID: 1987079
2026-03-27 13:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4def879d-f504-5515-832b-6814677da6fd with identifier: 1987079
2026-03-27 13:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4def879d-f504-5515-832b-6814677da6fd with scrape type 1
2026-03-27 13:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4def879d-f504-5515-832b-6814677da6fd
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F649%252Fa6478697beb74ff1b45b519edd5b1d78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/649/a6478697beb74ff1b45b519edd5b1d78/images/large/1.jpg not downloaded yet
2026-03-27 13:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c2ff90>
2026-03-27 13:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9e1bd-bdef-5c56-b552-8b4c49598b8c/0cf9e1bd-bdef-5c56-b552-8b4c49598b8c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F255%252Ff75be681fbff488a9561bad628594ed9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/255/f75be681fbff488a9561bad628594ed9/images/large/1.jpg saved to cache
2026-03-27 13:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c
2026-03-27 13:35:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c, skipping ID generation
2026-03-27 13:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c with scrape type 1
2026-03-27 13:35:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c sending to next pipeline
2026-03-27 13:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c, identifier: 1987069
2026-03-27 13:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960e7110>
2026-03-27 13:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c6a1af2-05a0-506f-8587-50d4a25d5a0f/4c6a1af2-05a0-506f-8587-50d4a25d5a0f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F609%252F0ec92e151a5d4a338dffde177a1d0fca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/609/0ec92e151a5d4a338dffde177a1d0fca/images/large/1.jpg saved to cache
2026-03-27 13:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c6a1af2-05a0-506f-8587-50d4a25d5a0f
2026-03-27 13:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c6a1af2-05a0-506f-8587-50d4a25d5a0f, skipping ID generation
2026-03-27 13:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6a1af2-05a0-506f-8587-50d4a25d5a0f with scrape type 1
2026-03-27 13:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c6a1af2-05a0-506f-8587-50d4a25d5a0f sending to next pipeline
2026-03-27 13:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4c6a1af2-05a0-506f-8587-50d4a25d5a0f, identifier: 1987071
2026-03-27 13:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52963cf1d0>
2026-03-27 13:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8e77080-12f1-5880-86a5-8f2c80d2b068/d8e77080-12f1-5880-86a5-8f2c80d2b068_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F789%252F28e8b989114043aaa69c8aa0c7e6b427%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/789/28e8b989114043aaa69c8aa0c7e6b427/images/large/1.jpg saved to cache
2026-03-27 13:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8e77080-12f1-5880-86a5-8f2c80d2b068
2026-03-27 13:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8e77080-12f1-5880-86a5-8f2c80d2b068, skipping ID generation
2026-03-27 13:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8e77080-12f1-5880-86a5-8f2c80d2b068 with scrape type 1
2026-03-27 13:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8e77080-12f1-5880-86a5-8f2c80d2b068 sending to next pipeline
2026-03-27 13:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d8e77080-12f1-5880-86a5-8f2c80d2b068, identifier: 1987072
2026-03-27 13:35:03 [ayvens.es] INFO: Found listing with ID: 1987080
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987080%27 HTTP/1.1" 200 None
2026-03-27 13:35:03 [ayvens.es] INFO: Scrape type for 1987080: 1
2026-03-27 13:35:03 [ayvens.es] INFO: Extracting data for car ID: 1987080
2026-03-27 13:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a5b31b-3276-54db-8a5e-f5f74f499682 with identifier: 1987080
2026-03-27 13:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a5b31b-3276-54db-8a5e-f5f74f499682 with scrape type 1
2026-03-27 13:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89a5b31b-3276-54db-8a5e-f5f74f499682
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F451%252F9f1a0940356f46fa9044293dbd56e45c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/451/9f1a0940356f46fa9044293dbd56e45c/images/large/1.jpg not downloaded yet
2026-03-27 13:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c with identifier: 1987069
2026-03-27 13:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c with identifier: 1987069
2026-03-27 13:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0cf9e1bd-bdef-5c56-b552-8b4c49598b8c with identifier: 1987069 to the API
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/255/f75be681fbff488a9561bad628594ed9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Blanco ibis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0cf9e1bd-bdef-5c56-b552-8b4c49598b8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 161249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9e1bd-bdef-5c56-b552-8b4c49598b8c/0cf9e1bd-bdef-5c56-b552-8b4c49598b8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/255/f75be681fbff488a9561bad628594ed9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 Avant S line 40 TDI 150kW quattro S tron+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Avant S line 40 TDI 150kW quattro S tron+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987069%27 HTTP/1.1" 200 None
2026-03-27 13:35:04 [ayvens.es] INFO: Saving data for 1987069: {'created_time': 1774618504.089617, 'last_price_update_time': 1774618504.089627, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987069') HTTP/1.1" 204 0
2026-03-27 13:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4c6a1af2-05a0-506f-8587-50d4a25d5a0f with identifier: 1987071
2026-03-27 13:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4c6a1af2-05a0-506f-8587-50d4a25d5a0f with identifier: 1987071
2026-03-27 13:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4c6a1af2-05a0-506f-8587-50d4a25d5a0f with identifier: 1987071 to the API
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/609/0ec92e151a5d4a338dffde177a1d0fca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4c6a1af2-05a0-506f-8587-50d4a25d5a0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 156250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c6a1af2-05a0-506f-8587-50d4a25d5a0f/4c6a1af2-05a0-506f-8587-50d4a25d5a0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/609/0ec92e151a5d4a338dffde177a1d0fca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Furgon Confort L1 1.6 BlueHDi 55KW (75)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon Confort L1 1.6 BlueHDi 55KW (75)+++Revisar peritacion+++',
 'vin': None,
 'year': 2018}
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987071%27 HTTP/1.1" 200 None
2026-03-27 13:35:04 [ayvens.es] INFO: Saving data for 1987071: {'created_time': 1774618504.569749, 'last_price_update_time': 1774618504.569759, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987071') HTTP/1.1" 204 0
2026-03-27 13:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d8e77080-12f1-5880-86a5-8f2c80d2b068 with identifier: 1987072
2026-03-27 13:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d8e77080-12f1-5880-86a5-8f2c80d2b068 with identifier: 1987072
2026-03-27 13:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d8e77080-12f1-5880-86a5-8f2c80d2b068 with identifier: 1987072 to the API
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/789/28e8b989114043aaa69c8aa0c7e6b427/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd8e77080-12f1-5880-86a5-8f2c80d2b068',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 192315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e77080-12f1-5880-86a5-8f2c80d2b068/d8e77080-12f1-5880-86a5-8f2c80d2b068_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/789/28e8b989114043aaa69c8aa0c7e6b427/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Doble Cabina Pro BlueHDi 120 S&S Long+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Doble Cabina Pro BlueHDi 120 S&S Long+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987072%27 HTTP/1.1" 200 None
2026-03-27 13:35:04 [ayvens.es] INFO: Saving data for 1987072: {'created_time': 1774618504.952987, 'last_price_update_time': 1774618504.952997, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987072') HTTP/1.1" 204 0
2026-03-27 13:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/551/ab245d324dd3441eb3e5f3a002e5d374/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/971/3fc5da49a2614246b424a42abcb7f0d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:04 [ayvens.es] INFO: Found listing with ID: 1987081
2026-03-27 13:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987081%27 HTTP/1.1" 200 None
2026-03-27 13:35:05 [ayvens.es] INFO: Scrape type for 1987081: 1
2026-03-27 13:35:05 [ayvens.es] INFO: Extracting data for car ID: 1987081
2026-03-27 13:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fde4d9-46ea-57b6-828c-794e83f7b99c with identifier: 1987081
2026-03-27 13:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fde4d9-46ea-57b6-828c-794e83f7b99c with scrape type 1
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 20fde4d9-46ea-57b6-828c-794e83f7b99c
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F723%252Fcee10811fe214f0ab0c1496d28de0c09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/723/cee10811fe214f0ab0c1496d28de0c09/images/large/1.jpg not downloaded yet
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1dcd0>
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e41414e2-f23f-514d-b989-aeba76ff2be5/e41414e2-f23f-514d-b989-aeba76ff2be5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F224%252F809e3d3519314eb5b3f592d25545a3a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/224/809e3d3519314eb5b3f592d25545a3a9/images/large/1.jpg saved to cache
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e41414e2-f23f-514d-b989-aeba76ff2be5
2026-03-27 13:35:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e41414e2-f23f-514d-b989-aeba76ff2be5, skipping ID generation
2026-03-27 13:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e41414e2-f23f-514d-b989-aeba76ff2be5 with scrape type 1
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e41414e2-f23f-514d-b989-aeba76ff2be5 sending to next pipeline
2026-03-27 13:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e41414e2-f23f-514d-b989-aeba76ff2be5, identifier: 1987073
2026-03-27 13:35:05 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 0 pages/min), scraped 424 items (at 92 items/min)
2026-03-27 13:35:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-27 13:35:05 [ayvens.es] INFO: Found listing with ID: 1987082
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987082%27 HTTP/1.1" 200 None
2026-03-27 13:35:05 [ayvens.es] INFO: Scrape type for 1987082: 1
2026-03-27 13:35:05 [ayvens.es] INFO: Extracting data for car ID: 1987082
2026-03-27 13:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47cc45e-e56e-5d7e-942b-750ac06dd2fe with identifier: 1987082
2026-03-27 13:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47cc45e-e56e-5d7e-942b-750ac06dd2fe with scrape type 1
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b47cc45e-e56e-5d7e-942b-750ac06dd2fe
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F558%252F7105cabe6914419fbcbd792c3d3bd1a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/558/7105cabe6914419fbcbd792c3d3bd1a5/images/large/1.jpg not downloaded yet
2026-03-27 13:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e41414e2-f23f-514d-b989-aeba76ff2be5 with identifier: 1987073
2026-03-27 13:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e41414e2-f23f-514d-b989-aeba76ff2be5 with identifier: 1987073
2026-03-27 13:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e41414e2-f23f-514d-b989-aeba76ff2be5 with identifier: 1987073 to the API
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/224/809e3d3519314eb5b3f592d25545a3a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e41414e2-f23f-514d-b989-aeba76ff2be5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 121331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e41414e2-f23f-514d-b989-aeba76ff2be5/e41414e2-f23f-514d-b989-aeba76ff2be5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/224/809e3d3519314eb5b3f592d25545a3a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens Blue dCi 70kW (95CV)+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': 'Intens Blue dCi 70kW (95CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987073%27 HTTP/1.1" 200 None
2026-03-27 13:35:05 [ayvens.es] INFO: Saving data for 1987073: {'created_time': 1774618505.660325, 'last_price_update_time': 1774618505.660336, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987073') HTTP/1.1" 204 0
2026-03-27 13:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/689/68a4e11c8bc24f628910db6ad3f3dc7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:05 [ayvens.es] INFO: Found listing with ID: 1987083
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987083%27 HTTP/1.1" 200 None
2026-03-27 13:35:05 [ayvens.es] INFO: Scrape type for 1987083: 1
2026-03-27 13:35:05 [ayvens.es] INFO: Extracting data for car ID: 1987083
2026-03-27 13:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43163df4-549c-507f-852b-4d23b885b464 with identifier: 1987083
2026-03-27 13:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43163df4-549c-507f-852b-4d23b885b464 with scrape type 1
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 43163df4-549c-507f-852b-4d23b885b464
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F370%252F5196cd20a32841feb855ad0acb122c06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/370/5196cd20a32841feb855ad0acb122c06/images/large/1.jpg not downloaded yet
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296097890>
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_597c1393-d297-5f8e-993d-5e2764cec8c2/597c1393-d297-5f8e-993d-5e2764cec8c2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F551%252Fab245d324dd3441eb3e5f3a002e5d374%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/551/ab245d324dd3441eb3e5f3a002e5d374/images/large/1.jpg saved to cache
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 597c1393-d297-5f8e-993d-5e2764cec8c2
2026-03-27 13:35:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 597c1393-d297-5f8e-993d-5e2764cec8c2, skipping ID generation
2026-03-27 13:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 597c1393-d297-5f8e-993d-5e2764cec8c2 with scrape type 1
2026-03-27 13:35:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 597c1393-d297-5f8e-993d-5e2764cec8c2 sending to next pipeline
2026-03-27 13:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 597c1393-d297-5f8e-993d-5e2764cec8c2, identifier: 1987074
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960aee90>
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315ac401-479d-5b06-8416-65bb2922bde4/315ac401-479d-5b06-8416-65bb2922bde4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F971%252F3fc5da49a2614246b424a42abcb7f0d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/971/3fc5da49a2614246b424a42abcb7f0d5/images/large/1.jpg saved to cache
2026-03-27 13:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 315ac401-479d-5b06-8416-65bb2922bde4
2026-03-27 13:35:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 315ac401-479d-5b06-8416-65bb2922bde4, skipping ID generation
2026-03-27 13:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315ac401-479d-5b06-8416-65bb2922bde4 with scrape type 1
2026-03-27 13:35:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 315ac401-479d-5b06-8416-65bb2922bde4 sending to next pipeline
2026-03-27 13:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 315ac401-479d-5b06-8416-65bb2922bde4, identifier: 1987075
2026-03-27 13:35:06 [ayvens.es] INFO: Found listing with ID: 1987084
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987084%27 HTTP/1.1" 200 None
2026-03-27 13:35:06 [ayvens.es] INFO: Scrape type for 1987084: 1
2026-03-27 13:35:06 [ayvens.es] INFO: Extracting data for car ID: 1987084
2026-03-27 13:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 862f4323-cb72-54cd-a60f-aecfad12dd22 with identifier: 1987084
2026-03-27 13:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862f4323-cb72-54cd-a60f-aecfad12dd22 with scrape type 1
2026-03-27 13:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 862f4323-cb72-54cd-a60f-aecfad12dd22
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252Fb5ed172cc7cb4e648d2f3d4c7069d7ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/b5ed172cc7cb4e648d2f3d4c7069d7ca/images/large/1.jpg not downloaded yet
2026-03-27 13:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 597c1393-d297-5f8e-993d-5e2764cec8c2 with identifier: 1987074
2026-03-27 13:35:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 597c1393-d297-5f8e-993d-5e2764cec8c2 with identifier: 1987074
2026-03-27 13:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 597c1393-d297-5f8e-993d-5e2764cec8c2 with identifier: 1987074 to the API
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/551/ab245d324dd3441eb3e5f3a002e5d374/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'color': 'Blanco mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '597c1393-d297-5f8e-993d-5e2764cec8c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 227805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_597c1393-d297-5f8e-993d-5e2764cec8c2/597c1393-d297-5f8e-993d-5e2764cec8c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/551/ab245d324dd3441eb3e5f3a002e5d374/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 Blue dCi 99W (135CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 Blue dCi 99W (135CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987074%27 HTTP/1.1" 200 None
2026-03-27 13:35:06 [ayvens.es] INFO: Saving data for 1987074: {'created_time': 1774618506.587593, 'last_price_update_time': 1774618506.587603, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987074') HTTP/1.1" 204 0
2026-03-27 13:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 315ac401-479d-5b06-8416-65bb2922bde4 with identifier: 1987075
2026-03-27 13:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 315ac401-479d-5b06-8416-65bb2922bde4 with identifier: 1987075
2026-03-27 13:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 315ac401-479d-5b06-8416-65bb2922bde4 with identifier: 1987075 to the API
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/971/3fc5da49a2614246b424a42abcb7f0d5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '315ac401-479d-5b06-8416-65bb2922bde4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 107539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315ac401-479d-5b06-8416-65bb2922bde4/315ac401-479d-5b06-8416-65bb2922bde4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/971/3fc5da49a2614246b424a42abcb7f0d5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'vin': None,
 'year': 2017}
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987075%27 HTTP/1.1" 200 None
2026-03-27 13:35:06 [ayvens.es] INFO: Saving data for 1987075: {'created_time': 1774618506.967436, 'last_price_update_time': 1774618506.967448, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987075') HTTP/1.1" 204 0
2026-03-27 13:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/864/e14f8414c1e24b1798da6f7175d7238b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:06 [ayvens.es] INFO: Found listing with ID: 1987085
2026-03-27 13:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987085%27 HTTP/1.1" 200 None
2026-03-27 13:35:07 [ayvens.es] INFO: Scrape type for 1987085: 1
2026-03-27 13:35:07 [ayvens.es] INFO: Extracting data for car ID: 1987085
2026-03-27 13:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd with identifier: 1987085
2026-03-27 13:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd with scrape type 1
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252Ffec32afdc3de499d9eea2dd3c77d1c18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/fec32afdc3de499d9eea2dd3c77d1c18/images/large/1.jpg not downloaded yet
2026-03-27 13:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296096850>
2026-03-27 13:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e56b3f9-2fd5-53e9-98e4-73d967794834/0e56b3f9-2fd5-53e9-98e4-73d967794834_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F689%252F68a4e11c8bc24f628910db6ad3f3dc7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/689/68a4e11c8bc24f628910db6ad3f3dc7b/images/large/1.jpg saved to cache
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e56b3f9-2fd5-53e9-98e4-73d967794834
2026-03-27 13:35:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e56b3f9-2fd5-53e9-98e4-73d967794834, skipping ID generation
2026-03-27 13:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e56b3f9-2fd5-53e9-98e4-73d967794834 with scrape type 1
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e56b3f9-2fd5-53e9-98e4-73d967794834 sending to next pipeline
2026-03-27 13:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e56b3f9-2fd5-53e9-98e4-73d967794834, identifier: 1987077
2026-03-27 13:35:07 [ayvens.es] INFO: Found listing with ID: 1987086
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987086%27 HTTP/1.1" 200 None
2026-03-27 13:35:07 [ayvens.es] INFO: Scrape type for 1987086: 1
2026-03-27 13:35:07 [ayvens.es] INFO: Extracting data for car ID: 1987086
2026-03-27 13:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d120cc1c-558a-5d5f-b340-fc5c703d2aae with identifier: 1987086
2026-03-27 13:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d120cc1c-558a-5d5f-b340-fc5c703d2aae with scrape type 1
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d120cc1c-558a-5d5f-b340-fc5c703d2aae
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F914%252F76bb6c4f53fe4ff38aad8d5fce031e8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/914/76bb6c4f53fe4ff38aad8d5fce031e8a/images/large/1.jpg not downloaded yet
2026-03-27 13:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e56b3f9-2fd5-53e9-98e4-73d967794834 with identifier: 1987077
2026-03-27 13:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e56b3f9-2fd5-53e9-98e4-73d967794834 with identifier: 1987077
2026-03-27 13:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0e56b3f9-2fd5-53e9-98e4-73d967794834 with identifier: 1987077 to the API
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/689/68a4e11c8bc24f628910db6ad3f3dc7b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0e56b3f9-2fd5-53e9-98e4-73d967794834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 121676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e56b3f9-2fd5-53e9-98e4-73d967794834/0e56b3f9-2fd5-53e9-98e4-73d967794834_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/689/68a4e11c8bc24f628910db6ad3f3dc7b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L2H1 dCi 88kW (120CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Furgon 29 L2H1 dCi 88kW (120CV) Euro 6',
 'vin': None,
 'year': 2018}
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987077%27 HTTP/1.1" 200 None
2026-03-27 13:35:07 [ayvens.es] INFO: Saving data for 1987077: {'created_time': 1774618507.65918, 'last_price_update_time': 1774618507.65919, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987077') HTTP/1.1" 204 0
2026-03-27 13:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/649/a6478697beb74ff1b45b519edd5b1d78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/328/6924b96044c741099bf25baa81ba9929/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/451/9f1a0940356f46fa9044293dbd56e45c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/723/cee10811fe214f0ab0c1496d28de0c09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:07 [ayvens.es] INFO: Found listing with ID: 1987087
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987087%27 HTTP/1.1" 200 None
2026-03-27 13:35:07 [ayvens.es] INFO: Scrape type for 1987087: 1
2026-03-27 13:35:07 [ayvens.es] INFO: Extracting data for car ID: 1987087
2026-03-27 13:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2003db44-0b61-5429-b7fc-211bf5163bd9 with identifier: 1987087
2026-03-27 13:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2003db44-0b61-5429-b7fc-211bf5163bd9 with scrape type 1
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2003db44-0b61-5429-b7fc-211bf5163bd9
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F412%252F84ad0bfcc9094d68a52463a698195d8c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/412/84ad0bfcc9094d68a52463a698195d8c/images/large/1.jpg not downloaded yet
2026-03-27 13:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295c34410>
2026-03-27 13:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e664ab6d-541c-5640-9bf8-351c24c1e970/e664ab6d-541c-5640-9bf8-351c24c1e970_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F864%252Fe14f8414c1e24b1798da6f7175d7238b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/864/e14f8414c1e24b1798da6f7175d7238b/images/large/1.jpg saved to cache
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e664ab6d-541c-5640-9bf8-351c24c1e970
2026-03-27 13:35:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e664ab6d-541c-5640-9bf8-351c24c1e970, skipping ID generation
2026-03-27 13:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e664ab6d-541c-5640-9bf8-351c24c1e970 with scrape type 1
2026-03-27 13:35:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e664ab6d-541c-5640-9bf8-351c24c1e970 sending to next pipeline
2026-03-27 13:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e664ab6d-541c-5640-9bf8-351c24c1e970, identifier: 1987076
2026-03-27 13:35:07 [ayvens.es] INFO: Found listing with ID: 1987088
2026-03-27 13:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987088%27 HTTP/1.1" 200 None
2026-03-27 13:35:08 [ayvens.es] INFO: Scrape type for 1987088: 1
2026-03-27 13:35:08 [ayvens.es] INFO: Extracting data for car ID: 1987088
2026-03-27 13:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb2bdb0-8916-52cd-93a9-60e202d23034 with identifier: 1987088
2026-03-27 13:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb2bdb0-8916-52cd-93a9-60e202d23034 with scrape type 1
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7cb2bdb0-8916-52cd-93a9-60e202d23034
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F618%252F7473a35e0adb4d7b98cbd9e9a3d1195d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/618/7473a35e0adb4d7b98cbd9e9a3d1195d/images/large/1.jpg not downloaded yet
2026-03-27 13:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e664ab6d-541c-5640-9bf8-351c24c1e970 with identifier: 1987076
2026-03-27 13:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e664ab6d-541c-5640-9bf8-351c24c1e970 with identifier: 1987076
2026-03-27 13:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e664ab6d-541c-5640-9bf8-351c24c1e970 with identifier: 1987076 to the API
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/864/e14f8414c1e24b1798da6f7175d7238b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e664ab6d-541c-5640-9bf8-351c24c1e970',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 62140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e664ab6d-541c-5640-9bf8-351c24c1e970/e664ab6d-541c-5640-9bf8-351c24c1e970_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/864/e14f8414c1e24b1798da6f7175d7238b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987076%27 HTTP/1.1" 200 None
2026-03-27 13:35:08 [ayvens.es] INFO: Saving data for 1987076: {'created_time': 1774618508.476649, 'last_price_update_time': 1774618508.476659, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987076') HTTP/1.1" 204 0
2026-03-27 13:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/558/7105cabe6914419fbcbd792c3d3bd1a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:08 [ayvens.es] INFO: Found listing with ID: 1987089
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987089%27 HTTP/1.1" 200 None
2026-03-27 13:35:08 [ayvens.es] INFO: Scrape type for 1987089: 1
2026-03-27 13:35:08 [ayvens.es] INFO: Extracting data for car ID: 1987089
2026-03-27 13:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc6529a6-8cf7-5040-a848-0149b881e793 with identifier: 1987089
2026-03-27 13:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc6529a6-8cf7-5040-a848-0149b881e793 with scrape type 1
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc6529a6-8cf7-5040-a848-0149b881e793
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F65c67861b84f48939a8b4b37b337969b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/65c67861b84f48939a8b4b37b337969b/images/large/1.jpg not downloaded yet
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fb3e50>
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4def879d-f504-5515-832b-6814677da6fd/4def879d-f504-5515-832b-6814677da6fd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F649%252Fa6478697beb74ff1b45b519edd5b1d78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/649/a6478697beb74ff1b45b519edd5b1d78/images/large/1.jpg saved to cache
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4def879d-f504-5515-832b-6814677da6fd
2026-03-27 13:35:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4def879d-f504-5515-832b-6814677da6fd, skipping ID generation
2026-03-27 13:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4def879d-f504-5515-832b-6814677da6fd with scrape type 1
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4def879d-f504-5515-832b-6814677da6fd sending to next pipeline
2026-03-27 13:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4def879d-f504-5515-832b-6814677da6fd, identifier: 1987079
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296009090>
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68794803-2041-5083-9734-1baae125b195/68794803-2041-5083-9734-1baae125b195_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F328%252F6924b96044c741099bf25baa81ba9929%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/328/6924b96044c741099bf25baa81ba9929/images/large/1.jpg saved to cache
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68794803-2041-5083-9734-1baae125b195
2026-03-27 13:35:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68794803-2041-5083-9734-1baae125b195, skipping ID generation
2026-03-27 13:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68794803-2041-5083-9734-1baae125b195 with scrape type 1
2026-03-27 13:35:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68794803-2041-5083-9734-1baae125b195 sending to next pipeline
2026-03-27 13:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 68794803-2041-5083-9734-1baae125b195, identifier: 1987078
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295705fd0>
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a5b31b-3276-54db-8a5e-f5f74f499682/89a5b31b-3276-54db-8a5e-f5f74f499682_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F451%252F9f1a0940356f46fa9044293dbd56e45c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/451/9f1a0940356f46fa9044293dbd56e45c/images/large/1.jpg saved to cache
2026-03-27 13:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89a5b31b-3276-54db-8a5e-f5f74f499682
2026-03-27 13:35:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89a5b31b-3276-54db-8a5e-f5f74f499682, skipping ID generation
2026-03-27 13:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a5b31b-3276-54db-8a5e-f5f74f499682 with scrape type 1
2026-03-27 13:35:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89a5b31b-3276-54db-8a5e-f5f74f499682 sending to next pipeline
2026-03-27 13:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89a5b31b-3276-54db-8a5e-f5f74f499682, identifier: 1987080
2026-03-27 13:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295782cd0>
2026-03-27 13:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fde4d9-46ea-57b6-828c-794e83f7b99c/20fde4d9-46ea-57b6-828c-794e83f7b99c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F723%252Fcee10811fe214f0ab0c1496d28de0c09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/723/cee10811fe214f0ab0c1496d28de0c09/images/large/1.jpg saved to cache
2026-03-27 13:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20fde4d9-46ea-57b6-828c-794e83f7b99c
2026-03-27 13:35:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20fde4d9-46ea-57b6-828c-794e83f7b99c, skipping ID generation
2026-03-27 13:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fde4d9-46ea-57b6-828c-794e83f7b99c with scrape type 1
2026-03-27 13:35:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20fde4d9-46ea-57b6-828c-794e83f7b99c sending to next pipeline
2026-03-27 13:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 20fde4d9-46ea-57b6-828c-794e83f7b99c, identifier: 1987081
2026-03-27 13:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/370/5196cd20a32841feb855ad0acb122c06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:09 [ayvens.es] INFO: Found listing with ID: 1987090
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987090%27 HTTP/1.1" 200 None
2026-03-27 13:35:09 [ayvens.es] INFO: Scrape type for 1987090: 1
2026-03-27 13:35:09 [ayvens.es] INFO: Extracting data for car ID: 1987090
2026-03-27 13:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c296ef24-99af-5461-8c09-179c212c9d57 with identifier: 1987090
2026-03-27 13:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c296ef24-99af-5461-8c09-179c212c9d57 with scrape type 1
2026-03-27 13:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c296ef24-99af-5461-8c09-179c212c9d57
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F527%252F321166d812fe47388e42a8f836e23cdd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/527/321166d812fe47388e42a8f836e23cdd/images/large/1.jpg not downloaded yet
2026-03-27 13:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4def879d-f504-5515-832b-6814677da6fd with identifier: 1987079
2026-03-27 13:35:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4def879d-f504-5515-832b-6814677da6fd with identifier: 1987079
2026-03-27 13:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4def879d-f504-5515-832b-6814677da6fd with identifier: 1987079 to the API
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/649/a6478697beb74ff1b45b519edd5b1d78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Gris amazonite',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4def879d-f504-5515-832b-6814677da6fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 226490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4def879d-f504-5515-832b-6814677da6fd/4def879d-f504-5515-832b-6814677da6fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/649/a6478697beb74ff1b45b519edd5b1d78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2019}
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987079%27 HTTP/1.1" 200 None
2026-03-27 13:35:09 [ayvens.es] INFO: Saving data for 1987079: {'created_time': 1774618509.796561, 'last_price_update_time': 1774618509.796571, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987079') HTTP/1.1" 204 0
2026-03-27 13:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 68794803-2041-5083-9734-1baae125b195 with identifier: 1987078
2026-03-27 13:35:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 68794803-2041-5083-9734-1baae125b195 with identifier: 1987078
2026-03-27 13:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 68794803-2041-5083-9734-1baae125b195 with identifier: 1987078 to the API
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/328/6924b96044c741099bf25baa81ba9929/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Azul v',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '68794803-2041-5083-9734-1baae125b195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 90138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68794803-2041-5083-9734-1baae125b195/68794803-2041-5083-9734-1baae125b195_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/328/6924b96044c741099bf25baa81ba9929/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Allure BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987078%27 HTTP/1.1" 200 None
2026-03-27 13:35:10 [ayvens.es] INFO: Saving data for 1987078: {'created_time': 1774618510.26085, 'last_price_update_time': 1774618510.26086, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987078') HTTP/1.1" 204 0
2026-03-27 13:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89a5b31b-3276-54db-8a5e-f5f74f499682 with identifier: 1987080
2026-03-27 13:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89a5b31b-3276-54db-8a5e-f5f74f499682 with identifier: 1987080
2026-03-27 13:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89a5b31b-3276-54db-8a5e-f5f74f499682 with identifier: 1987080 to the API
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/451/9f1a0940356f46fa9044293dbd56e45c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '89a5b31b-3276-54db-8a5e-f5f74f499682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 91630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a5b31b-3276-54db-8a5e-f5f74f499682/89a5b31b-3276-54db-8a5e-f5f74f499682_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/451/9f1a0940356f46fa9044293dbd56e45c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987080%27 HTTP/1.1" 200 None
2026-03-27 13:35:10 [ayvens.es] INFO: Saving data for 1987080: {'created_time': 1774618510.646932, 'last_price_update_time': 1774618510.646942, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987080') HTTP/1.1" 204 0
2026-03-27 13:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 20fde4d9-46ea-57b6-828c-794e83f7b99c with identifier: 1987081
2026-03-27 13:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 20fde4d9-46ea-57b6-828c-794e83f7b99c with identifier: 1987081
2026-03-27 13:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 20fde4d9-46ea-57b6-828c-794e83f7b99c with identifier: 1987081 to the API
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/723/cee10811fe214f0ab0c1496d28de0c09/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'gas',
 'id': '20fde4d9-46ea-57b6-828c-794e83f7b99c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 122738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20fde4d9-46ea-57b6-828c-794e83f7b99c/20fde4d9-46ea-57b6-828c-794e83f7b99c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/723/cee10811fe214f0ab0c1496d28de0c09/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.4 66kW (90CV) Selective Pro GLP',
 'transmission': 'manual',
 'trim': '1.4 66kW (90CV) Selective Pro GLP',
 'vin': None,
 'year': 2019}
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987081%27 HTTP/1.1" 200 None
2026-03-27 13:35:11 [ayvens.es] INFO: Saving data for 1987081: {'created_time': 1774618511.009553, 'last_price_update_time': 1774618511.009563, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987081') HTTP/1.1" 204 0
2026-03-27 13:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/029/fec32afdc3de499d9eea2dd3c77d1c18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:11 [ayvens.es] INFO: Found listing with ID: 1987091
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987091%27 HTTP/1.1" 200 None
2026-03-27 13:35:11 [ayvens.es] INFO: Scrape type for 1987091: 1
2026-03-27 13:35:11 [ayvens.es] INFO: Extracting data for car ID: 1987091
2026-03-27 13:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc95f4d6-8091-54c0-9dcb-34714eeca947 with identifier: 1987091
2026-03-27 13:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc95f4d6-8091-54c0-9dcb-34714eeca947 with scrape type 1
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc95f4d6-8091-54c0-9dcb-34714eeca947
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F509%252F8322bb7071b2451797116475a2f2b0ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/509/8322bb7071b2451797116475a2f2b0ff/images/large/1.jpg not downloaded yet
2026-03-27 13:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c9fd0>
2026-03-27 13:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47cc45e-e56e-5d7e-942b-750ac06dd2fe/b47cc45e-e56e-5d7e-942b-750ac06dd2fe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F558%252F7105cabe6914419fbcbd792c3d3bd1a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/558/7105cabe6914419fbcbd792c3d3bd1a5/images/large/1.jpg saved to cache
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b47cc45e-e56e-5d7e-942b-750ac06dd2fe
2026-03-27 13:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b47cc45e-e56e-5d7e-942b-750ac06dd2fe, skipping ID generation
2026-03-27 13:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47cc45e-e56e-5d7e-942b-750ac06dd2fe with scrape type 1
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b47cc45e-e56e-5d7e-942b-750ac06dd2fe sending to next pipeline
2026-03-27 13:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b47cc45e-e56e-5d7e-942b-750ac06dd2fe, identifier: 1987082
2026-03-27 13:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b47cc45e-e56e-5d7e-942b-750ac06dd2fe with identifier: 1987082
2026-03-27 13:35:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b47cc45e-e56e-5d7e-942b-750ac06dd2fe with identifier: 1987082
2026-03-27 13:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b47cc45e-e56e-5d7e-942b-750ac06dd2fe with identifier: 1987082 to the API
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/558/7105cabe6914419fbcbd792c3d3bd1a5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b47cc45e-e56e-5d7e-942b-750ac06dd2fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 209531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47cc45e-e56e-5d7e-942b-750ac06dd2fe/b47cc45e-e56e-5d7e-942b-750ac06dd2fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/558/7105cabe6914419fbcbd792c3d3bd1a5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987082%27 HTTP/1.1" 200 None
2026-03-27 13:35:11 [ayvens.es] INFO: Saving data for 1987082: {'created_time': 1774618511.671621, 'last_price_update_time': 1774618511.671631, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987082') HTTP/1.1" 204 0
2026-03-27 13:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bd6dd0>
2026-03-27 13:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43163df4-549c-507f-852b-4d23b885b464/43163df4-549c-507f-852b-4d23b885b464_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F370%252F5196cd20a32841feb855ad0acb122c06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/370/5196cd20a32841feb855ad0acb122c06/images/large/1.jpg saved to cache
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43163df4-549c-507f-852b-4d23b885b464
2026-03-27 13:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43163df4-549c-507f-852b-4d23b885b464, skipping ID generation
2026-03-27 13:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43163df4-549c-507f-852b-4d23b885b464 with scrape type 1
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43163df4-549c-507f-852b-4d23b885b464 sending to next pipeline
2026-03-27 13:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 43163df4-549c-507f-852b-4d23b885b464, identifier: 1987083
2026-03-27 13:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/753/b5ed172cc7cb4e648d2f3d4c7069d7ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:11 [ayvens.es] INFO: Found listing with ID: 1987092
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987092%27 HTTP/1.1" 200 None
2026-03-27 13:35:11 [ayvens.es] INFO: Scrape type for 1987092: 1
2026-03-27 13:35:11 [ayvens.es] INFO: Extracting data for car ID: 1987092
2026-03-27 13:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc75fafc-be3c-5084-b1d3-378fc0132923 with identifier: 1987092
2026-03-27 13:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc75fafc-be3c-5084-b1d3-378fc0132923 with scrape type 1
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc75fafc-be3c-5084-b1d3-378fc0132923
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F54a5c116966d45aa8be13c558404dc8d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/54a5c116966d45aa8be13c558404dc8d/images/large/1.jpg not downloaded yet
2026-03-27 13:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 43163df4-549c-507f-852b-4d23b885b464 with identifier: 1987083
2026-03-27 13:35:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 43163df4-549c-507f-852b-4d23b885b464 with identifier: 1987083
2026-03-27 13:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 43163df4-549c-507f-852b-4d23b885b464 with identifier: 1987083 to the API
2026-03-27 13:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/370/5196cd20a32841feb855ad0acb122c06/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '43163df4-549c-507f-852b-4d23b885b464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 61134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43163df4-549c-507f-852b-4d23b885b464/43163df4-549c-507f-852b-4d23b885b464_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/370/5196cd20a32841feb855ad0acb122c06/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987083%27 HTTP/1.1" 200 None
2026-03-27 13:35:12 [ayvens.es] INFO: Saving data for 1987083: {'created_time': 1774618512.262007, 'last_price_update_time': 1774618512.262017, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987083') HTTP/1.1" 204 0
2026-03-27 13:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961e9910>
2026-03-27 13:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_517a8a0c-87b4-5aae-bf5c-6dedf20a45fd/517a8a0c-87b4-5aae-bf5c-6dedf20a45fd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252Ffec32afdc3de499d9eea2dd3c77d1c18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/fec32afdc3de499d9eea2dd3c77d1c18/images/large/1.jpg saved to cache
2026-03-27 13:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd
2026-03-27 13:35:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd, skipping ID generation
2026-03-27 13:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd with scrape type 1
2026-03-27 13:35:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd sending to next pipeline
2026-03-27 13:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd, identifier: 1987085
2026-03-27 13:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/914/76bb6c4f53fe4ff38aad8d5fce031e8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:12 [ayvens.es] INFO: Found listing with ID: 1987093
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987093%27 HTTP/1.1" 200 None
2026-03-27 13:35:12 [ayvens.es] INFO: Scrape type for 1987093: 1
2026-03-27 13:35:12 [ayvens.es] INFO: Extracting data for car ID: 1987093
2026-03-27 13:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b3f91e-db6e-5aab-9fe7-4e4860a18946 with identifier: 1987093
2026-03-27 13:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b3f91e-db6e-5aab-9fe7-4e4860a18946 with scrape type 1
2026-03-27 13:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6b3f91e-db6e-5aab-9fe7-4e4860a18946
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F783%252F1e79b77073ac40c4aea64db008c8dc3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/783/1e79b77073ac40c4aea64db008c8dc3c/images/large/1.jpg not downloaded yet
2026-03-27 13:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd with identifier: 1987085
2026-03-27 13:35:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd with identifier: 1987085
2026-03-27 13:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 517a8a0c-87b4-5aae-bf5c-6dedf20a45fd with identifier: 1987085 to the API
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/029/fec32afdc3de499d9eea2dd3c77d1c18/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '517a8a0c-87b4-5aae-bf5c-6dedf20a45fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 134075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_517a8a0c-87b4-5aae-bf5c-6dedf20a45fd/517a8a0c-87b4-5aae-bf5c-6dedf20a45fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/029/fec32afdc3de499d9eea2dd3c77d1c18/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Style BlueHDi 130 S&S',
 'transmission': 'manual',
 'trim': 'SW Style BlueHDi 130 S&S',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987085%27 HTTP/1.1" 200 None
2026-03-27 13:35:12 [ayvens.es] INFO: Saving data for 1987085: {'created_time': 1774618512.8774, 'last_price_update_time': 1774618512.877411, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987085') HTTP/1.1" 204 0
2026-03-27 13:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296086dd0>
2026-03-27 13:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862f4323-cb72-54cd-a60f-aecfad12dd22/862f4323-cb72-54cd-a60f-aecfad12dd22_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252Fb5ed172cc7cb4e648d2f3d4c7069d7ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/b5ed172cc7cb4e648d2f3d4c7069d7ca/images/large/1.jpg saved to cache
2026-03-27 13:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 862f4323-cb72-54cd-a60f-aecfad12dd22
2026-03-27 13:35:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 862f4323-cb72-54cd-a60f-aecfad12dd22, skipping ID generation
2026-03-27 13:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862f4323-cb72-54cd-a60f-aecfad12dd22 with scrape type 1
2026-03-27 13:35:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 862f4323-cb72-54cd-a60f-aecfad12dd22 sending to next pipeline
2026-03-27 13:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 862f4323-cb72-54cd-a60f-aecfad12dd22, identifier: 1987084
2026-03-27 13:35:13 [ayvens.es] INFO: Found listing with ID: 1987094
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987094%27 HTTP/1.1" 200 None
2026-03-27 13:35:13 [ayvens.es] INFO: Scrape type for 1987094: 1
2026-03-27 13:35:13 [ayvens.es] INFO: Extracting data for car ID: 1987094
2026-03-27 13:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a538d96e-d3bf-5095-83a1-46a7335c05be with identifier: 1987094
2026-03-27 13:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a538d96e-d3bf-5095-83a1-46a7335c05be with scrape type 1
2026-03-27 13:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a538d96e-d3bf-5095-83a1-46a7335c05be
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F050%252F62f3f701579e424d990acdc5b720ccc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/050/62f3f701579e424d990acdc5b720ccc6/images/large/1.jpg not downloaded yet
2026-03-27 13:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 862f4323-cb72-54cd-a60f-aecfad12dd22 with identifier: 1987084
2026-03-27 13:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 862f4323-cb72-54cd-a60f-aecfad12dd22 with identifier: 1987084
2026-03-27 13:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 862f4323-cb72-54cd-a60f-aecfad12dd22 with identifier: 1987084 to the API
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/753/b5ed172cc7cb4e648d2f3d4c7069d7ca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '862f4323-cb72-54cd-a60f-aecfad12dd22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 64891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862f4323-cb72-54cd-a60f-aecfad12dd22/862f4323-cb72-54cd-a60f-aecfad12dd22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/753/b5ed172cc7cb4e648d2f3d4c7069d7ca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'transmission': 'manual',
 'trim': 'Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'vin': None,
 'year': 2018}
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987084%27 HTTP/1.1" 200 None
2026-03-27 13:35:13 [ayvens.es] INFO: Saving data for 1987084: {'created_time': 1774618513.450077, 'last_price_update_time': 1774618513.450088, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987084') HTTP/1.1" 204 0
2026-03-27 13:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/412/84ad0bfcc9094d68a52463a698195d8c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/618/7473a35e0adb4d7b98cbd9e9a3d1195d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632cc10>
2026-03-27 13:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d120cc1c-558a-5d5f-b340-fc5c703d2aae/d120cc1c-558a-5d5f-b340-fc5c703d2aae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F914%252F76bb6c4f53fe4ff38aad8d5fce031e8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/914/76bb6c4f53fe4ff38aad8d5fce031e8a/images/large/1.jpg saved to cache
2026-03-27 13:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d120cc1c-558a-5d5f-b340-fc5c703d2aae
2026-03-27 13:35:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d120cc1c-558a-5d5f-b340-fc5c703d2aae, skipping ID generation
2026-03-27 13:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d120cc1c-558a-5d5f-b340-fc5c703d2aae with scrape type 1
2026-03-27 13:35:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d120cc1c-558a-5d5f-b340-fc5c703d2aae sending to next pipeline
2026-03-27 13:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d120cc1c-558a-5d5f-b340-fc5c703d2aae, identifier: 1987086
2026-03-27 13:35:13 [ayvens.es] INFO: Found listing with ID: 1987095
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987095%27 HTTP/1.1" 200 None
2026-03-27 13:35:13 [ayvens.es] INFO: Scrape type for 1987095: 1
2026-03-27 13:35:13 [ayvens.es] INFO: Extracting data for car ID: 1987095
2026-03-27 13:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4e24fc6-df30-5003-89d0-e248a7b63873 with identifier: 1987095
2026-03-27 13:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4e24fc6-df30-5003-89d0-e248a7b63873 with scrape type 1
2026-03-27 13:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d4e24fc6-df30-5003-89d0-e248a7b63873
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252F200ef0b47773493cafdc199d3352fccc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/200ef0b47773493cafdc199d3352fccc/images/large/1.jpg not downloaded yet
2026-03-27 13:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d120cc1c-558a-5d5f-b340-fc5c703d2aae with identifier: 1987086
2026-03-27 13:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d120cc1c-558a-5d5f-b340-fc5c703d2aae with identifier: 1987086
2026-03-27 13:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d120cc1c-558a-5d5f-b340-fc5c703d2aae with identifier: 1987086 to the API
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/914/76bb6c4f53fe4ff38aad8d5fce031e8a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd120cc1c-558a-5d5f-b340-fc5c703d2aae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 119394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d120cc1c-558a-5d5f-b340-fc5c703d2aae/d120cc1c-558a-5d5f-b340-fc5c703d2aae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/914/76bb6c4f53fe4ff38aad8d5fce031e8a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Furgon 29 L1H1 dCi 115',
 'transmission': 'manual',
 'trim': '(O) Furgon 29 L1H1 dCi 115',
 'vin': None,
 'year': 2016}
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987086%27 HTTP/1.1" 200 None
2026-03-27 13:35:14 [ayvens.es] INFO: Saving data for 1987086: {'created_time': 1774618514.090718, 'last_price_update_time': 1774618514.09073, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987086') HTTP/1.1" 204 0
2026-03-27 13:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/527/321166d812fe47388e42a8f836e23cdd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/856/65c67861b84f48939a8b4b37b337969b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:14 [ayvens.es] INFO: Found listing with ID: 1987096
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987096%27 HTTP/1.1" 200 None
2026-03-27 13:35:14 [ayvens.es] INFO: Scrape type for 1987096: 1
2026-03-27 13:35:14 [ayvens.es] INFO: Extracting data for car ID: 1987096
2026-03-27 13:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40cf76c5-0252-56b2-97e6-90ea51232d5e with identifier: 1987096
2026-03-27 13:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40cf76c5-0252-56b2-97e6-90ea51232d5e with scrape type 1
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 40cf76c5-0252-56b2-97e6-90ea51232d5e
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F124%252F5d816e55e17e4ca1bf36020361cf7216%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/124/5d816e55e17e4ca1bf36020361cf7216/images/large/1.jpg not downloaded yet
2026-03-27 13:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/509/8322bb7071b2451797116475a2f2b0ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bdc950>
2026-03-27 13:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2003db44-0b61-5429-b7fc-211bf5163bd9/2003db44-0b61-5429-b7fc-211bf5163bd9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F412%252F84ad0bfcc9094d68a52463a698195d8c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/412/84ad0bfcc9094d68a52463a698195d8c/images/large/1.jpg saved to cache
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2003db44-0b61-5429-b7fc-211bf5163bd9
2026-03-27 13:35:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2003db44-0b61-5429-b7fc-211bf5163bd9, skipping ID generation
2026-03-27 13:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2003db44-0b61-5429-b7fc-211bf5163bd9 with scrape type 1
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2003db44-0b61-5429-b7fc-211bf5163bd9 sending to next pipeline
2026-03-27 13:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2003db44-0b61-5429-b7fc-211bf5163bd9, identifier: 1987087
2026-03-27 13:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529610c910>
2026-03-27 13:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cb2bdb0-8916-52cd-93a9-60e202d23034/7cb2bdb0-8916-52cd-93a9-60e202d23034_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F618%252F7473a35e0adb4d7b98cbd9e9a3d1195d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/618/7473a35e0adb4d7b98cbd9e9a3d1195d/images/large/1.jpg saved to cache
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cb2bdb0-8916-52cd-93a9-60e202d23034
2026-03-27 13:35:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cb2bdb0-8916-52cd-93a9-60e202d23034, skipping ID generation
2026-03-27 13:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb2bdb0-8916-52cd-93a9-60e202d23034 with scrape type 1
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cb2bdb0-8916-52cd-93a9-60e202d23034 sending to next pipeline
2026-03-27 13:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7cb2bdb0-8916-52cd-93a9-60e202d23034, identifier: 1987088
2026-03-27 13:35:14 [ayvens.es] INFO: Found listing with ID: 1987097
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987097%27 HTTP/1.1" 200 None
2026-03-27 13:35:14 [ayvens.es] INFO: Scrape type for 1987097: 1
2026-03-27 13:35:14 [ayvens.es] INFO: Extracting data for car ID: 1987097
2026-03-27 13:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3b2ea3-d892-5f56-bd5c-460d6b40b728 with identifier: 1987097
2026-03-27 13:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3b2ea3-d892-5f56-bd5c-460d6b40b728 with scrape type 1
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca3b2ea3-d892-5f56-bd5c-460d6b40b728
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F959%252Fce58773505944e629f35acb50b902b5e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/959/ce58773505944e629f35acb50b902b5e/images/large/1.jpg not downloaded yet
2026-03-27 13:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2003db44-0b61-5429-b7fc-211bf5163bd9 with identifier: 1987087
2026-03-27 13:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2003db44-0b61-5429-b7fc-211bf5163bd9 with identifier: 1987087
2026-03-27 13:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2003db44-0b61-5429-b7fc-211bf5163bd9 with identifier: 1987087 to the API
2026-03-27 13:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/412/84ad0bfcc9094d68a52463a698195d8c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2003db44-0b61-5429-b7fc-211bf5163bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 70787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2003db44-0b61-5429-b7fc-211bf5163bd9/2003db44-0b61-5429-b7fc-211bf5163bd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/412/84ad0bfcc9094d68a52463a698195d8c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 225 e-EAT8 Allure Pack',
 'transmission': 'manual',
 'trim': '225 e-EAT8 Allure Pack',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987087%27 HTTP/1.1" 200 None
2026-03-27 13:35:15 [ayvens.es] INFO: Saving data for 1987087: {'created_time': 1774618515.659856, 'last_price_update_time': 1774618515.659868, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987087') HTTP/1.1" 204 0
2026-03-27 13:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7cb2bdb0-8916-52cd-93a9-60e202d23034 with identifier: 1987088
2026-03-27 13:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7cb2bdb0-8916-52cd-93a9-60e202d23034 with identifier: 1987088
2026-03-27 13:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7cb2bdb0-8916-52cd-93a9-60e202d23034 with identifier: 1987088 to the API
2026-03-27 13:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/618/7473a35e0adb4d7b98cbd9e9a3d1195d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7cb2bdb0-8916-52cd-93a9-60e202d23034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 45220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cb2bdb0-8916-52cd-93a9-60e202d23034/7cb2bdb0-8916-52cd-93a9-60e202d23034_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/618/7473a35e0adb4d7b98cbd9e9a3d1195d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2018}
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987088%27 HTTP/1.1" 200 None
2026-03-27 13:35:16 [ayvens.es] INFO: Saving data for 1987088: {'created_time': 1774618516.144202, 'last_price_update_time': 1774618516.144212, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987088') HTTP/1.1" 204 0
2026-03-27 13:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296231390>
2026-03-27 13:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c296ef24-99af-5461-8c09-179c212c9d57/c296ef24-99af-5461-8c09-179c212c9d57_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F527%252F321166d812fe47388e42a8f836e23cdd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/527/321166d812fe47388e42a8f836e23cdd/images/large/1.jpg saved to cache
2026-03-27 13:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c296ef24-99af-5461-8c09-179c212c9d57
2026-03-27 13:35:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c296ef24-99af-5461-8c09-179c212c9d57, skipping ID generation
2026-03-27 13:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c296ef24-99af-5461-8c09-179c212c9d57 with scrape type 1
2026-03-27 13:35:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c296ef24-99af-5461-8c09-179c212c9d57 sending to next pipeline
2026-03-27 13:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c296ef24-99af-5461-8c09-179c212c9d57, identifier: 1987090
2026-03-27 13:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960e5b50>
2026-03-27 13:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc6529a6-8cf7-5040-a848-0149b881e793/fc6529a6-8cf7-5040-a848-0149b881e793_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F65c67861b84f48939a8b4b37b337969b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/65c67861b84f48939a8b4b37b337969b/images/large/1.jpg saved to cache
2026-03-27 13:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc6529a6-8cf7-5040-a848-0149b881e793
2026-03-27 13:35:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc6529a6-8cf7-5040-a848-0149b881e793, skipping ID generation
2026-03-27 13:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc6529a6-8cf7-5040-a848-0149b881e793 with scrape type 1
2026-03-27 13:35:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc6529a6-8cf7-5040-a848-0149b881e793 sending to next pipeline
2026-03-27 13:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fc6529a6-8cf7-5040-a848-0149b881e793, identifier: 1987089
2026-03-27 13:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/826/54a5c116966d45aa8be13c558404dc8d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:16 [ayvens.es] INFO: Found listing with ID: 1987098
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987098%27 HTTP/1.1" 200 None
2026-03-27 13:35:16 [ayvens.es] INFO: Scrape type for 1987098: 1
2026-03-27 13:35:16 [ayvens.es] INFO: Extracting data for car ID: 1987098
2026-03-27 13:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbacef63-bcff-5fc1-9251-b4707d9f32c1 with identifier: 1987098
2026-03-27 13:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbacef63-bcff-5fc1-9251-b4707d9f32c1 with scrape type 1
2026-03-27 13:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cbacef63-bcff-5fc1-9251-b4707d9f32c1
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F429%252F4ffbf7aa3c8f475aa5dec148446e3b53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/429/4ffbf7aa3c8f475aa5dec148446e3b53/images/large/1.jpg not downloaded yet
2026-03-27 13:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c296ef24-99af-5461-8c09-179c212c9d57 with identifier: 1987090
2026-03-27 13:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c296ef24-99af-5461-8c09-179c212c9d57 with identifier: 1987090
2026-03-27 13:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c296ef24-99af-5461-8c09-179c212c9d57 with identifier: 1987090 to the API
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/527/321166d812fe47388e42a8f836e23cdd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c296ef24-99af-5461-8c09-179c212c9d57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 135431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c296ef24-99af-5461-8c09-179c212c9d57/c296ef24-99af-5461-8c09-179c212c9d57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/527/321166d812fe47388e42a8f836e23cdd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon L1H1 Blue dCi 81 Kw (110 CV)',
 'transmission': 'manual',
 'trim': 'Furgon L1H1 Blue dCi 81 Kw (110 CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987090%27 HTTP/1.1" 200 None
2026-03-27 13:35:16 [ayvens.es] INFO: Saving data for 1987090: {'created_time': 1774618516.979791, 'last_price_update_time': 1774618516.979801, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987090') HTTP/1.1" 204 0
2026-03-27 13:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fc6529a6-8cf7-5040-a848-0149b881e793 with identifier: 1987089
2026-03-27 13:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fc6529a6-8cf7-5040-a848-0149b881e793 with identifier: 1987089
2026-03-27 13:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fc6529a6-8cf7-5040-a848-0149b881e793 with identifier: 1987089 to the API
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/856/65c67861b84f48939a8b4b37b337969b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Mineralweiss metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fc6529a6-8cf7-5040-a848-0149b881e793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2 ACTIVE TOURER',
 'odometer': 91443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc6529a6-8cf7-5040-a848-0149b881e793/fc6529a6-8cf7-5040-a848-0149b881e793_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/856/65c67861b84f48939a8b4b37b337969b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 ACTIVE TOURER 216d',
 'transmission': 'manual',
 'trim': '216d',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987089%27 HTTP/1.1" 200 None
2026-03-27 13:35:17 [ayvens.es] INFO: Saving data for 1987089: {'created_time': 1774618517.573488, 'last_price_update_time': 1774618517.573546, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987089') HTTP/1.1" 204 0
2026-03-27 13:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/783/1e79b77073ac40c4aea64db008c8dc3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956f9710>
2026-03-27 13:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc95f4d6-8091-54c0-9dcb-34714eeca947/cc95f4d6-8091-54c0-9dcb-34714eeca947_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F509%252F8322bb7071b2451797116475a2f2b0ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/509/8322bb7071b2451797116475a2f2b0ff/images/large/1.jpg saved to cache
2026-03-27 13:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc95f4d6-8091-54c0-9dcb-34714eeca947
2026-03-27 13:35:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc95f4d6-8091-54c0-9dcb-34714eeca947, skipping ID generation
2026-03-27 13:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc95f4d6-8091-54c0-9dcb-34714eeca947 with scrape type 1
2026-03-27 13:35:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc95f4d6-8091-54c0-9dcb-34714eeca947 sending to next pipeline
2026-03-27 13:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cc95f4d6-8091-54c0-9dcb-34714eeca947, identifier: 1987091
2026-03-27 13:35:17 [ayvens.es] INFO: Found listing with ID: 1987099
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987099%27 HTTP/1.1" 200 None
2026-03-27 13:35:17 [ayvens.es] INFO: Scrape type for 1987099: 1
2026-03-27 13:35:17 [ayvens.es] INFO: Extracting data for car ID: 1987099
2026-03-27 13:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e08d33-eb7c-51a6-81cc-8ba7719115b8 with identifier: 1987099
2026-03-27 13:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e08d33-eb7c-51a6-81cc-8ba7719115b8 with scrape type 1
2026-03-27 13:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e2e08d33-eb7c-51a6-81cc-8ba7719115b8
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252F021258818b7a4dbdb4b8e1980f7d27e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/021258818b7a4dbdb4b8e1980f7d27e5/images/large/1.jpg not downloaded yet
2026-03-27 13:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cc95f4d6-8091-54c0-9dcb-34714eeca947 with identifier: 1987091
2026-03-27 13:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cc95f4d6-8091-54c0-9dcb-34714eeca947 with identifier: 1987091
2026-03-27 13:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cc95f4d6-8091-54c0-9dcb-34714eeca947 with identifier: 1987091 to the API
2026-03-27 13:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/509/8322bb7071b2451797116475a2f2b0ff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cc95f4d6-8091-54c0-9dcb-34714eeca947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NAVARA',
 'odometer': 132144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc95f4d6-8091-54c0-9dcb-34714eeca947/cc95f4d6-8091-54c0-9dcb-34714eeca947_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/509/8322bb7071b2451797116475a2f2b0ff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN NAVARA D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'transmission': 'manual',
 'trim': 'D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'vin': None,
 'year': 2020}
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987091%27 HTTP/1.1" 200 None
2026-03-27 13:35:18 [ayvens.es] INFO: Saving data for 1987091: {'created_time': 1774618518.248612, 'last_price_update_time': 1774618518.248623, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987091') HTTP/1.1" 204 0
2026-03-27 13:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295723690>
2026-03-27 13:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc75fafc-be3c-5084-b1d3-378fc0132923/dc75fafc-be3c-5084-b1d3-378fc0132923_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F54a5c116966d45aa8be13c558404dc8d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/54a5c116966d45aa8be13c558404dc8d/images/large/1.jpg saved to cache
2026-03-27 13:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc75fafc-be3c-5084-b1d3-378fc0132923
2026-03-27 13:35:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc75fafc-be3c-5084-b1d3-378fc0132923, skipping ID generation
2026-03-27 13:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc75fafc-be3c-5084-b1d3-378fc0132923 with scrape type 1
2026-03-27 13:35:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc75fafc-be3c-5084-b1d3-378fc0132923 sending to next pipeline
2026-03-27 13:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc75fafc-be3c-5084-b1d3-378fc0132923, identifier: 1987092
2026-03-27 13:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/050/62f3f701579e424d990acdc5b720ccc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:18 [ayvens.es] INFO: Found listing with ID: 1987100
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987100%27 HTTP/1.1" 200 None
2026-03-27 13:35:18 [ayvens.es] INFO: Scrape type for 1987100: 1
2026-03-27 13:35:18 [ayvens.es] INFO: Extracting data for car ID: 1987100
2026-03-27 13:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68ba3b41-8b99-58f6-9acf-7fcb265140a3 with identifier: 1987100
2026-03-27 13:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ba3b41-8b99-58f6-9acf-7fcb265140a3 with scrape type 1
2026-03-27 13:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68ba3b41-8b99-58f6-9acf-7fcb265140a3
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F732%252Faad9bc3820ed4e8aaf503a78f2e38960%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/732/aad9bc3820ed4e8aaf503a78f2e38960/images/large/1.jpg not downloaded yet
2026-03-27 13:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc75fafc-be3c-5084-b1d3-378fc0132923 with identifier: 1987092
2026-03-27 13:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc75fafc-be3c-5084-b1d3-378fc0132923 with identifier: 1987092
2026-03-27 13:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc75fafc-be3c-5084-b1d3-378fc0132923 with identifier: 1987092 to the API
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/826/54a5c116966d45aa8be13c558404dc8d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.1L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dc75fafc-be3c-5084-b1d3-378fc0132923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 137960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc75fafc-be3c-5084-b1d3-378fc0132923/dc75fafc-be3c-5084-b1d3-378fc0132923_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/826/54a5c116966d45aa8be13c558404dc8d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.1 Ti-VCT 63kW Trend 5p',
 'transmission': 'manual',
 'trim': '1.1 Ti-VCT 63kW Trend 5p',
 'vin': None,
 'year': 2019}
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987092%27 HTTP/1.1" 200 None
2026-03-27 13:35:18 [ayvens.es] INFO: Saving data for 1987092: {'created_time': 1774618518.820532, 'last_price_update_time': 1774618518.820544, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987092') HTTP/1.1" 204 0
2026-03-27 13:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52989aced0>
2026-03-27 13:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b3f91e-db6e-5aab-9fe7-4e4860a18946/d6b3f91e-db6e-5aab-9fe7-4e4860a18946_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F783%252F1e79b77073ac40c4aea64db008c8dc3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/783/1e79b77073ac40c4aea64db008c8dc3c/images/large/1.jpg saved to cache
2026-03-27 13:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6b3f91e-db6e-5aab-9fe7-4e4860a18946
2026-03-27 13:35:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6b3f91e-db6e-5aab-9fe7-4e4860a18946, skipping ID generation
2026-03-27 13:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b3f91e-db6e-5aab-9fe7-4e4860a18946 with scrape type 1
2026-03-27 13:35:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6b3f91e-db6e-5aab-9fe7-4e4860a18946 sending to next pipeline
2026-03-27 13:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6b3f91e-db6e-5aab-9fe7-4e4860a18946, identifier: 1987093
2026-03-27 13:35:19 [ayvens.es] INFO: Found listing with ID: 1987101
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987101%27 HTTP/1.1" 200 None
2026-03-27 13:35:19 [ayvens.es] INFO: Scrape type for 1987101: 1
2026-03-27 13:35:19 [ayvens.es] INFO: Extracting data for car ID: 1987101
2026-03-27 13:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9072a34f-977b-54a8-afa5-22a609214a87 with identifier: 1987101
2026-03-27 13:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9072a34f-977b-54a8-afa5-22a609214a87 with scrape type 1
2026-03-27 13:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9072a34f-977b-54a8-afa5-22a609214a87
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F070%252Fd6affc63b96743518207c3f3ba149d7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/070/d6affc63b96743518207c3f3ba149d7d/images/large/1.jpg not downloaded yet
2026-03-27 13:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6b3f91e-db6e-5aab-9fe7-4e4860a18946 with identifier: 1987093
2026-03-27 13:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6b3f91e-db6e-5aab-9fe7-4e4860a18946 with identifier: 1987093
2026-03-27 13:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6b3f91e-db6e-5aab-9fe7-4e4860a18946 with identifier: 1987093 to the API
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/783/1e79b77073ac40c4aea64db008c8dc3c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Plata blade',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd6b3f91e-db6e-5aab-9fe7-4e4860a18946',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA',
 'odometer': 154249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b3f91e-db6e-5aab-9fe7-4e4860a18946/d6b3f91e-db6e-5aab-9fe7-4e4860a18946_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/783/1e79b77073ac40c4aea64db008c8dc3c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA 1.2T SHL 81kW (110CV) GS Line',
 'transmission': 'manual',
 'trim': '1.2T SHL 81kW (110CV) GS Line',
 'vin': None,
 'year': 2020}
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987093%27 HTTP/1.1" 200 None
2026-03-27 13:35:19 [ayvens.es] INFO: Saving data for 1987093: {'created_time': 1774618519.434231, 'last_price_update_time': 1774618519.434241, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987093') HTTP/1.1" 204 0
2026-03-27 13:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/378/200ef0b47773493cafdc199d3352fccc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529602b090>
2026-03-27 13:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a538d96e-d3bf-5095-83a1-46a7335c05be/a538d96e-d3bf-5095-83a1-46a7335c05be_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F050%252F62f3f701579e424d990acdc5b720ccc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/050/62f3f701579e424d990acdc5b720ccc6/images/large/1.jpg saved to cache
2026-03-27 13:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a538d96e-d3bf-5095-83a1-46a7335c05be
2026-03-27 13:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a538d96e-d3bf-5095-83a1-46a7335c05be, skipping ID generation
2026-03-27 13:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a538d96e-d3bf-5095-83a1-46a7335c05be with scrape type 1
2026-03-27 13:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a538d96e-d3bf-5095-83a1-46a7335c05be sending to next pipeline
2026-03-27 13:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a538d96e-d3bf-5095-83a1-46a7335c05be, identifier: 1987094
2026-03-27 13:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/124/5d816e55e17e4ca1bf36020361cf7216/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/959/ce58773505944e629f35acb50b902b5e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:19 [ayvens.es] INFO: Found listing with ID: 1987102
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987102%27 HTTP/1.1" 200 None
2026-03-27 13:35:19 [ayvens.es] INFO: Scrape type for 1987102: 1
2026-03-27 13:35:19 [ayvens.es] INFO: Extracting data for car ID: 1987102
2026-03-27 13:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6691ea78-da1e-5c07-82c0-85f0f81f88d3 with identifier: 1987102
2026-03-27 13:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6691ea78-da1e-5c07-82c0-85f0f81f88d3 with scrape type 1
2026-03-27 13:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6691ea78-da1e-5c07-82c0-85f0f81f88d3
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F944%252F6282f9a59aed4e76b28251f91e5838ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/944/6282f9a59aed4e76b28251f91e5838ca/images/large/1.jpg not downloaded yet
2026-03-27 13:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a538d96e-d3bf-5095-83a1-46a7335c05be with identifier: 1987094
2026-03-27 13:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a538d96e-d3bf-5095-83a1-46a7335c05be with identifier: 1987094
2026-03-27 13:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a538d96e-d3bf-5095-83a1-46a7335c05be with identifier: 1987094 to the API
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/050/62f3f701579e424d990acdc5b720ccc6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a538d96e-d3bf-5095-83a1-46a7335c05be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 66228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a538d96e-d3bf-5095-83a1-46a7335c05be/a538d96e-d3bf-5095-83a1-46a7335c05be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/050/62f3f701579e424d990acdc5b720ccc6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 180 d',
 'transmission': 'manual',
 'trim': 'A 180 d',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987094%27 HTTP/1.1" 200 None
2026-03-27 13:35:20 [ayvens.es] INFO: Saving data for 1987094: {'created_time': 1774618520.101338, 'last_price_update_time': 1774618520.101347, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987094') HTTP/1.1" 204 0
2026-03-27 13:35:20 [ayvens.es] INFO: Found listing with ID: 1987103
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987103%27 HTTP/1.1" 200 None
2026-03-27 13:35:20 [ayvens.es] INFO: Scrape type for 1987103: 1
2026-03-27 13:35:20 [ayvens.es] INFO: Extracting data for car ID: 1987103
2026-03-27 13:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19 with identifier: 1987103
2026-03-27 13:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19 with scrape type 1
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F169%252F034ebed24c0745b4a5cbb136a52e5b87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/169/034ebed24c0745b4a5cbb136a52e5b87/images/large/1.jpg not downloaded yet
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296319f10>
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4e24fc6-df30-5003-89d0-e248a7b63873/d4e24fc6-df30-5003-89d0-e248a7b63873_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252F200ef0b47773493cafdc199d3352fccc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/200ef0b47773493cafdc199d3352fccc/images/large/1.jpg saved to cache
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4e24fc6-df30-5003-89d0-e248a7b63873
2026-03-27 13:35:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4e24fc6-df30-5003-89d0-e248a7b63873, skipping ID generation
2026-03-27 13:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4e24fc6-df30-5003-89d0-e248a7b63873 with scrape type 1
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4e24fc6-df30-5003-89d0-e248a7b63873 sending to next pipeline
2026-03-27 13:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d4e24fc6-df30-5003-89d0-e248a7b63873, identifier: 1987095
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529815b990>
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40cf76c5-0252-56b2-97e6-90ea51232d5e/40cf76c5-0252-56b2-97e6-90ea51232d5e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F124%252F5d816e55e17e4ca1bf36020361cf7216%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/124/5d816e55e17e4ca1bf36020361cf7216/images/large/1.jpg saved to cache
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40cf76c5-0252-56b2-97e6-90ea51232d5e
2026-03-27 13:35:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40cf76c5-0252-56b2-97e6-90ea51232d5e, skipping ID generation
2026-03-27 13:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40cf76c5-0252-56b2-97e6-90ea51232d5e with scrape type 1
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40cf76c5-0252-56b2-97e6-90ea51232d5e sending to next pipeline
2026-03-27 13:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 40cf76c5-0252-56b2-97e6-90ea51232d5e, identifier: 1987096
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1c110>
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3b2ea3-d892-5f56-bd5c-460d6b40b728/ca3b2ea3-d892-5f56-bd5c-460d6b40b728_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F959%252Fce58773505944e629f35acb50b902b5e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/959/ce58773505944e629f35acb50b902b5e/images/large/1.jpg saved to cache
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca3b2ea3-d892-5f56-bd5c-460d6b40b728
2026-03-27 13:35:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca3b2ea3-d892-5f56-bd5c-460d6b40b728, skipping ID generation
2026-03-27 13:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3b2ea3-d892-5f56-bd5c-460d6b40b728 with scrape type 1
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca3b2ea3-d892-5f56-bd5c-460d6b40b728 sending to next pipeline
2026-03-27 13:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca3b2ea3-d892-5f56-bd5c-460d6b40b728, identifier: 1987097
2026-03-27 13:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/429/4ffbf7aa3c8f475aa5dec148446e3b53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:20 [ayvens.es] INFO: Found listing with ID: 1987104
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987104%27 HTTP/1.1" 200 None
2026-03-27 13:35:20 [ayvens.es] INFO: Scrape type for 1987104: 1
2026-03-27 13:35:20 [ayvens.es] INFO: Extracting data for car ID: 1987104
2026-03-27 13:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f1abb7d-d016-5e66-a222-282b54bea0c8 with identifier: 1987104
2026-03-27 13:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f1abb7d-d016-5e66-a222-282b54bea0c8 with scrape type 1
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6f1abb7d-d016-5e66-a222-282b54bea0c8
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F7f5c8ad4f0be4e429a3d869f0e7387e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/7f5c8ad4f0be4e429a3d869f0e7387e6/images/large/1.jpg not downloaded yet
2026-03-27 13:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d4e24fc6-df30-5003-89d0-e248a7b63873 with identifier: 1987095
2026-03-27 13:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d4e24fc6-df30-5003-89d0-e248a7b63873 with identifier: 1987095
2026-03-27 13:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d4e24fc6-df30-5003-89d0-e248a7b63873 with identifier: 1987095 to the API
2026-03-27 13:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/378/200ef0b47773493cafdc199d3352fccc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd4e24fc6-df30-5003-89d0-e248a7b63873',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 114544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4e24fc6-df30-5003-89d0-e248a7b63873/d4e24fc6-df30-5003-89d0-e248a7b63873_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/378/200ef0b47773493cafdc199d3352fccc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-16',
 'seats_number': 6,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 D 88kW (120CV) M Std Express M.P. DC',
 'transmission': 'manual',
 'trim': '1.5 D 88kW (120CV) M Std Express M.P. DC',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987095%27 HTTP/1.1" 200 None
2026-03-27 13:35:21 [ayvens.es] INFO: Saving data for 1987095: {'created_time': 1774618521.215512, 'last_price_update_time': 1774618521.215522, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987095') HTTP/1.1" 204 0
2026-03-27 13:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 40cf76c5-0252-56b2-97e6-90ea51232d5e with identifier: 1987096
2026-03-27 13:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 40cf76c5-0252-56b2-97e6-90ea51232d5e with identifier: 1987096
2026-03-27 13:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 40cf76c5-0252-56b2-97e6-90ea51232d5e with identifier: 1987096 to the API
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/124/5d816e55e17e4ca1bf36020361cf7216/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '40cf76c5-0252-56b2-97e6-90ea51232d5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 133362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40cf76c5-0252-56b2-97e6-90ea51232d5e/40cf76c5-0252-56b2-97e6-90ea51232d5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/124/5d816e55e17e4ca1bf36020361cf7216/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 71kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 71kW Trend',
 'vin': None,
 'year': 2020}
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987096%27 HTTP/1.1" 200 None
2026-03-27 13:35:21 [ayvens.es] INFO: Saving data for 1987096: {'created_time': 1774618521.686698, 'last_price_update_time': 1774618521.686708, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987096') HTTP/1.1" 204 0
2026-03-27 13:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca3b2ea3-d892-5f56-bd5c-460d6b40b728 with identifier: 1987097
2026-03-27 13:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca3b2ea3-d892-5f56-bd5c-460d6b40b728 with identifier: 1987097
2026-03-27 13:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca3b2ea3-d892-5f56-bd5c-460d6b40b728 with identifier: 1987097 to the API
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/959/ce58773505944e629f35acb50b902b5e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco blanquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ca3b2ea3-d892-5f56-bd5c-460d6b40b728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 71549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3b2ea3-d892-5f56-bd5c-460d6b40b728/ca3b2ea3-d892-5f56-bd5c-460d6b40b728_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/959/ce58773505944e629f35acb50b902b5e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE PureTech 60kW (82CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE PureTech 60kW (82CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987097%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [ayvens.es] INFO: Saving data for 1987097: {'created_time': 1774618522.042013, 'last_price_update_time': 1774618522.042023, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987097') HTTP/1.1" 204 0
2026-03-27 13:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/629/021258818b7a4dbdb4b8e1980f7d27e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:22 [ayvens.es] INFO: Found listing with ID: 1987105
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987105%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [ayvens.es] INFO: Scrape type for 1987105: 1
2026-03-27 13:35:22 [ayvens.es] INFO: Extracting data for car ID: 1987105
2026-03-27 13:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8542024c-3b43-50e0-9bf9-0d7538570052 with identifier: 1987105
2026-03-27 13:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8542024c-3b43-50e0-9bf9-0d7538570052 with scrape type 1
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8542024c-3b43-50e0-9bf9-0d7538570052
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F247%252F4d563c9e83d8422b8b80f325d927777f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/247/4d563c9e83d8422b8b80f325d927777f/images/large/1.jpg not downloaded yet
2026-03-27 13:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fb2d10>
2026-03-27 13:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbacef63-bcff-5fc1-9251-b4707d9f32c1/cbacef63-bcff-5fc1-9251-b4707d9f32c1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F429%252F4ffbf7aa3c8f475aa5dec148446e3b53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/429/4ffbf7aa3c8f475aa5dec148446e3b53/images/large/1.jpg saved to cache
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbacef63-bcff-5fc1-9251-b4707d9f32c1
2026-03-27 13:35:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbacef63-bcff-5fc1-9251-b4707d9f32c1, skipping ID generation
2026-03-27 13:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbacef63-bcff-5fc1-9251-b4707d9f32c1 with scrape type 1
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbacef63-bcff-5fc1-9251-b4707d9f32c1 sending to next pipeline
2026-03-27 13:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cbacef63-bcff-5fc1-9251-b4707d9f32c1, identifier: 1987098
2026-03-27 13:35:22 [ayvens.es] INFO: Found listing with ID: 1987106
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987106%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [ayvens.es] INFO: Scrape type for 1987106: 1
2026-03-27 13:35:22 [ayvens.es] INFO: Extracting data for car ID: 1987106
2026-03-27 13:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4fdfe3f-81fb-5302-99b2-2dc1a17b9577 with identifier: 1987106
2026-03-27 13:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4fdfe3f-81fb-5302-99b2-2dc1a17b9577 with scrape type 1
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d4fdfe3f-81fb-5302-99b2-2dc1a17b9577
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252Fe634cca79e954914a5962feedebc9721%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/e634cca79e954914a5962feedebc9721/images/large/1.jpg not downloaded yet
2026-03-27 13:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cbacef63-bcff-5fc1-9251-b4707d9f32c1 with identifier: 1987098
2026-03-27 13:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cbacef63-bcff-5fc1-9251-b4707d9f32c1 with identifier: 1987098
2026-03-27 13:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cbacef63-bcff-5fc1-9251-b4707d9f32c1 with identifier: 1987098 to the API
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/429/4ffbf7aa3c8f475aa5dec148446e3b53/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cbacef63-bcff-5fc1-9251-b4707d9f32c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 218303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbacef63-bcff-5fc1-9251-b4707d9f32c1/cbacef63-bcff-5fc1-9251-b4707d9f32c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/429/4ffbf7aa3c8f475aa5dec148446e3b53/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Energy dCi 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 81kW (110CV)',
 'vin': None,
 'year': 2018}
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987098%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [ayvens.es] INFO: Saving data for 1987098: {'created_time': 1774618522.655331, 'last_price_update_time': 1774618522.655341, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987098') HTTP/1.1" 204 0
2026-03-27 13:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/732/aad9bc3820ed4e8aaf503a78f2e38960/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/070/d6affc63b96743518207c3f3ba149d7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:22 [ayvens.es] INFO: Found listing with ID: 1987107
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987107%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [ayvens.es] INFO: Scrape type for 1987107: 1
2026-03-27 13:35:22 [ayvens.es] INFO: Extracting data for car ID: 1987107
2026-03-27 13:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82883a9-78e5-530d-9d91-fe1108bd3990 with identifier: 1987107
2026-03-27 13:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82883a9-78e5-530d-9d91-fe1108bd3990 with scrape type 1
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f82883a9-78e5-530d-9d91-fe1108bd3990
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252Fd54268ac939c410c9331d67b3e2481f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/d54268ac939c410c9331d67b3e2481f8/images/large/1.jpg not downloaded yet
2026-03-27 13:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957974d0>
2026-03-27 13:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e08d33-eb7c-51a6-81cc-8ba7719115b8/e2e08d33-eb7c-51a6-81cc-8ba7719115b8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252F021258818b7a4dbdb4b8e1980f7d27e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/021258818b7a4dbdb4b8e1980f7d27e5/images/large/1.jpg saved to cache
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2e08d33-eb7c-51a6-81cc-8ba7719115b8
2026-03-27 13:35:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e08d33-eb7c-51a6-81cc-8ba7719115b8, skipping ID generation
2026-03-27 13:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e08d33-eb7c-51a6-81cc-8ba7719115b8 with scrape type 1
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2e08d33-eb7c-51a6-81cc-8ba7719115b8 sending to next pipeline
2026-03-27 13:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e2e08d33-eb7c-51a6-81cc-8ba7719115b8, identifier: 1987099
2026-03-27 13:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/944/6282f9a59aed4e76b28251f91e5838ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:22 [ayvens.es] INFO: Found listing with ID: 1987108
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987108%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [ayvens.es] INFO: Scrape type for 1987108: 1
2026-03-27 13:35:22 [ayvens.es] INFO: Extracting data for car ID: 1987108
2026-03-27 13:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a97048-07b6-5818-9c7e-841f5bb2de7c with identifier: 1987108
2026-03-27 13:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a97048-07b6-5818-9c7e-841f5bb2de7c with scrape type 1
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29a97048-07b6-5818-9c7e-841f5bb2de7c
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F634%252F008098224c764505af33568c40e1ea9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/634/008098224c764505af33568c40e1ea9b/images/large/1.jpg not downloaded yet
2026-03-27 13:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e2e08d33-eb7c-51a6-81cc-8ba7719115b8 with identifier: 1987099
2026-03-27 13:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e2e08d33-eb7c-51a6-81cc-8ba7719115b8 with identifier: 1987099
2026-03-27 13:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e2e08d33-eb7c-51a6-81cc-8ba7719115b8 with identifier: 1987099 to the API
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/629/021258818b7a4dbdb4b8e1980f7d27e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Negro metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e2e08d33-eb7c-51a6-81cc-8ba7719115b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 221555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e08d33-eb7c-51a6-81cc-8ba7719115b8/e2e08d33-eb7c-51a6-81cc-8ba7719115b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/629/021258818b7a4dbdb4b8e1980f7d27e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Style 1.5 BlueHDi 96KW (130CV)',
 'transmission': 'manual',
 'trim': 'SW Style 1.5 BlueHDi 96KW (130CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987099%27 HTTP/1.1" 200 None
2026-03-27 13:35:23 [ayvens.es] INFO: Saving data for 1987099: {'created_time': 1774618523.583202, 'last_price_update_time': 1774618523.583212, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987099') HTTP/1.1" 204 0
2026-03-27 13:35:23 [ayvens.es] INFO: Found listing with ID: 1987109
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987109%27 HTTP/1.1" 200 None
2026-03-27 13:35:23 [ayvens.es] INFO: Scrape type for 1987109: 1
2026-03-27 13:35:23 [ayvens.es] INFO: Extracting data for car ID: 1987109
2026-03-27 13:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75300ae-b2c4-5242-b831-7c2f9e8fd57e with identifier: 1987109
2026-03-27 13:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75300ae-b2c4-5242-b831-7c2f9e8fd57e with scrape type 1
2026-03-27 13:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f75300ae-b2c4-5242-b831-7c2f9e8fd57e
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252Fa4900f0bd356463980b2a971e5df76a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/a4900f0bd356463980b2a971e5df76a7/images/large/1.jpg not downloaded yet
2026-03-27 13:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f20e50>
2026-03-27 13:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ba3b41-8b99-58f6-9acf-7fcb265140a3/68ba3b41-8b99-58f6-9acf-7fcb265140a3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F732%252Faad9bc3820ed4e8aaf503a78f2e38960%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/732/aad9bc3820ed4e8aaf503a78f2e38960/images/large/1.jpg saved to cache
2026-03-27 13:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68ba3b41-8b99-58f6-9acf-7fcb265140a3
2026-03-27 13:35:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68ba3b41-8b99-58f6-9acf-7fcb265140a3, skipping ID generation
2026-03-27 13:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ba3b41-8b99-58f6-9acf-7fcb265140a3 with scrape type 1
2026-03-27 13:35:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68ba3b41-8b99-58f6-9acf-7fcb265140a3 sending to next pipeline
2026-03-27 13:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 68ba3b41-8b99-58f6-9acf-7fcb265140a3, identifier: 1987100
2026-03-27 13:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956fd350>
2026-03-27 13:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9072a34f-977b-54a8-afa5-22a609214a87/9072a34f-977b-54a8-afa5-22a609214a87_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F070%252Fd6affc63b96743518207c3f3ba149d7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/070/d6affc63b96743518207c3f3ba149d7d/images/large/1.jpg saved to cache
2026-03-27 13:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9072a34f-977b-54a8-afa5-22a609214a87
2026-03-27 13:35:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9072a34f-977b-54a8-afa5-22a609214a87, skipping ID generation
2026-03-27 13:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9072a34f-977b-54a8-afa5-22a609214a87 with scrape type 1
2026-03-27 13:35:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9072a34f-977b-54a8-afa5-22a609214a87 sending to next pipeline
2026-03-27 13:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9072a34f-977b-54a8-afa5-22a609214a87, identifier: 1987101
2026-03-27 13:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52965e7810>
2026-03-27 13:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6691ea78-da1e-5c07-82c0-85f0f81f88d3/6691ea78-da1e-5c07-82c0-85f0f81f88d3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F944%252F6282f9a59aed4e76b28251f91e5838ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/944/6282f9a59aed4e76b28251f91e5838ca/images/large/1.jpg saved to cache
2026-03-27 13:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6691ea78-da1e-5c07-82c0-85f0f81f88d3
2026-03-27 13:35:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6691ea78-da1e-5c07-82c0-85f0f81f88d3, skipping ID generation
2026-03-27 13:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6691ea78-da1e-5c07-82c0-85f0f81f88d3 with scrape type 1
2026-03-27 13:35:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6691ea78-da1e-5c07-82c0-85f0f81f88d3 sending to next pipeline
2026-03-27 13:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6691ea78-da1e-5c07-82c0-85f0f81f88d3, identifier: 1987102
2026-03-27 13:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/169/034ebed24c0745b4a5cbb136a52e5b87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:24 [ayvens.es] INFO: Found listing with ID: 1987110
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987110%27 HTTP/1.1" 200 None
2026-03-27 13:35:24 [ayvens.es] INFO: Scrape type for 1987110: 1
2026-03-27 13:35:24 [ayvens.es] INFO: Extracting data for car ID: 1987110
2026-03-27 13:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea76a27e-834e-594b-b9c9-2bc81f9ae17a with identifier: 1987110
2026-03-27 13:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea76a27e-834e-594b-b9c9-2bc81f9ae17a with scrape type 1
2026-03-27 13:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ea76a27e-834e-594b-b9c9-2bc81f9ae17a
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F590%252F43c933ac3408410a819f6eb2c44687e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/590/43c933ac3408410a819f6eb2c44687e8/images/large/1.jpg not downloaded yet
2026-03-27 13:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 68ba3b41-8b99-58f6-9acf-7fcb265140a3 with identifier: 1987100
2026-03-27 13:35:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 68ba3b41-8b99-58f6-9acf-7fcb265140a3 with identifier: 1987100
2026-03-27 13:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 68ba3b41-8b99-58f6-9acf-7fcb265140a3 with identifier: 1987100 to the API
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/732/aad9bc3820ed4e8aaf503a78f2e38960/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco met',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '68ba3b41-8b99-58f6-9acf-7fcb265140a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 72422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ba3b41-8b99-58f6-9acf-7fcb265140a3/68ba3b41-8b99-58f6-9acf-7fcb265140a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/732/aad9bc3820ed4e8aaf503a78f2e38960/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D 4MATIC DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D 4MATIC DCT 110KW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987100%27 HTTP/1.1" 200 None
2026-03-27 13:35:25 [ayvens.es] INFO: Saving data for 1987100: {'created_time': 1774618525.005043, 'last_price_update_time': 1774618525.005054, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987100') HTTP/1.1" 204 0
2026-03-27 13:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9072a34f-977b-54a8-afa5-22a609214a87 with identifier: 1987101
2026-03-27 13:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9072a34f-977b-54a8-afa5-22a609214a87 with identifier: 1987101
2026-03-27 13:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9072a34f-977b-54a8-afa5-22a609214a87 with identifier: 1987101 to the API
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/070/d6affc63b96743518207c3f3ba149d7d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Flamencorot efecto b',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9072a34f-977b-54a8-afa5-22a609214a87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X6',
 'odometer': 164636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9072a34f-977b-54a8-afa5-22a609214a87/9072a34f-977b-54a8-afa5-22a609214a87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/070/d6affc63b96743518207c3f3ba149d7d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X6 xDrive30d',
 'transmission': 'manual',
 'trim': 'xDrive30d',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987101%27 HTTP/1.1" 200 None
2026-03-27 13:35:25 [ayvens.es] INFO: Saving data for 1987101: {'created_time': 1774618525.409204, 'last_price_update_time': 1774618525.409213, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987101') HTTP/1.1" 204 0
2026-03-27 13:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6691ea78-da1e-5c07-82c0-85f0f81f88d3 with identifier: 1987102
2026-03-27 13:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6691ea78-da1e-5c07-82c0-85f0f81f88d3 with identifier: 1987102
2026-03-27 13:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6691ea78-da1e-5c07-82c0-85f0f81f88d3 with identifier: 1987102 to the API
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/944/6282f9a59aed4e76b28251f91e5838ca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Deep cerulean blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6691ea78-da1e-5c07-82c0-85f0f81f88d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 77965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6691ea78-da1e-5c07-82c0-85f0f81f88d3/6691ea78-da1e-5c07-82c0-85f0f81f88d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/944/6282f9a59aed4e76b28251f91e5838ca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDi HEV 104kW (141CV) Drive',
 'transmission': 'manual',
 'trim': '1.6 GDi HEV 104kW (141CV) Drive',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987102%27 HTTP/1.1" 200 None
2026-03-27 13:35:25 [ayvens.es] INFO: Saving data for 1987102: {'created_time': 1774618525.789212, 'last_price_update_time': 1774618525.789222, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987102') HTTP/1.1" 204 0
2026-03-27 13:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/247/4d563c9e83d8422b8b80f325d927777f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/729/7f5c8ad4f0be4e429a3d869f0e7387e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:25 [ayvens.es] INFO: Found listing with ID: 1987111
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987111%27 HTTP/1.1" 200 None
2026-03-27 13:35:25 [ayvens.es] INFO: Scrape type for 1987111: 1
2026-03-27 13:35:25 [ayvens.es] INFO: Extracting data for car ID: 1987111
2026-03-27 13:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5766e43d-f5be-5a2b-a700-215e8a081646 with identifier: 1987111
2026-03-27 13:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5766e43d-f5be-5a2b-a700-215e8a081646 with scrape type 1
2026-03-27 13:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5766e43d-f5be-5a2b-a700-215e8a081646
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F076%252Faee302ef3b214e108ab8a26f2d1a2239%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/076/aee302ef3b214e108ab8a26f2d1a2239/images/large/1.jpg not downloaded yet
2026-03-27 13:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956fe8d0>
2026-03-27 13:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19/9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F169%252F034ebed24c0745b4a5cbb136a52e5b87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/169/034ebed24c0745b4a5cbb136a52e5b87/images/large/1.jpg saved to cache
2026-03-27 13:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19
2026-03-27 13:35:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19, skipping ID generation
2026-03-27 13:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19 with scrape type 1
2026-03-27 13:35:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19 sending to next pipeline
2026-03-27 13:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19, identifier: 1987103
2026-03-27 13:35:26 [ayvens.es] INFO: Found listing with ID: 1987112
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987112%27 HTTP/1.1" 200 None
2026-03-27 13:35:26 [ayvens.es] INFO: Scrape type for 1987112: 1
2026-03-27 13:35:26 [ayvens.es] INFO: Extracting data for car ID: 1987112
2026-03-27 13:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aaf9417-5eda-5918-be39-f3ac1f31430e with identifier: 1987112
2026-03-27 13:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aaf9417-5eda-5918-be39-f3ac1f31430e with scrape type 1
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5aaf9417-5eda-5918-be39-f3ac1f31430e
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252Fbe5bd15b08e74c949e521f90361fe4ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/be5bd15b08e74c949e521f90361fe4ab/images/large/1.jpg not downloaded yet
2026-03-27 13:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19 with identifier: 1987103
2026-03-27 13:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19 with identifier: 1987103
2026-03-27 13:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19 with identifier: 1987103 to the API
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/169/034ebed24c0745b4a5cbb136a52e5b87/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura blanco glaci',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 154315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19/9fd3b2f6-3b4e-50fd-a69e-587e0ca1ac19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/169/034ebed24c0745b4a5cbb136a52e5b87/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987103%27 HTTP/1.1" 200 None
2026-03-27 13:35:26 [ayvens.es] INFO: Saving data for 1987103: {'created_time': 1774618526.363817, 'last_price_update_time': 1774618526.363827, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987103') HTTP/1.1" 204 0
2026-03-27 13:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/716/d54268ac939c410c9331d67b3e2481f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/543/e634cca79e954914a5962feedebc9721/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:26 [ayvens.es] INFO: Found listing with ID: 1987113
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987113%27 HTTP/1.1" 200 None
2026-03-27 13:35:26 [ayvens.es] INFO: Scrape type for 1987113: 1
2026-03-27 13:35:26 [ayvens.es] INFO: Extracting data for car ID: 1987113
2026-03-27 13:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74624f5e-0adb-5e1e-97d6-178b26263f7b with identifier: 1987113
2026-03-27 13:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74624f5e-0adb-5e1e-97d6-178b26263f7b with scrape type 1
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 74624f5e-0adb-5e1e-97d6-178b26263f7b
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F391%252F25ffde4a49e64d658983c572c000a06d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/391/25ffde4a49e64d658983c572c000a06d/images/large/1.jpg not downloaded yet
2026-03-27 13:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0d150>
2026-03-27 13:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8542024c-3b43-50e0-9bf9-0d7538570052/8542024c-3b43-50e0-9bf9-0d7538570052_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F247%252F4d563c9e83d8422b8b80f325d927777f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/247/4d563c9e83d8422b8b80f325d927777f/images/large/1.jpg saved to cache
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8542024c-3b43-50e0-9bf9-0d7538570052
2026-03-27 13:35:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8542024c-3b43-50e0-9bf9-0d7538570052, skipping ID generation
2026-03-27 13:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8542024c-3b43-50e0-9bf9-0d7538570052 with scrape type 1
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8542024c-3b43-50e0-9bf9-0d7538570052 sending to next pipeline
2026-03-27 13:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8542024c-3b43-50e0-9bf9-0d7538570052, identifier: 1987105
2026-03-27 13:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296702f90>
2026-03-27 13:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f1abb7d-d016-5e66-a222-282b54bea0c8/6f1abb7d-d016-5e66-a222-282b54bea0c8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F7f5c8ad4f0be4e429a3d869f0e7387e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/7f5c8ad4f0be4e429a3d869f0e7387e6/images/large/1.jpg saved to cache
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f1abb7d-d016-5e66-a222-282b54bea0c8
2026-03-27 13:35:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f1abb7d-d016-5e66-a222-282b54bea0c8, skipping ID generation
2026-03-27 13:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f1abb7d-d016-5e66-a222-282b54bea0c8 with scrape type 1
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f1abb7d-d016-5e66-a222-282b54bea0c8 sending to next pipeline
2026-03-27 13:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6f1abb7d-d016-5e66-a222-282b54bea0c8, identifier: 1987104
2026-03-27 13:35:26 [ayvens.es] INFO: Found listing with ID: 1987114
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987114%27 HTTP/1.1" 200 None
2026-03-27 13:35:26 [ayvens.es] INFO: Scrape type for 1987114: 1
2026-03-27 13:35:26 [ayvens.es] INFO: Extracting data for car ID: 1987114
2026-03-27 13:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b6388f9-4c81-5797-a067-db2e88224866 with identifier: 1987114
2026-03-27 13:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b6388f9-4c81-5797-a067-db2e88224866 with scrape type 1
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2b6388f9-4c81-5797-a067-db2e88224866
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252F016a2aa2b3034e1d862ffa849d01ce76%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/016a2aa2b3034e1d862ffa849d01ce76/images/large/1.jpg not downloaded yet
2026-03-27 13:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8542024c-3b43-50e0-9bf9-0d7538570052 with identifier: 1987105
2026-03-27 13:35:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8542024c-3b43-50e0-9bf9-0d7538570052 with identifier: 1987105
2026-03-27 13:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8542024c-3b43-50e0-9bf9-0d7538570052 with identifier: 1987105 to the API
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/247/4d563c9e83d8422b8b80f325d927777f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Oro rosado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '8542024c-3b43-50e0-9bf9-0d7538570052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 75938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8542024c-3b43-50e0-9bf9-0d7538570052/8542024c-3b43-50e0-9bf9-0d7538570052_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/247/4d563c9e83d8422b8b80f325d927777f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 250 e',
 'transmission': 'manual',
 'trim': 'GLA 250 e',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987105%27 HTTP/1.1" 200 None
2026-03-27 13:35:27 [ayvens.es] INFO: Saving data for 1987105: {'created_time': 1774618527.466682, 'last_price_update_time': 1774618527.466693, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987105') HTTP/1.1" 204 0
2026-03-27 13:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6f1abb7d-d016-5e66-a222-282b54bea0c8 with identifier: 1987104
2026-03-27 13:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6f1abb7d-d016-5e66-a222-282b54bea0c8 with identifier: 1987104
2026-03-27 13:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6f1abb7d-d016-5e66-a222-282b54bea0c8 with identifier: 1987104 to the API
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/729/7f5c8ad4f0be4e429a3d869f0e7387e6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Gris acero',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6f1abb7d-d016-5e66-a222-282b54bea0c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 43605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f1abb7d-d016-5e66-a222-282b54bea0c8/6f1abb7d-d016-5e66-a222-282b54bea0c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/729/7f5c8ad4f0be4e429a3d869f0e7387e6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) Plus',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) Plus',
 'vin': None,
 'year': 2024}
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987104%27 HTTP/1.1" 200 None
2026-03-27 13:35:27 [ayvens.es] INFO: Saving data for 1987104: {'created_time': 1774618527.86469, 'last_price_update_time': 1774618527.8647, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987104') HTTP/1.1" 204 0
2026-03-27 13:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/634/008098224c764505af33568c40e1ea9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:27 [ayvens.es] INFO: Found listing with ID: 1987115
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987115%27 HTTP/1.1" 200 None
2026-03-27 13:35:27 [ayvens.es] INFO: Scrape type for 1987115: 1
2026-03-27 13:35:27 [ayvens.es] INFO: Extracting data for car ID: 1987115
2026-03-27 13:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b44917b-06b5-537f-b851-1e343418d6fa with identifier: 1987115
2026-03-27 13:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b44917b-06b5-537f-b851-1e343418d6fa with scrape type 1
2026-03-27 13:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1b44917b-06b5-537f-b851-1e343418d6fa
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F2788cc1cb02c45e9adf34b20517d7e25%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/2788cc1cb02c45e9adf34b20517d7e25/images/large/1.jpg not downloaded yet
2026-03-27 13:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/590/43c933ac3408410a819f6eb2c44687e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52a5631210>
2026-03-27 13:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f82883a9-78e5-530d-9d91-fe1108bd3990/f82883a9-78e5-530d-9d91-fe1108bd3990_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252Fd54268ac939c410c9331d67b3e2481f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/d54268ac939c410c9331d67b3e2481f8/images/large/1.jpg saved to cache
2026-03-27 13:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f82883a9-78e5-530d-9d91-fe1108bd3990
2026-03-27 13:35:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f82883a9-78e5-530d-9d91-fe1108bd3990, skipping ID generation
2026-03-27 13:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82883a9-78e5-530d-9d91-fe1108bd3990 with scrape type 1
2026-03-27 13:35:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f82883a9-78e5-530d-9d91-fe1108bd3990 sending to next pipeline
2026-03-27 13:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f82883a9-78e5-530d-9d91-fe1108bd3990, identifier: 1987107
2026-03-27 13:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bcded0>
2026-03-27 13:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fdfe3f-81fb-5302-99b2-2dc1a17b9577/d4fdfe3f-81fb-5302-99b2-2dc1a17b9577_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252Fe634cca79e954914a5962feedebc9721%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/e634cca79e954914a5962feedebc9721/images/large/1.jpg saved to cache
2026-03-27 13:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4fdfe3f-81fb-5302-99b2-2dc1a17b9577
2026-03-27 13:35:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4fdfe3f-81fb-5302-99b2-2dc1a17b9577, skipping ID generation
2026-03-27 13:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4fdfe3f-81fb-5302-99b2-2dc1a17b9577 with scrape type 1
2026-03-27 13:35:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4fdfe3f-81fb-5302-99b2-2dc1a17b9577 sending to next pipeline
2026-03-27 13:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d4fdfe3f-81fb-5302-99b2-2dc1a17b9577, identifier: 1987106
2026-03-27 13:35:28 [ayvens.es] INFO: Found listing with ID: 1987116
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987116%27 HTTP/1.1" 200 None
2026-03-27 13:35:28 [ayvens.es] INFO: Scrape type for 1987116: 1
2026-03-27 13:35:28 [ayvens.es] INFO: Extracting data for car ID: 1987116
2026-03-27 13:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e548b3a-9550-5e2c-9246-faebb13a2c20 with identifier: 1987116
2026-03-27 13:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e548b3a-9550-5e2c-9246-faebb13a2c20 with scrape type 1
2026-03-27 13:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e548b3a-9550-5e2c-9246-faebb13a2c20
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252Fca37aa92e2db41aaaaf184743161b5a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/ca37aa92e2db41aaaaf184743161b5a5/images/large/1.jpg not downloaded yet
2026-03-27 13:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f82883a9-78e5-530d-9d91-fe1108bd3990 with identifier: 1987107
2026-03-27 13:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f82883a9-78e5-530d-9d91-fe1108bd3990 with identifier: 1987107
2026-03-27 13:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f82883a9-78e5-530d-9d91-fe1108bd3990 with identifier: 1987107 to the API
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/716/d54268ac939c410c9331d67b3e2481f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f82883a9-78e5-530d-9d91-fe1108bd3990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 114887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82883a9-78e5-530d-9d91-fe1108bd3990/f82883a9-78e5-530d-9d91-fe1108bd3990_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/716/d54268ac939c410c9331d67b3e2481f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987107%27 HTTP/1.1" 200 None
2026-03-27 13:35:28 [ayvens.es] INFO: Saving data for 1987107: {'created_time': 1774618528.703434, 'last_price_update_time': 1774618528.703445, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987107') HTTP/1.1" 204 0
2026-03-27 13:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d4fdfe3f-81fb-5302-99b2-2dc1a17b9577 with identifier: 1987106
2026-03-27 13:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d4fdfe3f-81fb-5302-99b2-2dc1a17b9577 with identifier: 1987106
2026-03-27 13:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d4fdfe3f-81fb-5302-99b2-2dc1a17b9577 with identifier: 1987106 to the API
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/543/e634cca79e954914a5962feedebc9721/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'color': 'Negro obsidiana meta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd4fdfe3f-81fb-5302-99b2-2dc1a17b9577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 67271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fdfe3f-81fb-5302-99b2-2dc1a17b9577/d4fdfe3f-81fb-5302-99b2-2dc1a17b9577_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/543/e634cca79e954914a5962feedebc9721/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE GLC 300 de 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 de 4MATIC',
 'vin': None,
 'year': 2023}
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987106%27 HTTP/1.1" 200 None
2026-03-27 13:35:29 [ayvens.es] INFO: Saving data for 1987106: {'created_time': 1774618529.103375, 'last_price_update_time': 1774618529.103386, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987106') HTTP/1.1" 204 0
2026-03-27 13:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/416/a4900f0bd356463980b2a971e5df76a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/076/aee302ef3b214e108ab8a26f2d1a2239/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:29 [ayvens.es] INFO: Found listing with ID: 1987117
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987117%27 HTTP/1.1" 200 None
2026-03-27 13:35:29 [ayvens.es] INFO: Scrape type for 1987117: 1
2026-03-27 13:35:29 [ayvens.es] INFO: Extracting data for car ID: 1987117
2026-03-27 13:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a with identifier: 1987117
2026-03-27 13:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a with scrape type 1
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F874%252F5c54ffce525e4cc992639fe685853bd4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/874/5c54ffce525e4cc992639fe685853bd4/images/large/1.jpg not downloaded yet
2026-03-27 13:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4c5d0>
2026-03-27 13:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a97048-07b6-5818-9c7e-841f5bb2de7c/29a97048-07b6-5818-9c7e-841f5bb2de7c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F634%252F008098224c764505af33568c40e1ea9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/634/008098224c764505af33568c40e1ea9b/images/large/1.jpg saved to cache
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29a97048-07b6-5818-9c7e-841f5bb2de7c
2026-03-27 13:35:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29a97048-07b6-5818-9c7e-841f5bb2de7c, skipping ID generation
2026-03-27 13:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a97048-07b6-5818-9c7e-841f5bb2de7c with scrape type 1
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29a97048-07b6-5818-9c7e-841f5bb2de7c sending to next pipeline
2026-03-27 13:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29a97048-07b6-5818-9c7e-841f5bb2de7c, identifier: 1987108
2026-03-27 13:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f4d910>
2026-03-27 13:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea76a27e-834e-594b-b9c9-2bc81f9ae17a/ea76a27e-834e-594b-b9c9-2bc81f9ae17a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F590%252F43c933ac3408410a819f6eb2c44687e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/590/43c933ac3408410a819f6eb2c44687e8/images/large/1.jpg saved to cache
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea76a27e-834e-594b-b9c9-2bc81f9ae17a
2026-03-27 13:35:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea76a27e-834e-594b-b9c9-2bc81f9ae17a, skipping ID generation
2026-03-27 13:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea76a27e-834e-594b-b9c9-2bc81f9ae17a with scrape type 1
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea76a27e-834e-594b-b9c9-2bc81f9ae17a sending to next pipeline
2026-03-27 13:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ea76a27e-834e-594b-b9c9-2bc81f9ae17a, identifier: 1987110
2026-03-27 13:35:29 [ayvens.es] INFO: Found listing with ID: 1987118
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987118%27 HTTP/1.1" 200 None
2026-03-27 13:35:29 [ayvens.es] INFO: Scrape type for 1987118: 1
2026-03-27 13:35:29 [ayvens.es] INFO: Extracting data for car ID: 1987118
2026-03-27 13:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a3876f3-c68c-536d-9ce7-d7955e95e37e with identifier: 1987118
2026-03-27 13:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a3876f3-c68c-536d-9ce7-d7955e95e37e with scrape type 1
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a3876f3-c68c-536d-9ce7-d7955e95e37e
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F15305bfe67ec4123b9af8a4a9382a630%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/15305bfe67ec4123b9af8a4a9382a630/images/large/1.jpg not downloaded yet
2026-03-27 13:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29a97048-07b6-5818-9c7e-841f5bb2de7c with identifier: 1987108
2026-03-27 13:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29a97048-07b6-5818-9c7e-841f5bb2de7c with identifier: 1987108
2026-03-27 13:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29a97048-07b6-5818-9c7e-841f5bb2de7c with identifier: 1987108 to the API
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/634/008098224c764505af33568c40e1ea9b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '29a97048-07b6-5818-9c7e-841f5bb2de7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 6656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a97048-07b6-5818-9c7e-841f5bb2de7c/29a97048-07b6-5818-9c7e-841f5bb2de7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/634/008098224c764505af33568c40e1ea9b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Kombi 1.5 TDCi 74kW Trend 230 L1 (N1)',
 'transmission': 'manual',
 'trim': 'Kombi 1.5 TDCi 74kW Trend 230 L1 (N1)',
 'vin': None,
 'year': 2023}
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987108%27 HTTP/1.1" 200 None
2026-03-27 13:35:29 [ayvens.es] INFO: Saving data for 1987108: {'created_time': 1774618529.931244, 'last_price_update_time': 1774618529.931254, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987108') HTTP/1.1" 204 0
2026-03-27 13:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ea76a27e-834e-594b-b9c9-2bc81f9ae17a with identifier: 1987110
2026-03-27 13:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ea76a27e-834e-594b-b9c9-2bc81f9ae17a with identifier: 1987110
2026-03-27 13:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ea76a27e-834e-594b-b9c9-2bc81f9ae17a with identifier: 1987110 to the API
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/590/43c933ac3408410a819f6eb2c44687e8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Rojo jacinto metaliz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ea76a27e-834e-594b-b9c9-2bc81f9ae17a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 132880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea76a27e-834e-594b-b9c9-2bc81f9ae17a/ea76a27e-834e-594b-b9c9-2bc81f9ae17a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/590/43c933ac3408410a819f6eb2c44687e8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 220 d',
 'transmission': 'manual',
 'trim': 'C 220 d',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987110%27 HTTP/1.1" 200 None
2026-03-27 13:35:30 [ayvens.es] INFO: Saving data for 1987110: {'created_time': 1774618530.358974, 'last_price_update_time': 1774618530.358984, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987110') HTTP/1.1" 204 0
2026-03-27 13:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/478/be5bd15b08e74c949e521f90361fe4ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:30 [ayvens.es] INFO: Found listing with ID: 1987119
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987119%27 HTTP/1.1" 200 None
2026-03-27 13:35:30 [ayvens.es] INFO: Scrape type for 1987119: 1
2026-03-27 13:35:30 [ayvens.es] INFO: Extracting data for car ID: 1987119
2026-03-27 13:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0082f4a4-2378-53bf-808d-b41e3e077075 with identifier: 1987119
2026-03-27 13:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0082f4a4-2378-53bf-808d-b41e3e077075 with scrape type 1
2026-03-27 13:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0082f4a4-2378-53bf-808d-b41e3e077075
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F179%252Fe9d3f8fb63f2418b929fa8b43cf98cef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/179/e9d3f8fb63f2418b929fa8b43cf98cef/images/large/1.jpg not downloaded yet
2026-03-27 13:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960ae590>
2026-03-27 13:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f75300ae-b2c4-5242-b831-7c2f9e8fd57e/f75300ae-b2c4-5242-b831-7c2f9e8fd57e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252Fa4900f0bd356463980b2a971e5df76a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/a4900f0bd356463980b2a971e5df76a7/images/large/1.jpg saved to cache
2026-03-27 13:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f75300ae-b2c4-5242-b831-7c2f9e8fd57e
2026-03-27 13:35:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f75300ae-b2c4-5242-b831-7c2f9e8fd57e, skipping ID generation
2026-03-27 13:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75300ae-b2c4-5242-b831-7c2f9e8fd57e with scrape type 1
2026-03-27 13:35:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f75300ae-b2c4-5242-b831-7c2f9e8fd57e sending to next pipeline
2026-03-27 13:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f75300ae-b2c4-5242-b831-7c2f9e8fd57e, identifier: 1987109
2026-03-27 13:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529579d5d0>
2026-03-27 13:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5766e43d-f5be-5a2b-a700-215e8a081646/5766e43d-f5be-5a2b-a700-215e8a081646_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F076%252Faee302ef3b214e108ab8a26f2d1a2239%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/076/aee302ef3b214e108ab8a26f2d1a2239/images/large/1.jpg saved to cache
2026-03-27 13:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5766e43d-f5be-5a2b-a700-215e8a081646
2026-03-27 13:35:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5766e43d-f5be-5a2b-a700-215e8a081646, skipping ID generation
2026-03-27 13:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5766e43d-f5be-5a2b-a700-215e8a081646 with scrape type 1
2026-03-27 13:35:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5766e43d-f5be-5a2b-a700-215e8a081646 sending to next pipeline
2026-03-27 13:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5766e43d-f5be-5a2b-a700-215e8a081646, identifier: 1987111
2026-03-27 13:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f75300ae-b2c4-5242-b831-7c2f9e8fd57e with identifier: 1987109
2026-03-27 13:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f75300ae-b2c4-5242-b831-7c2f9e8fd57e with identifier: 1987109
2026-03-27 13:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f75300ae-b2c4-5242-b831-7c2f9e8fd57e with identifier: 1987109 to the API
2026-03-27 13:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/416/a4900f0bd356463980b2a971e5df76a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Gris selenita',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f75300ae-b2c4-5242-b831-7c2f9e8fd57e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 88172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f75300ae-b2c4-5242-b831-7c2f9e8fd57e/f75300ae-b2c4-5242-b831-7c2f9e8fd57e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/416/a4900f0bd356463980b2a971e5df76a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE GLC 300 de 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 de 4MATIC',
 'vin': None,
 'year': 2020}
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987109%27 HTTP/1.1" 200 None
2026-03-27 13:35:31 [ayvens.es] INFO: Saving data for 1987109: {'created_time': 1774618531.510678, 'last_price_update_time': 1774618531.510688, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987109') HTTP/1.1" 204 0
2026-03-27 13:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5766e43d-f5be-5a2b-a700-215e8a081646 with identifier: 1987111
2026-03-27 13:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5766e43d-f5be-5a2b-a700-215e8a081646 with identifier: 1987111
2026-03-27 13:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5766e43d-f5be-5a2b-a700-215e8a081646 with identifier: 1987111 to the API
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/076/aee302ef3b214e108ab8a26f2d1a2239/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5766e43d-f5be-5a2b-a700-215e8a081646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 78671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5766e43d-f5be-5a2b-a700-215e8a081646/5766e43d-f5be-5a2b-a700-215e8a081646_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/076/aee302ef3b214e108ab8a26f2d1a2239/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987111%27 HTTP/1.1" 200 None
2026-03-27 13:35:31 [ayvens.es] INFO: Saving data for 1987111: {'created_time': 1774618531.919906, 'last_price_update_time': 1774618531.919916, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987111') HTTP/1.1" 204 0
2026-03-27 13:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/391/25ffde4a49e64d658983c572c000a06d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:31 [ayvens.es] INFO: Found listing with ID: 1987120
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987120%27 HTTP/1.1" 200 None
2026-03-27 13:35:31 [ayvens.es] INFO: Scrape type for 1987120: 1
2026-03-27 13:35:31 [ayvens.es] INFO: Extracting data for car ID: 1987120
2026-03-27 13:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2d370d8-5f36-532a-a9da-4f6fd6f948ea with identifier: 1987120
2026-03-27 13:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2d370d8-5f36-532a-a9da-4f6fd6f948ea with scrape type 1
2026-03-27 13:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d2d370d8-5f36-532a-a9da-4f6fd6f948ea
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F204%252F57a2c30b10b74401a9c2fa77b2210dfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/204/57a2c30b10b74401a9c2fa77b2210dfe/images/large/1.jpg not downloaded yet
2026-03-27 13:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962031d0>
2026-03-27 13:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aaf9417-5eda-5918-be39-f3ac1f31430e/5aaf9417-5eda-5918-be39-f3ac1f31430e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252Fbe5bd15b08e74c949e521f90361fe4ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/be5bd15b08e74c949e521f90361fe4ab/images/large/1.jpg saved to cache
2026-03-27 13:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5aaf9417-5eda-5918-be39-f3ac1f31430e
2026-03-27 13:35:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5aaf9417-5eda-5918-be39-f3ac1f31430e, skipping ID generation
2026-03-27 13:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aaf9417-5eda-5918-be39-f3ac1f31430e with scrape type 1
2026-03-27 13:35:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5aaf9417-5eda-5918-be39-f3ac1f31430e sending to next pipeline
2026-03-27 13:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5aaf9417-5eda-5918-be39-f3ac1f31430e, identifier: 1987112
2026-03-27 13:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/2788cc1cb02c45e9adf34b20517d7e25/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/810/016a2aa2b3034e1d862ffa849d01ce76/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:32 [ayvens.es] INFO: Found listing with ID: 1987121
2026-03-27 13:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987121%27 HTTP/1.1" 200 None
2026-03-27 13:35:32 [ayvens.es] INFO: Scrape type for 1987121: 1
2026-03-27 13:35:32 [ayvens.es] INFO: Extracting data for car ID: 1987121
2026-03-27 13:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a065db2f-9dc4-5f75-bd22-dd820cf98386 with identifier: 1987121
2026-03-27 13:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a065db2f-9dc4-5f75-bd22-dd820cf98386 with scrape type 1
2026-03-27 13:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a065db2f-9dc4-5f75-bd22-dd820cf98386
2026-03-27 13:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F119%252F98791acb61be4ac694236509b6090b53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/119/98791acb61be4ac694236509b6090b53/images/large/1.jpg not downloaded yet
2026-03-27 13:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5aaf9417-5eda-5918-be39-f3ac1f31430e with identifier: 1987112
2026-03-27 13:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5aaf9417-5eda-5918-be39-f3ac1f31430e with identifier: 1987112
2026-03-27 13:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5aaf9417-5eda-5918-be39-f3ac1f31430e with identifier: 1987112 to the API
2026-03-27 13:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/478/be5bd15b08e74c949e521f90361fe4ab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Azul celebes',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5aaf9417-5eda-5918-be39-f3ac1f31430e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 124117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aaf9417-5eda-5918-be39-f3ac1f31430e/5aaf9417-5eda-5918-be39-f3ac1f31430e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/478/be5bd15b08e74c949e521f90361fe4ab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987112%27 HTTP/1.1" 200 None
2026-03-27 13:35:33 [ayvens.es] INFO: Saving data for 1987112: {'created_time': 1774618533.245846, 'last_price_update_time': 1774618533.245856, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987112') HTTP/1.1" 204 0
2026-03-27 13:35:33 [ayvens.es] INFO: Found listing with ID: 1987122
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987122%27 HTTP/1.1" 200 None
2026-03-27 13:35:33 [ayvens.es] INFO: Scrape type for 1987122: 1
2026-03-27 13:35:33 [ayvens.es] INFO: Extracting data for car ID: 1987122
2026-03-27 13:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2f53ff5-2dcf-5b44-b912-331d18d58431 with identifier: 1987122
2026-03-27 13:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f53ff5-2dcf-5b44-b912-331d18d58431 with scrape type 1
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2f53ff5-2dcf-5b44-b912-331d18d58431
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F4b2e7f223ff14e5d938dd2d33237e7bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/4b2e7f223ff14e5d938dd2d33237e7bf/images/large/1.jpg not downloaded yet
2026-03-27 13:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/874/5c54ffce525e4cc992639fe685853bd4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/626/ca37aa92e2db41aaaaf184743161b5a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f83d10>
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74624f5e-0adb-5e1e-97d6-178b26263f7b/74624f5e-0adb-5e1e-97d6-178b26263f7b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F391%252F25ffde4a49e64d658983c572c000a06d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/391/25ffde4a49e64d658983c572c000a06d/images/large/1.jpg saved to cache
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74624f5e-0adb-5e1e-97d6-178b26263f7b
2026-03-27 13:35:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74624f5e-0adb-5e1e-97d6-178b26263f7b, skipping ID generation
2026-03-27 13:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74624f5e-0adb-5e1e-97d6-178b26263f7b with scrape type 1
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74624f5e-0adb-5e1e-97d6-178b26263f7b sending to next pipeline
2026-03-27 13:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 74624f5e-0adb-5e1e-97d6-178b26263f7b, identifier: 1987113
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529618c850>
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b44917b-06b5-537f-b851-1e343418d6fa/1b44917b-06b5-537f-b851-1e343418d6fa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F2788cc1cb02c45e9adf34b20517d7e25%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/2788cc1cb02c45e9adf34b20517d7e25/images/large/1.jpg saved to cache
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b44917b-06b5-537f-b851-1e343418d6fa
2026-03-27 13:35:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b44917b-06b5-537f-b851-1e343418d6fa, skipping ID generation
2026-03-27 13:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b44917b-06b5-537f-b851-1e343418d6fa with scrape type 1
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b44917b-06b5-537f-b851-1e343418d6fa sending to next pipeline
2026-03-27 13:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1b44917b-06b5-537f-b851-1e343418d6fa, identifier: 1987115
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1c450>
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b6388f9-4c81-5797-a067-db2e88224866/2b6388f9-4c81-5797-a067-db2e88224866_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252F016a2aa2b3034e1d862ffa849d01ce76%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/016a2aa2b3034e1d862ffa849d01ce76/images/large/1.jpg saved to cache
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b6388f9-4c81-5797-a067-db2e88224866
2026-03-27 13:35:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b6388f9-4c81-5797-a067-db2e88224866, skipping ID generation
2026-03-27 13:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b6388f9-4c81-5797-a067-db2e88224866 with scrape type 1
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b6388f9-4c81-5797-a067-db2e88224866 sending to next pipeline
2026-03-27 13:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2b6388f9-4c81-5797-a067-db2e88224866, identifier: 1987114
2026-03-27 13:35:33 [ayvens.es] INFO: Found listing with ID: 1987123
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987123%27 HTTP/1.1" 200 None
2026-03-27 13:35:33 [ayvens.es] INFO: Scrape type for 1987123: 1
2026-03-27 13:35:33 [ayvens.es] INFO: Extracting data for car ID: 1987123
2026-03-27 13:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aef44c2c-80ee-5db5-a526-80d003dcf2ca with identifier: 1987123
2026-03-27 13:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aef44c2c-80ee-5db5-a526-80d003dcf2ca with scrape type 1
2026-03-27 13:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aef44c2c-80ee-5db5-a526-80d003dcf2ca
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F081%252Fcd75c37022f44a20b7a54d48c4ef3ad6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/081/cd75c37022f44a20b7a54d48c4ef3ad6/images/large/1.jpg not downloaded yet
2026-03-27 13:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 74624f5e-0adb-5e1e-97d6-178b26263f7b with identifier: 1987113
2026-03-27 13:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 74624f5e-0adb-5e1e-97d6-178b26263f7b with identifier: 1987113
2026-03-27 13:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 74624f5e-0adb-5e1e-97d6-178b26263f7b with identifier: 1987113 to the API
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/391/25ffde4a49e64d658983c572c000a06d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '74624f5e-0adb-5e1e-97d6-178b26263f7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 95312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74624f5e-0adb-5e1e-97d6-178b26263f7b/74624f5e-0adb-5e1e-97d6-178b26263f7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/391/25ffde4a49e64d658983c572c000a06d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987113%27 HTTP/1.1" 200 None
2026-03-27 13:35:34 [ayvens.es] INFO: Saving data for 1987113: {'created_time': 1774618534.339039, 'last_price_update_time': 1774618534.339049, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987113') HTTP/1.1" 204 0
2026-03-27 13:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1b44917b-06b5-537f-b851-1e343418d6fa with identifier: 1987115
2026-03-27 13:35:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1b44917b-06b5-537f-b851-1e343418d6fa with identifier: 1987115
2026-03-27 13:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1b44917b-06b5-537f-b851-1e343418d6fa with identifier: 1987115 to the API
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/635/2788cc1cb02c45e9adf34b20517d7e25/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Azul cavansita metal',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b44917b-06b5-537f-b851-1e343418d6fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 81725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b44917b-06b5-537f-b851-1e343418d6fa/1b44917b-06b5-537f-b851-1e343418d6fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/2788cc1cb02c45e9adf34b20517d7e25/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 200',
 'transmission': 'manual',
 'trim': 'C 200',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987115%27 HTTP/1.1" 200 None
2026-03-27 13:35:34 [ayvens.es] INFO: Saving data for 1987115: {'created_time': 1774618534.807834, 'last_price_update_time': 1774618534.807849, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987115') HTTP/1.1" 204 0
2026-03-27 13:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2b6388f9-4c81-5797-a067-db2e88224866 with identifier: 1987114
2026-03-27 13:35:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2b6388f9-4c81-5797-a067-db2e88224866 with identifier: 1987114
2026-03-27 13:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2b6388f9-4c81-5797-a067-db2e88224866 with identifier: 1987114 to the API
2026-03-27 13:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/810/016a2aa2b3034e1d862ffa849d01ce76/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 13,
 'color': 'Azul espectral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2b6388f9-4c81-5797-a067-db2e88224866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 40899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b6388f9-4c81-5797-a067-db2e88224866/2b6388f9-4c81-5797-a067-db2e88224866_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/810/016a2aa2b3034e1d862ffa849d01ce76/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 300 e',
 'transmission': 'manual',
 'trim': 'C 300 e',
 'vin': None,
 'year': 2023}
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987114%27 HTTP/1.1" 200 None
2026-03-27 13:35:35 [ayvens.es] INFO: Saving data for 1987114: {'created_time': 1774618535.203972, 'last_price_update_time': 1774618535.203984, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987114') HTTP/1.1" 204 0
2026-03-27 13:35:35 [ayvens.es] INFO: Found listing with ID: 1987124
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987124%27 HTTP/1.1" 200 None
2026-03-27 13:35:35 [ayvens.es] INFO: Scrape type for 1987124: 1
2026-03-27 13:35:35 [ayvens.es] INFO: Extracting data for car ID: 1987124
2026-03-27 13:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fffbc78-9a6e-5657-a287-e38944fc05b0 with identifier: 1987124
2026-03-27 13:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fffbc78-9a6e-5657-a287-e38944fc05b0 with scrape type 1
2026-03-27 13:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6fffbc78-9a6e-5657-a287-e38944fc05b0
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F890%252F1b847c8065004ca7a6e16c592094d9fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/890/1b847c8065004ca7a6e16c592094d9fd/images/large/1.jpg not downloaded yet
2026-03-27 13:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fb0590>
2026-03-27 13:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a/cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F874%252F5c54ffce525e4cc992639fe685853bd4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/874/5c54ffce525e4cc992639fe685853bd4/images/large/1.jpg saved to cache
2026-03-27 13:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a
2026-03-27 13:35:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a, skipping ID generation
2026-03-27 13:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a with scrape type 1
2026-03-27 13:35:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a sending to next pipeline
2026-03-27 13:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a, identifier: 1987117
2026-03-27 13:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296028e10>
2026-03-27 13:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e548b3a-9550-5e2c-9246-faebb13a2c20/0e548b3a-9550-5e2c-9246-faebb13a2c20_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252Fca37aa92e2db41aaaaf184743161b5a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/ca37aa92e2db41aaaaf184743161b5a5/images/large/1.jpg saved to cache
2026-03-27 13:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e548b3a-9550-5e2c-9246-faebb13a2c20
2026-03-27 13:35:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e548b3a-9550-5e2c-9246-faebb13a2c20, skipping ID generation
2026-03-27 13:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e548b3a-9550-5e2c-9246-faebb13a2c20 with scrape type 1
2026-03-27 13:35:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e548b3a-9550-5e2c-9246-faebb13a2c20 sending to next pipeline
2026-03-27 13:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e548b3a-9550-5e2c-9246-faebb13a2c20, identifier: 1987116
2026-03-27 13:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/179/e9d3f8fb63f2418b929fa8b43cf98cef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a with identifier: 1987117
2026-03-27 13:35:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a with identifier: 1987117
2026-03-27 13:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a with identifier: 1987117 to the API
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/874/5c54ffce525e4cc992639fe685853bd4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Rojo carm',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 137634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a/cb1dcc7d-4b3e-5bb0-9e11-302a68b9052a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/874/5c54ffce525e4cc992639fe685853bd4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Life Edition One 1.5 Blue dCi 55kW(75CV)',
 'transmission': 'manual',
 'trim': 'Life Edition One 1.5 Blue dCi 55kW(75CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987117%27 HTTP/1.1" 200 None
2026-03-27 13:35:36 [ayvens.es] INFO: Saving data for 1987117: {'created_time': 1774618536.07724, 'last_price_update_time': 1774618536.07725, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987117') HTTP/1.1" 204 0
2026-03-27 13:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e548b3a-9550-5e2c-9246-faebb13a2c20 with identifier: 1987116
2026-03-27 13:35:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e548b3a-9550-5e2c-9246-faebb13a2c20 with identifier: 1987116
2026-03-27 13:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0e548b3a-9550-5e2c-9246-faebb13a2c20 with identifier: 1987116 to the API
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/626/ca37aa92e2db41aaaaf184743161b5a5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Nanuq white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '0e548b3a-9550-5e2c-9246-faebb13a2c20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 52184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e548b3a-9550-5e2c-9246-faebb13a2c20/0e548b3a-9550-5e2c-9246-faebb13a2c20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/626/ca37aa92e2db41aaaaf184743161b5a5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2023}
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987116%27 HTTP/1.1" 200 None
2026-03-27 13:35:36 [ayvens.es] INFO: Saving data for 1987116: {'created_time': 1774618536.480565, 'last_price_update_time': 1774618536.480576, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987116') HTTP/1.1" 204 0
2026-03-27 13:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/15305bfe67ec4123b9af8a4a9382a630/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:36 [ayvens.es] INFO: Found listing with ID: 1987125
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987125%27 HTTP/1.1" 200 None
2026-03-27 13:35:36 [ayvens.es] INFO: Scrape type for 1987125: 1
2026-03-27 13:35:36 [ayvens.es] INFO: Extracting data for car ID: 1987125
2026-03-27 13:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09ba5402-79b4-57dd-be20-bf007d6a83d8 with identifier: 1987125
2026-03-27 13:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ba5402-79b4-57dd-be20-bf007d6a83d8 with scrape type 1
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09ba5402-79b4-57dd-be20-bf007d6a83d8
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F396%252F354b50926df642e79f2f672e02f737e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/396/354b50926df642e79f2f672e02f737e3/images/large/1.jpg not downloaded yet
2026-03-27 13:35:36 [ayvens.es] INFO: Found listing with ID: 1987126
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987126%27 HTTP/1.1" 200 None
2026-03-27 13:35:36 [ayvens.es] INFO: Scrape type for 1987126: 1
2026-03-27 13:35:36 [ayvens.es] INFO: Extracting data for car ID: 1987126
2026-03-27 13:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d5df243-55d7-5726-90b4-ad88344bc889 with identifier: 1987126
2026-03-27 13:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d5df243-55d7-5726-90b4-ad88344bc889 with scrape type 1
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1d5df243-55d7-5726-90b4-ad88344bc889
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F683%252F997bb4c2b69d459fb9470d5a0793c6fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/683/997bb4c2b69d459fb9470d5a0793c6fc/images/large/1.jpg not downloaded yet
2026-03-27 13:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/119/98791acb61be4ac694236509b6090b53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ef4b50>
2026-03-27 13:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082f4a4-2378-53bf-808d-b41e3e077075/0082f4a4-2378-53bf-808d-b41e3e077075_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F179%252Fe9d3f8fb63f2418b929fa8b43cf98cef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/179/e9d3f8fb63f2418b929fa8b43cf98cef/images/large/1.jpg saved to cache
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0082f4a4-2378-53bf-808d-b41e3e077075
2026-03-27 13:35:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0082f4a4-2378-53bf-808d-b41e3e077075, skipping ID generation
2026-03-27 13:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0082f4a4-2378-53bf-808d-b41e3e077075 with scrape type 1
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0082f4a4-2378-53bf-808d-b41e3e077075 sending to next pipeline
2026-03-27 13:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0082f4a4-2378-53bf-808d-b41e3e077075, identifier: 1987119
2026-03-27 13:35:36 [ayvens.es] INFO: Found listing with ID: 1987127
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987127%27 HTTP/1.1" 200 None
2026-03-27 13:35:36 [ayvens.es] INFO: Scrape type for 1987127: 1
2026-03-27 13:35:36 [ayvens.es] INFO: Extracting data for car ID: 1987127
2026-03-27 13:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa234f1a-b35f-526f-b011-4069016f901e with identifier: 1987127
2026-03-27 13:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa234f1a-b35f-526f-b011-4069016f901e with scrape type 1
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aa234f1a-b35f-526f-b011-4069016f901e
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252F82e1e752864d4cf6b68be3423e2307d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/82e1e752864d4cf6b68be3423e2307d6/images/large/1.jpg not downloaded yet
2026-03-27 13:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0082f4a4-2378-53bf-808d-b41e3e077075 with identifier: 1987119
2026-03-27 13:35:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0082f4a4-2378-53bf-808d-b41e3e077075 with identifier: 1987119
2026-03-27 13:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0082f4a4-2378-53bf-808d-b41e3e077075 with identifier: 1987119 to the API
2026-03-27 13:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/179/e9d3f8fb63f2418b929fa8b43cf98cef/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0082f4a4-2378-53bf-808d-b41e3e077075',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 97479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082f4a4-2378-53bf-808d-b41e3e077075/0082f4a4-2378-53bf-808d-b41e3e077075_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/179/e9d3f8fb63f2418b929fa8b43cf98cef/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx DCT 4x4',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987119%27 HTTP/1.1" 200 None
2026-03-27 13:35:37 [ayvens.es] INFO: Saving data for 1987119: {'created_time': 1774618537.216151, 'last_price_update_time': 1774618537.216161, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987119') HTTP/1.1" 204 0
2026-03-27 13:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/204/57a2c30b10b74401a9c2fa77b2210dfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:37 [ayvens.es] INFO: Found listing with ID: 1987128
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987128%27 HTTP/1.1" 200 None
2026-03-27 13:35:37 [ayvens.es] INFO: Scrape type for 1987128: 1
2026-03-27 13:35:37 [ayvens.es] INFO: Extracting data for car ID: 1987128
2026-03-27 13:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd3131c-797b-5b5a-9cd1-d83f752e69e0 with identifier: 1987128
2026-03-27 13:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd3131c-797b-5b5a-9cd1-d83f752e69e0 with scrape type 1
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7fd3131c-797b-5b5a-9cd1-d83f752e69e0
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F600%252Fa022cebf2612479085d727ecde58ed6c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/600/a022cebf2612479085d727ecde58ed6c/images/large/1.jpg not downloaded yet
2026-03-27 13:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956cacd0>
2026-03-27 13:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a3876f3-c68c-536d-9ce7-d7955e95e37e/0a3876f3-c68c-536d-9ce7-d7955e95e37e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F15305bfe67ec4123b9af8a4a9382a630%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/15305bfe67ec4123b9af8a4a9382a630/images/large/1.jpg saved to cache
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a3876f3-c68c-536d-9ce7-d7955e95e37e
2026-03-27 13:35:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a3876f3-c68c-536d-9ce7-d7955e95e37e, skipping ID generation
2026-03-27 13:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a3876f3-c68c-536d-9ce7-d7955e95e37e with scrape type 1
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a3876f3-c68c-536d-9ce7-d7955e95e37e sending to next pipeline
2026-03-27 13:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0a3876f3-c68c-536d-9ce7-d7955e95e37e, identifier: 1987118
2026-03-27 13:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295716490>
2026-03-27 13:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a065db2f-9dc4-5f75-bd22-dd820cf98386/a065db2f-9dc4-5f75-bd22-dd820cf98386_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F119%252F98791acb61be4ac694236509b6090b53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/119/98791acb61be4ac694236509b6090b53/images/large/1.jpg saved to cache
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a065db2f-9dc4-5f75-bd22-dd820cf98386
2026-03-27 13:35:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a065db2f-9dc4-5f75-bd22-dd820cf98386, skipping ID generation
2026-03-27 13:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a065db2f-9dc4-5f75-bd22-dd820cf98386 with scrape type 1
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a065db2f-9dc4-5f75-bd22-dd820cf98386 sending to next pipeline
2026-03-27 13:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a065db2f-9dc4-5f75-bd22-dd820cf98386, identifier: 1987121
2026-03-27 13:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/135/4b2e7f223ff14e5d938dd2d33237e7bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:37 [ayvens.es] INFO: Found listing with ID: 1987129
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987129%27 HTTP/1.1" 200 None
2026-03-27 13:35:37 [ayvens.es] INFO: Scrape type for 1987129: 1
2026-03-27 13:35:37 [ayvens.es] INFO: Extracting data for car ID: 1987129
2026-03-27 13:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dbbb78a-a724-5df9-ac72-63e7fded1444 with identifier: 1987129
2026-03-27 13:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dbbb78a-a724-5df9-ac72-63e7fded1444 with scrape type 1
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9dbbb78a-a724-5df9-ac72-63e7fded1444
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Fedafdde90cdb4987b84d8e81b2508d2b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/edafdde90cdb4987b84d8e81b2508d2b/images/large/1.jpg not downloaded yet
2026-03-27 13:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0a3876f3-c68c-536d-9ce7-d7955e95e37e with identifier: 1987118
2026-03-27 13:35:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0a3876f3-c68c-536d-9ce7-d7955e95e37e with identifier: 1987118
2026-03-27 13:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0a3876f3-c68c-536d-9ce7-d7955e95e37e with identifier: 1987118 to the API
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/15305bfe67ec4123b9af8a4a9382a630/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Cristal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a3876f3-c68c-536d-9ce7-d7955e95e37e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 79507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3876f3-c68c-536d-9ce7-d7955e95e37e/0a3876f3-c68c-536d-9ce7-d7955e95e37e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/15305bfe67ec4123b9af8a4a9382a630/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT. PERF.LINE',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT. PERF.LINE',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987118%27 HTTP/1.1" 200 None
2026-03-27 13:35:38 [ayvens.es] INFO: Saving data for 1987118: {'created_time': 1774618538.108623, 'last_price_update_time': 1774618538.108633, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987118') HTTP/1.1" 204 0
2026-03-27 13:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a065db2f-9dc4-5f75-bd22-dd820cf98386 with identifier: 1987121
2026-03-27 13:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a065db2f-9dc4-5f75-bd22-dd820cf98386 with identifier: 1987121
2026-03-27 13:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a065db2f-9dc4-5f75-bd22-dd820cf98386 with identifier: 1987121 to the API
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/119/98791acb61be4ac694236509b6090b53/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a065db2f-9dc4-5f75-bd22-dd820cf98386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 38699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a065db2f-9dc4-5f75-bd22-dd820cf98386/a065db2f-9dc4-5f75-bd22-dd820cf98386_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/119/98791acb61be4ac694236509b6090b53/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) M Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) M Std Express',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987121%27 HTTP/1.1" 200 None
2026-03-27 13:35:38 [ayvens.es] INFO: Saving data for 1987121: {'created_time': 1774618538.491263, 'last_price_update_time': 1774618538.491273, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987121') HTTP/1.1" 204 0
2026-03-27 13:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/081/cd75c37022f44a20b7a54d48c4ef3ad6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:38 [ayvens.es] INFO: Found listing with ID: 1987130
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987130%27 HTTP/1.1" 200 None
2026-03-27 13:35:38 [ayvens.es] INFO: Scrape type for 1987130: 1
2026-03-27 13:35:38 [ayvens.es] INFO: Extracting data for car ID: 1987130
2026-03-27 13:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8103150-c40e-5ad5-80a3-347a9d22644f with identifier: 1987130
2026-03-27 13:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8103150-c40e-5ad5-80a3-347a9d22644f with scrape type 1
2026-03-27 13:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e8103150-c40e-5ad5-80a3-347a9d22644f
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252F2d3a9430f9e541a49d84559f07c50c08%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/2d3a9430f9e541a49d84559f07c50c08/images/large/1.jpg not downloaded yet
2026-03-27 13:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/396/354b50926df642e79f2f672e02f737e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296202a50>
2026-03-27 13:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2d370d8-5f36-532a-a9da-4f6fd6f948ea/d2d370d8-5f36-532a-a9da-4f6fd6f948ea_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F204%252F57a2c30b10b74401a9c2fa77b2210dfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/204/57a2c30b10b74401a9c2fa77b2210dfe/images/large/1.jpg saved to cache
2026-03-27 13:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2d370d8-5f36-532a-a9da-4f6fd6f948ea
2026-03-27 13:35:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2d370d8-5f36-532a-a9da-4f6fd6f948ea, skipping ID generation
2026-03-27 13:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2d370d8-5f36-532a-a9da-4f6fd6f948ea with scrape type 1
2026-03-27 13:35:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2d370d8-5f36-532a-a9da-4f6fd6f948ea sending to next pipeline
2026-03-27 13:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d2d370d8-5f36-532a-a9da-4f6fd6f948ea, identifier: 1987120
2026-03-27 13:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529577d790>
2026-03-27 13:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2f53ff5-2dcf-5b44-b912-331d18d58431/b2f53ff5-2dcf-5b44-b912-331d18d58431_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F4b2e7f223ff14e5d938dd2d33237e7bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/4b2e7f223ff14e5d938dd2d33237e7bf/images/large/1.jpg saved to cache
2026-03-27 13:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2f53ff5-2dcf-5b44-b912-331d18d58431
2026-03-27 13:35:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2f53ff5-2dcf-5b44-b912-331d18d58431, skipping ID generation
2026-03-27 13:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2f53ff5-2dcf-5b44-b912-331d18d58431 with scrape type 1
2026-03-27 13:35:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2f53ff5-2dcf-5b44-b912-331d18d58431 sending to next pipeline
2026-03-27 13:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2f53ff5-2dcf-5b44-b912-331d18d58431, identifier: 1987122
2026-03-27 13:35:39 [ayvens.es] INFO: Found listing with ID: 1987131
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987131%27 HTTP/1.1" 200 None
2026-03-27 13:35:39 [ayvens.es] INFO: Scrape type for 1987131: 1
2026-03-27 13:35:39 [ayvens.es] INFO: Extracting data for car ID: 1987131
2026-03-27 13:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcb031d8-fb69-57e2-94ab-570714f301e7 with identifier: 1987131
2026-03-27 13:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb031d8-fb69-57e2-94ab-570714f301e7 with scrape type 1
2026-03-27 13:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fcb031d8-fb69-57e2-94ab-570714f301e7
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F513%252F285df7215cd64cda9ffbfe2883fc842d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/513/285df7215cd64cda9ffbfe2883fc842d/images/large/1.jpg not downloaded yet
2026-03-27 13:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d2d370d8-5f36-532a-a9da-4f6fd6f948ea with identifier: 1987120
2026-03-27 13:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d2d370d8-5f36-532a-a9da-4f6fd6f948ea with identifier: 1987120
2026-03-27 13:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d2d370d8-5f36-532a-a9da-4f6fd6f948ea with identifier: 1987120 to the API
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/204/57a2c30b10b74401a9c2fa77b2210dfe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd2d370d8-5f36-532a-a9da-4f6fd6f948ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 44849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2d370d8-5f36-532a-a9da-4f6fd6f948ea/d2d370d8-5f36-532a-a9da-4f6fd6f948ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/204/57a2c30b10b74401a9c2fa77b2210dfe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987120%27 HTTP/1.1" 200 None
2026-03-27 13:35:39 [ayvens.es] INFO: Saving data for 1987120: {'created_time': 1774618539.391035, 'last_price_update_time': 1774618539.391045, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987120') HTTP/1.1" 204 0
2026-03-27 13:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2f53ff5-2dcf-5b44-b912-331d18d58431 with identifier: 1987122
2026-03-27 13:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2f53ff5-2dcf-5b44-b912-331d18d58431 with identifier: 1987122
2026-03-27 13:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2f53ff5-2dcf-5b44-b912-331d18d58431 with identifier: 1987122 to the API
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/135/4b2e7f223ff14e5d938dd2d33237e7bf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2f53ff5-2dcf-5b44-b912-331d18d58431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 95114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2f53ff5-2dcf-5b44-b912-331d18d58431/b2f53ff5-2dcf-5b44-b912-331d18d58431_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/135/4b2e7f223ff14e5d938dd2d33237e7bf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.0 EcoBoost 75kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.0 EcoBoost 75kW Trend',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987122%27 HTTP/1.1" 200 None
2026-03-27 13:35:39 [ayvens.es] INFO: Saving data for 1987122: {'created_time': 1774618539.756854, 'last_price_update_time': 1774618539.756864, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987122') HTTP/1.1" 204 0
2026-03-27 13:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/890/1b847c8065004ca7a6e16c592094d9fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/683/997bb4c2b69d459fb9470d5a0793c6fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:39 [ayvens.es] INFO: Found listing with ID: 1987132
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987132%27 HTTP/1.1" 200 None
2026-03-27 13:35:39 [ayvens.es] INFO: Scrape type for 1987132: 1
2026-03-27 13:35:39 [ayvens.es] INFO: Extracting data for car ID: 1987132
2026-03-27 13:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eeadc58-b9a4-5727-bd17-1f5afb6c5024 with identifier: 1987132
2026-03-27 13:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eeadc58-b9a4-5727-bd17-1f5afb6c5024 with scrape type 1
2026-03-27 13:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4eeadc58-b9a4-5727-bd17-1f5afb6c5024
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F771%252Fe3fdb0e5579e4ebf96c92ac3fe0819c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/771/e3fdb0e5579e4ebf96c92ac3fe0819c8/images/large/1.jpg not downloaded yet
2026-03-27 13:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297943f10>
2026-03-27 13:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef44c2c-80ee-5db5-a526-80d003dcf2ca/aef44c2c-80ee-5db5-a526-80d003dcf2ca_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F081%252Fcd75c37022f44a20b7a54d48c4ef3ad6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/081/cd75c37022f44a20b7a54d48c4ef3ad6/images/large/1.jpg saved to cache
2026-03-27 13:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aef44c2c-80ee-5db5-a526-80d003dcf2ca
2026-03-27 13:35:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aef44c2c-80ee-5db5-a526-80d003dcf2ca, skipping ID generation
2026-03-27 13:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aef44c2c-80ee-5db5-a526-80d003dcf2ca with scrape type 1
2026-03-27 13:35:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aef44c2c-80ee-5db5-a526-80d003dcf2ca sending to next pipeline
2026-03-27 13:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aef44c2c-80ee-5db5-a526-80d003dcf2ca, identifier: 1987123
2026-03-27 13:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fb1950>
2026-03-27 13:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09ba5402-79b4-57dd-be20-bf007d6a83d8/09ba5402-79b4-57dd-be20-bf007d6a83d8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F396%252F354b50926df642e79f2f672e02f737e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/396/354b50926df642e79f2f672e02f737e3/images/large/1.jpg saved to cache
2026-03-27 13:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09ba5402-79b4-57dd-be20-bf007d6a83d8
2026-03-27 13:35:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09ba5402-79b4-57dd-be20-bf007d6a83d8, skipping ID generation
2026-03-27 13:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ba5402-79b4-57dd-be20-bf007d6a83d8 with scrape type 1
2026-03-27 13:35:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09ba5402-79b4-57dd-be20-bf007d6a83d8 sending to next pipeline
2026-03-27 13:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 09ba5402-79b4-57dd-be20-bf007d6a83d8, identifier: 1987125
2026-03-27 13:35:40 [ayvens.es] INFO: Found listing with ID: 1987133
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987133%27 HTTP/1.1" 200 None
2026-03-27 13:35:40 [ayvens.es] INFO: Scrape type for 1987133: 1
2026-03-27 13:35:40 [ayvens.es] INFO: Extracting data for car ID: 1987133
2026-03-27 13:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a16780b1-92f8-5135-8d91-7eaff408d51f with identifier: 1987133
2026-03-27 13:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16780b1-92f8-5135-8d91-7eaff408d51f with scrape type 1
2026-03-27 13:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a16780b1-92f8-5135-8d91-7eaff408d51f
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252F7b433fdaa61e41559c799babcaa989aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/7b433fdaa61e41559c799babcaa989aa/images/large/1.jpg not downloaded yet
2026-03-27 13:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aef44c2c-80ee-5db5-a526-80d003dcf2ca with identifier: 1987123
2026-03-27 13:35:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aef44c2c-80ee-5db5-a526-80d003dcf2ca with identifier: 1987123
2026-03-27 13:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aef44c2c-80ee-5db5-a526-80d003dcf2ca with identifier: 1987123 to the API
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/081/cd75c37022f44a20b7a54d48c4ef3ad6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Dark night',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'electric',
 'id': 'aef44c2c-80ee-5db5-a526-80d003dcf2ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 56857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef44c2c-80ee-5db5-a526-80d003dcf2ca/aef44c2c-80ee-5db5-a526-80d003dcf2ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/081/cd75c37022f44a20b7a54d48c4ef3ad6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 150kW EV Maxx',
 'transmission': 'manual',
 'trim': '150kW EV Maxx',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987123%27 HTTP/1.1" 200 None
2026-03-27 13:35:40 [ayvens.es] INFO: Saving data for 1987123: {'created_time': 1774618540.608233, 'last_price_update_time': 1774618540.608243, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987123') HTTP/1.1" 204 0
2026-03-27 13:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 09ba5402-79b4-57dd-be20-bf007d6a83d8 with identifier: 1987125
2026-03-27 13:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 09ba5402-79b4-57dd-be20-bf007d6a83d8 with identifier: 1987125
2026-03-27 13:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 09ba5402-79b4-57dd-be20-bf007d6a83d8 with identifier: 1987125 to the API
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/396/354b50926df642e79f2f672e02f737e3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '09ba5402-79b4-57dd-be20-bf007d6a83d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 180074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09ba5402-79b4-57dd-be20-bf007d6a83d8/09ba5402-79b4-57dd-be20-bf007d6a83d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/396/354b50926df642e79f2f672e02f737e3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE (O) Intens Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': '(O) Intens Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987125%27 HTTP/1.1" 200 None
2026-03-27 13:35:40 [ayvens.es] INFO: Saving data for 1987125: {'created_time': 1774618540.992435, 'last_price_update_time': 1774618540.992446, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987125') HTTP/1.1" 204 0
2026-03-27 13:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/533/82e1e752864d4cf6b68be3423e2307d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/600/a022cebf2612479085d727ecde58ed6c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:41 [ayvens.es] INFO: Found listing with ID: 1987134
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987134%27 HTTP/1.1" 200 None
2026-03-27 13:35:41 [ayvens.es] INFO: Scrape type for 1987134: 1
2026-03-27 13:35:41 [ayvens.es] INFO: Extracting data for car ID: 1987134
2026-03-27 13:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3 with identifier: 1987134
2026-03-27 13:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3 with scrape type 1
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F432%252F48144f6e28804ccb995eabf0ea29098c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/432/48144f6e28804ccb995eabf0ea29098c/images/large/1.jpg not downloaded yet
2026-03-27 13:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c09d0>
2026-03-27 13:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fffbc78-9a6e-5657-a287-e38944fc05b0/6fffbc78-9a6e-5657-a287-e38944fc05b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F890%252F1b847c8065004ca7a6e16c592094d9fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/890/1b847c8065004ca7a6e16c592094d9fd/images/large/1.jpg saved to cache
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fffbc78-9a6e-5657-a287-e38944fc05b0
2026-03-27 13:35:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fffbc78-9a6e-5657-a287-e38944fc05b0, skipping ID generation
2026-03-27 13:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fffbc78-9a6e-5657-a287-e38944fc05b0 with scrape type 1
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fffbc78-9a6e-5657-a287-e38944fc05b0 sending to next pipeline
2026-03-27 13:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6fffbc78-9a6e-5657-a287-e38944fc05b0, identifier: 1987124
2026-03-27 13:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c2cd0>
2026-03-27 13:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d5df243-55d7-5726-90b4-ad88344bc889/1d5df243-55d7-5726-90b4-ad88344bc889_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F683%252F997bb4c2b69d459fb9470d5a0793c6fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/683/997bb4c2b69d459fb9470d5a0793c6fc/images/large/1.jpg saved to cache
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d5df243-55d7-5726-90b4-ad88344bc889
2026-03-27 13:35:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d5df243-55d7-5726-90b4-ad88344bc889, skipping ID generation
2026-03-27 13:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d5df243-55d7-5726-90b4-ad88344bc889 with scrape type 1
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d5df243-55d7-5726-90b4-ad88344bc889 sending to next pipeline
2026-03-27 13:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1d5df243-55d7-5726-90b4-ad88344bc889, identifier: 1987126
2026-03-27 13:35:41 [ayvens.es] INFO: Found listing with ID: 1987135
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987135%27 HTTP/1.1" 200 None
2026-03-27 13:35:41 [ayvens.es] INFO: Scrape type for 1987135: 1
2026-03-27 13:35:41 [ayvens.es] INFO: Extracting data for car ID: 1987135
2026-03-27 13:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76916b02-0376-5757-a798-4bf948511eb9 with identifier: 1987135
2026-03-27 13:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76916b02-0376-5757-a798-4bf948511eb9 with scrape type 1
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 76916b02-0376-5757-a798-4bf948511eb9
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F799%252Fa6a17a4942524cd6be26c38a7e0d0010%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/799/a6a17a4942524cd6be26c38a7e0d0010/images/large/1.jpg not downloaded yet
2026-03-27 13:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6fffbc78-9a6e-5657-a287-e38944fc05b0 with identifier: 1987124
2026-03-27 13:35:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6fffbc78-9a6e-5657-a287-e38944fc05b0 with identifier: 1987124
2026-03-27 13:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6fffbc78-9a6e-5657-a287-e38944fc05b0 with identifier: 1987124 to the API
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/890/1b847c8065004ca7a6e16c592094d9fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'White cream',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6fffbc78-9a6e-5657-a287-e38944fc05b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'SANTA FE',
 'odometer': 71204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fffbc78-9a6e-5657-a287-e38944fc05b0/6fffbc78-9a6e-5657-a287-e38944fc05b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/890/1b847c8065004ca7a6e16c592094d9fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'HYUNDAI SANTA FE 1.6 TGDi HEV Klass Auto 4x2',
 'transmission': 'manual',
 'trim': '1.6 TGDi HEV Klass Auto 4x2',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987124%27 HTTP/1.1" 200 None
2026-03-27 13:35:41 [ayvens.es] INFO: Saving data for 1987124: {'created_time': 1774618541.766918, 'last_price_update_time': 1774618541.766929, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987124') HTTP/1.1" 204 0
2026-03-27 13:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1d5df243-55d7-5726-90b4-ad88344bc889 with identifier: 1987126
2026-03-27 13:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1d5df243-55d7-5726-90b4-ad88344bc889 with identifier: 1987126
2026-03-27 13:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1d5df243-55d7-5726-90b4-ad88344bc889 with identifier: 1987126 to the API
2026-03-27 13:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/683/997bb4c2b69d459fb9470d5a0793c6fc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '1d5df243-55d7-5726-90b4-ad88344bc889',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 106286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d5df243-55d7-5726-90b4-ad88344bc889/1d5df243-55d7-5726-90b4-ad88344bc889_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/683/997bb4c2b69d459fb9470d5a0793c6fc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987126%27 HTTP/1.1" 200 None
2026-03-27 13:35:42 [ayvens.es] INFO: Saving data for 1987126: {'created_time': 1774618542.209859, 'last_price_update_time': 1774618542.209869, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987126') HTTP/1.1" 204 0
2026-03-27 13:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/edafdde90cdb4987b84d8e81b2508d2b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/026/2d3a9430f9e541a49d84559f07c50c08/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:42 [ayvens.es] INFO: Found listing with ID: 1987136
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987136%27 HTTP/1.1" 200 None
2026-03-27 13:35:42 [ayvens.es] INFO: Scrape type for 1987136: 1
2026-03-27 13:35:42 [ayvens.es] INFO: Extracting data for car ID: 1987136
2026-03-27 13:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 718e0be9-36c8-5c0e-bf9f-d3679fba11c9 with identifier: 1987136
2026-03-27 13:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 718e0be9-36c8-5c0e-bf9f-d3679fba11c9 with scrape type 1
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 718e0be9-36c8-5c0e-bf9f-d3679fba11c9
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F598%252Feaf542f5650e4feaad880392c284a8af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/598/eaf542f5650e4feaad880392c284a8af/images/large/1.jpg not downloaded yet
2026-03-27 13:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529610df10>
2026-03-27 13:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa234f1a-b35f-526f-b011-4069016f901e/aa234f1a-b35f-526f-b011-4069016f901e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F533%252F82e1e752864d4cf6b68be3423e2307d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/533/82e1e752864d4cf6b68be3423e2307d6/images/large/1.jpg saved to cache
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa234f1a-b35f-526f-b011-4069016f901e
2026-03-27 13:35:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa234f1a-b35f-526f-b011-4069016f901e, skipping ID generation
2026-03-27 13:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa234f1a-b35f-526f-b011-4069016f901e with scrape type 1
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa234f1a-b35f-526f-b011-4069016f901e sending to next pipeline
2026-03-27 13:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aa234f1a-b35f-526f-b011-4069016f901e, identifier: 1987127
2026-03-27 13:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957666d0>
2026-03-27 13:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd3131c-797b-5b5a-9cd1-d83f752e69e0/7fd3131c-797b-5b5a-9cd1-d83f752e69e0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F600%252Fa022cebf2612479085d727ecde58ed6c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/600/a022cebf2612479085d727ecde58ed6c/images/large/1.jpg saved to cache
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fd3131c-797b-5b5a-9cd1-d83f752e69e0
2026-03-27 13:35:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fd3131c-797b-5b5a-9cd1-d83f752e69e0, skipping ID generation
2026-03-27 13:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd3131c-797b-5b5a-9cd1-d83f752e69e0 with scrape type 1
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fd3131c-797b-5b5a-9cd1-d83f752e69e0 sending to next pipeline
2026-03-27 13:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7fd3131c-797b-5b5a-9cd1-d83f752e69e0, identifier: 1987128
2026-03-27 13:35:42 [ayvens.es] INFO: Found listing with ID: 1987137
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987137%27 HTTP/1.1" 200 None
2026-03-27 13:35:42 [ayvens.es] INFO: Scrape type for 1987137: 1
2026-03-27 13:35:42 [ayvens.es] INFO: Extracting data for car ID: 1987137
2026-03-27 13:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2cb3ee9-7791-582d-b655-6b683128d48d with identifier: 1987137
2026-03-27 13:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2cb3ee9-7791-582d-b655-6b683128d48d with scrape type 1
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2cb3ee9-7791-582d-b655-6b683128d48d
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F7a8df905bbfd494d875ef77559539a7f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/7a8df905bbfd494d875ef77559539a7f/images/large/1.jpg not downloaded yet
2026-03-27 13:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aa234f1a-b35f-526f-b011-4069016f901e with identifier: 1987127
2026-03-27 13:35:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aa234f1a-b35f-526f-b011-4069016f901e with identifier: 1987127
2026-03-27 13:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aa234f1a-b35f-526f-b011-4069016f901e with identifier: 1987127 to the API
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/533/82e1e752864d4cf6b68be3423e2307d6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Negro noche',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'aa234f1a-b35f-526f-b011-4069016f901e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 130189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa234f1a-b35f-526f-b011-4069016f901e/aa234f1a-b35f-526f-b011-4069016f901e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/533/82e1e752864d4cf6b68be3423e2307d6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 200',
 'transmission': 'manual',
 'trim': 'CLA 200',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987127%27 HTTP/1.1" 200 None
2026-03-27 13:35:43 [ayvens.es] INFO: Saving data for 1987127: {'created_time': 1774618543.001274, 'last_price_update_time': 1774618543.001284, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987127') HTTP/1.1" 204 0
2026-03-27 13:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7fd3131c-797b-5b5a-9cd1-d83f752e69e0 with identifier: 1987128
2026-03-27 13:35:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7fd3131c-797b-5b5a-9cd1-d83f752e69e0 with identifier: 1987128
2026-03-27 13:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7fd3131c-797b-5b5a-9cd1-d83f752e69e0 with identifier: 1987128 to the API
2026-03-27 13:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/600/a022cebf2612479085d727ecde58ed6c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Azul navarra',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'electric',
 'id': '7fd3131c-797b-5b5a-9cd1-d83f752e69e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4',
 'odometer': 81050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd3131c-797b-5b5a-9cd1-d83f752e69e0/7fd3131c-797b-5b5a-9cd1-d83f752e69e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/600/a022cebf2612479085d727ecde58ed6c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 Advanced 40 e-tron 150kW 82kWh',
 'transmission': 'manual',
 'trim': 'Advanced 40 e-tron 150kW 82kWh',
 'vin': None,
 'year': 2023}
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987128%27 HTTP/1.1" 200 None
2026-03-27 13:35:44 [ayvens.es] INFO: Saving data for 1987128: {'created_time': 1774618544.273708, 'last_price_update_time': 1774618544.273718, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987128') HTTP/1.1" 204 0
2026-03-27 13:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/771/e3fdb0e5579e4ebf96c92ac3fe0819c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:44 [ayvens.es] INFO: Found listing with ID: 1987138
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987138%27 HTTP/1.1" 200 None
2026-03-27 13:35:44 [ayvens.es] INFO: Scrape type for 1987138: 1
2026-03-27 13:35:44 [ayvens.es] INFO: Extracting data for car ID: 1987138
2026-03-27 13:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 594bd271-fbd6-5c64-b00e-c5d73b6ee034 with identifier: 1987138
2026-03-27 13:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 594bd271-fbd6-5c64-b00e-c5d73b6ee034 with scrape type 1
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 594bd271-fbd6-5c64-b00e-c5d73b6ee034
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252F60fed9eca24e430586c31e450812f3e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/60fed9eca24e430586c31e450812f3e0/images/large/1.jpg not downloaded yet
2026-03-27 13:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296232e50>
2026-03-27 13:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dbbb78a-a724-5df9-ac72-63e7fded1444/9dbbb78a-a724-5df9-ac72-63e7fded1444_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Fedafdde90cdb4987b84d8e81b2508d2b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/edafdde90cdb4987b84d8e81b2508d2b/images/large/1.jpg saved to cache
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dbbb78a-a724-5df9-ac72-63e7fded1444
2026-03-27 13:35:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dbbb78a-a724-5df9-ac72-63e7fded1444, skipping ID generation
2026-03-27 13:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dbbb78a-a724-5df9-ac72-63e7fded1444 with scrape type 1
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dbbb78a-a724-5df9-ac72-63e7fded1444 sending to next pipeline
2026-03-27 13:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9dbbb78a-a724-5df9-ac72-63e7fded1444, identifier: 1987129
2026-03-27 13:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529671b1d0>
2026-03-27 13:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8103150-c40e-5ad5-80a3-347a9d22644f/e8103150-c40e-5ad5-80a3-347a9d22644f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252F2d3a9430f9e541a49d84559f07c50c08%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/2d3a9430f9e541a49d84559f07c50c08/images/large/1.jpg saved to cache
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8103150-c40e-5ad5-80a3-347a9d22644f
2026-03-27 13:35:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8103150-c40e-5ad5-80a3-347a9d22644f, skipping ID generation
2026-03-27 13:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8103150-c40e-5ad5-80a3-347a9d22644f with scrape type 1
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8103150-c40e-5ad5-80a3-347a9d22644f sending to next pipeline
2026-03-27 13:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e8103150-c40e-5ad5-80a3-347a9d22644f, identifier: 1987130
2026-03-27 13:35:44 [ayvens.es] INFO: Found listing with ID: 1987139
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987139%27 HTTP/1.1" 200 None
2026-03-27 13:35:44 [ayvens.es] INFO: Scrape type for 1987139: 1
2026-03-27 13:35:44 [ayvens.es] INFO: Extracting data for car ID: 1987139
2026-03-27 13:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e9a939-740d-533c-9cf3-20b988bc47cc with identifier: 1987139
2026-03-27 13:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e9a939-740d-533c-9cf3-20b988bc47cc with scrape type 1
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33e9a939-740d-533c-9cf3-20b988bc47cc
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F9cab355db6034b23953a8e25d76f6193%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/9cab355db6034b23953a8e25d76f6193/images/large/1.jpg not downloaded yet
2026-03-27 13:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9dbbb78a-a724-5df9-ac72-63e7fded1444 with identifier: 1987129
2026-03-27 13:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9dbbb78a-a724-5df9-ac72-63e7fded1444 with identifier: 1987129
2026-03-27 13:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9dbbb78a-a724-5df9-ac72-63e7fded1444 with identifier: 1987129 to the API
2026-03-27 13:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/edafdde90cdb4987b84d8e81b2508d2b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9dbbb78a-a724-5df9-ac72-63e7fded1444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 101407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dbbb78a-a724-5df9-ac72-63e7fded1444/9dbbb78a-a724-5df9-ac72-63e7fded1444_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/edafdde90cdb4987b84d8e81b2508d2b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987129%27 HTTP/1.1" 200 None
2026-03-27 13:35:45 [ayvens.es] INFO: Saving data for 1987129: {'created_time': 1774618545.145383, 'last_price_update_time': 1774618545.145394, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987129') HTTP/1.1" 204 0
2026-03-27 13:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e8103150-c40e-5ad5-80a3-347a9d22644f with identifier: 1987130
2026-03-27 13:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e8103150-c40e-5ad5-80a3-347a9d22644f with identifier: 1987130
2026-03-27 13:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e8103150-c40e-5ad5-80a3-347a9d22644f with identifier: 1987130 to the API
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/026/2d3a9430f9e541a49d84559f07c50c08/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e8103150-c40e-5ad5-80a3-347a9d22644f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 159172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8103150-c40e-5ad5-80a3-347a9d22644f/e8103150-c40e-5ad5-80a3-347a9d22644f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/026/2d3a9430f9e541a49d84559f07c50c08/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987130%27 HTTP/1.1" 200 None
2026-03-27 13:35:45 [ayvens.es] INFO: Saving data for 1987130: {'created_time': 1774618545.515461, 'last_price_update_time': 1774618545.51547, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987130') HTTP/1.1" 204 0
2026-03-27 13:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/513/285df7215cd64cda9ffbfe2883fc842d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/259/7b433fdaa61e41559c799babcaa989aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/432/48144f6e28804ccb995eabf0ea29098c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:45 [ayvens.es] INFO: Found listing with ID: 1987140
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987140%27 HTTP/1.1" 200 None
2026-03-27 13:35:45 [ayvens.es] INFO: Scrape type for 1987140: 1
2026-03-27 13:35:45 [ayvens.es] INFO: Extracting data for car ID: 1987140
2026-03-27 13:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 905d83b6-745c-587b-9f20-5e9cc35ee40f with identifier: 1987140
2026-03-27 13:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 905d83b6-745c-587b-9f20-5e9cc35ee40f with scrape type 1
2026-03-27 13:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 905d83b6-745c-587b-9f20-5e9cc35ee40f
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F333%252Fd1634f477ff343f9bd7206a1412319f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/333/d1634f477ff343f9bd7206a1412319f3/images/large/1.jpg not downloaded yet
2026-03-27 13:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962cbc90>
2026-03-27 13:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eeadc58-b9a4-5727-bd17-1f5afb6c5024/4eeadc58-b9a4-5727-bd17-1f5afb6c5024_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F771%252Fe3fdb0e5579e4ebf96c92ac3fe0819c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/771/e3fdb0e5579e4ebf96c92ac3fe0819c8/images/large/1.jpg saved to cache
2026-03-27 13:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4eeadc58-b9a4-5727-bd17-1f5afb6c5024
2026-03-27 13:35:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4eeadc58-b9a4-5727-bd17-1f5afb6c5024, skipping ID generation
2026-03-27 13:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eeadc58-b9a4-5727-bd17-1f5afb6c5024 with scrape type 1
2026-03-27 13:35:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4eeadc58-b9a4-5727-bd17-1f5afb6c5024 sending to next pipeline
2026-03-27 13:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4eeadc58-b9a4-5727-bd17-1f5afb6c5024, identifier: 1987132
2026-03-27 13:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4eeadc58-b9a4-5727-bd17-1f5afb6c5024 with identifier: 1987132
2026-03-27 13:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4eeadc58-b9a4-5727-bd17-1f5afb6c5024 with identifier: 1987132
2026-03-27 13:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4eeadc58-b9a4-5727-bd17-1f5afb6c5024 with identifier: 1987132 to the API
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/771/e3fdb0e5579e4ebf96c92ac3fe0819c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4eeadc58-b9a4-5727-bd17-1f5afb6c5024',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 150005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eeadc58-b9a4-5727-bd17-1f5afb6c5024/4eeadc58-b9a4-5727-bd17-1f5afb6c5024_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/771/e3fdb0e5579e4ebf96c92ac3fe0819c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW ST-Line HEV AT SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW ST-Line HEV AT SB',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987132%27 HTTP/1.1" 200 None
2026-03-27 13:35:46 [ayvens.es] INFO: Saving data for 1987132: {'created_time': 1774618546.103049, 'last_price_update_time': 1774618546.103058, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987132') HTTP/1.1" 204 0
2026-03-27 13:35:46 [ayvens.es] INFO: Found listing with ID: 1987141
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987141%27 HTTP/1.1" 200 None
2026-03-27 13:35:46 [ayvens.es] INFO: Scrape type for 1987141: 1
2026-03-27 13:35:46 [ayvens.es] INFO: Extracting data for car ID: 1987141
2026-03-27 13:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f261cfe-3b66-5ba5-b762-8667075a5a60 with identifier: 1987141
2026-03-27 13:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f261cfe-3b66-5ba5-b762-8667075a5a60 with scrape type 1
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8f261cfe-3b66-5ba5-b762-8667075a5a60
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252Faf57c3c07f204c009f6d977dbfbe9b4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/af57c3c07f204c009f6d977dbfbe9b4c/images/large/1.jpg not downloaded yet
2026-03-27 13:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/598/eaf542f5650e4feaad880392c284a8af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f18590>
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb031d8-fb69-57e2-94ab-570714f301e7/fcb031d8-fb69-57e2-94ab-570714f301e7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F513%252F285df7215cd64cda9ffbfe2883fc842d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/513/285df7215cd64cda9ffbfe2883fc842d/images/large/1.jpg saved to cache
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcb031d8-fb69-57e2-94ab-570714f301e7
2026-03-27 13:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcb031d8-fb69-57e2-94ab-570714f301e7, skipping ID generation
2026-03-27 13:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb031d8-fb69-57e2-94ab-570714f301e7 with scrape type 1
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcb031d8-fb69-57e2-94ab-570714f301e7 sending to next pipeline
2026-03-27 13:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fcb031d8-fb69-57e2-94ab-570714f301e7, identifier: 1987131
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bcecd0>
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16780b1-92f8-5135-8d91-7eaff408d51f/a16780b1-92f8-5135-8d91-7eaff408d51f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252F7b433fdaa61e41559c799babcaa989aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/7b433fdaa61e41559c799babcaa989aa/images/large/1.jpg saved to cache
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a16780b1-92f8-5135-8d91-7eaff408d51f
2026-03-27 13:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a16780b1-92f8-5135-8d91-7eaff408d51f, skipping ID generation
2026-03-27 13:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16780b1-92f8-5135-8d91-7eaff408d51f with scrape type 1
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a16780b1-92f8-5135-8d91-7eaff408d51f sending to next pipeline
2026-03-27 13:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a16780b1-92f8-5135-8d91-7eaff408d51f, identifier: 1987133
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632e9d0>
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3/7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F432%252F48144f6e28804ccb995eabf0ea29098c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/432/48144f6e28804ccb995eabf0ea29098c/images/large/1.jpg saved to cache
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3
2026-03-27 13:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3, skipping ID generation
2026-03-27 13:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3 with scrape type 1
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3 sending to next pipeline
2026-03-27 13:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3, identifier: 1987134
2026-03-27 13:35:46 [ayvens.es] INFO: Found listing with ID: 1987142
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987142%27 HTTP/1.1" 200 None
2026-03-27 13:35:46 [ayvens.es] INFO: Scrape type for 1987142: 1
2026-03-27 13:35:46 [ayvens.es] INFO: Extracting data for car ID: 1987142
2026-03-27 13:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b9962a2-59a5-548c-9c41-cb7f74935fc9 with identifier: 1987142
2026-03-27 13:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9962a2-59a5-548c-9c41-cb7f74935fc9 with scrape type 1
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2b9962a2-59a5-548c-9c41-cb7f74935fc9
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F136784b062504a3dba0bfd0db229ac76%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/136784b062504a3dba0bfd0db229ac76/images/large/1.jpg not downloaded yet
2026-03-27 13:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fcb031d8-fb69-57e2-94ab-570714f301e7 with identifier: 1987131
2026-03-27 13:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fcb031d8-fb69-57e2-94ab-570714f301e7 with identifier: 1987131
2026-03-27 13:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fcb031d8-fb69-57e2-94ab-570714f301e7 with identifier: 1987131 to the API
2026-03-27 13:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/513/285df7215cd64cda9ffbfe2883fc842d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fcb031d8-fb69-57e2-94ab-570714f301e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 135988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb031d8-fb69-57e2-94ab-570714f301e7/fcb031d8-fb69-57e2-94ab-570714f301e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/513/285df7215cd64cda9ffbfe2883fc842d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 73KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': 'BlueHDi 73KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987131%27 HTTP/1.1" 200 None
2026-03-27 13:35:47 [ayvens.es] INFO: Saving data for 1987131: {'created_time': 1774618547.257336, 'last_price_update_time': 1774618547.257347, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987131') HTTP/1.1" 204 0
2026-03-27 13:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a16780b1-92f8-5135-8d91-7eaff408d51f with identifier: 1987133
2026-03-27 13:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a16780b1-92f8-5135-8d91-7eaff408d51f with identifier: 1987133
2026-03-27 13:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a16780b1-92f8-5135-8d91-7eaff408d51f with identifier: 1987133 to the API
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/259/7b433fdaa61e41559c799babcaa989aa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a16780b1-92f8-5135-8d91-7eaff408d51f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 19099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16780b1-92f8-5135-8d91-7eaff408d51f/a16780b1-92f8-5135-8d91-7eaff408d51f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/259/7b433fdaa61e41559c799babcaa989aa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987133%27 HTTP/1.1" 200 None
2026-03-27 13:35:47 [ayvens.es] INFO: Saving data for 1987133: {'created_time': 1774618547.65193, 'last_price_update_time': 1774618547.651968, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987133') HTTP/1.1" 204 0
2026-03-27 13:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3 with identifier: 1987134
2026-03-27 13:35:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3 with identifier: 1987134
2026-03-27 13:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3 with identifier: 1987134 to the API
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/432/48144f6e28804ccb995eabf0ea29098c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'Negro cosmos',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 11682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3/7e1f29df-35f7-5ebd-8a9f-f74ff4f394e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/432/48144f6e28804ccb995eabf0ea29098c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 250 e Shooting Brake',
 'transmission': 'manual',
 'trim': 'CLA 250 e Shooting Brake',
 'vin': None,
 'year': 2023}
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987134%27 HTTP/1.1" 200 None
2026-03-27 13:35:48 [ayvens.es] INFO: Saving data for 1987134: {'created_time': 1774618548.058328, 'last_price_update_time': 1774618548.058347, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987134') HTTP/1.1" 204 0
2026-03-27 13:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/799/a6a17a4942524cd6be26c38a7e0d0010/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/002/60fed9eca24e430586c31e450812f3e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:48 [ayvens.es] INFO: Found listing with ID: 1987143
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987143%27 HTTP/1.1" 200 None
2026-03-27 13:35:48 [ayvens.es] INFO: Scrape type for 1987143: 1
2026-03-27 13:35:48 [ayvens.es] INFO: Extracting data for car ID: 1987143
2026-03-27 13:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d587de-5622-5e08-814a-a129a6723aec with identifier: 1987143
2026-03-27 13:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d587de-5622-5e08-814a-a129a6723aec with scrape type 1
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 54d587de-5622-5e08-814a-a129a6723aec
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F089%252F0658888ef4c34d038c0b672e9b13a4e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/089/0658888ef4c34d038c0b672e9b13a4e3/images/large/1.jpg not downloaded yet
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956cad10>
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_718e0be9-36c8-5c0e-bf9f-d3679fba11c9/718e0be9-36c8-5c0e-bf9f-d3679fba11c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F598%252Feaf542f5650e4feaad880392c284a8af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/598/eaf542f5650e4feaad880392c284a8af/images/large/1.jpg saved to cache
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 718e0be9-36c8-5c0e-bf9f-d3679fba11c9
2026-03-27 13:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 718e0be9-36c8-5c0e-bf9f-d3679fba11c9, skipping ID generation
2026-03-27 13:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 718e0be9-36c8-5c0e-bf9f-d3679fba11c9 with scrape type 1
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 718e0be9-36c8-5c0e-bf9f-d3679fba11c9 sending to next pipeline
2026-03-27 13:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 718e0be9-36c8-5c0e-bf9f-d3679fba11c9, identifier: 1987136
2026-03-27 13:35:48 [ayvens.es] INFO: Found listing with ID: 1987144
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987144%27 HTTP/1.1" 200 None
2026-03-27 13:35:48 [ayvens.es] INFO: Scrape type for 1987144: 1
2026-03-27 13:35:48 [ayvens.es] INFO: Extracting data for car ID: 1987144
2026-03-27 13:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90 with identifier: 1987144
2026-03-27 13:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90 with scrape type 1
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F769%252F1e27852ccda7453d82b0af5c288c237a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/769/1e27852ccda7453d82b0af5c288c237a/images/large/1.jpg not downloaded yet
2026-03-27 13:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 718e0be9-36c8-5c0e-bf9f-d3679fba11c9 with identifier: 1987136
2026-03-27 13:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 718e0be9-36c8-5c0e-bf9f-d3679fba11c9 with identifier: 1987136
2026-03-27 13:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 718e0be9-36c8-5c0e-bf9f-d3679fba11c9 with identifier: 1987136 to the API
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/598/eaf542f5650e4feaad880392c284a8af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '718e0be9-36c8-5c0e-bf9f-d3679fba11c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 121639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_718e0be9-36c8-5c0e-bf9f-d3679fba11c9/718e0be9-36c8-5c0e-bf9f-d3679fba11c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/598/eaf542f5650e4feaad880392c284a8af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Life Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987136%27 HTTP/1.1" 200 None
2026-03-27 13:35:48 [ayvens.es] INFO: Saving data for 1987136: {'created_time': 1774618548.692649, 'last_price_update_time': 1774618548.69266, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987136') HTTP/1.1" 204 0
2026-03-27 13:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/744/9cab355db6034b23953a8e25d76f6193/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/7a8df905bbfd494d875ef77559539a7f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:48 [ayvens.es] INFO: Found listing with ID: 1987145
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987145%27 HTTP/1.1" 200 None
2026-03-27 13:35:48 [ayvens.es] INFO: Scrape type for 1987145: 1
2026-03-27 13:35:48 [ayvens.es] INFO: Extracting data for car ID: 1987145
2026-03-27 13:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35e5dd10-12d6-53ee-8b96-833c992823fe with identifier: 1987145
2026-03-27 13:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35e5dd10-12d6-53ee-8b96-833c992823fe with scrape type 1
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35e5dd10-12d6-53ee-8b96-833c992823fe
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F311%252Fe8e2f4c1bf0b43f8b8db0bc3897b2570%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/311/e8e2f4c1bf0b43f8b8db0bc3897b2570/images/large/1.jpg not downloaded yet
2026-03-27 13:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/333/d1634f477ff343f9bd7206a1412319f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f0f750>
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76916b02-0376-5757-a798-4bf948511eb9/76916b02-0376-5757-a798-4bf948511eb9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F799%252Fa6a17a4942524cd6be26c38a7e0d0010%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/799/a6a17a4942524cd6be26c38a7e0d0010/images/large/1.jpg saved to cache
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76916b02-0376-5757-a798-4bf948511eb9
2026-03-27 13:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76916b02-0376-5757-a798-4bf948511eb9, skipping ID generation
2026-03-27 13:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76916b02-0376-5757-a798-4bf948511eb9 with scrape type 1
2026-03-27 13:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76916b02-0376-5757-a798-4bf948511eb9 sending to next pipeline
2026-03-27 13:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 76916b02-0376-5757-a798-4bf948511eb9, identifier: 1987135
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1b610>
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_594bd271-fbd6-5c64-b00e-c5d73b6ee034/594bd271-fbd6-5c64-b00e-c5d73b6ee034_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252F60fed9eca24e430586c31e450812f3e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/60fed9eca24e430586c31e450812f3e0/images/large/1.jpg saved to cache
2026-03-27 13:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 594bd271-fbd6-5c64-b00e-c5d73b6ee034
2026-03-27 13:35:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 594bd271-fbd6-5c64-b00e-c5d73b6ee034, skipping ID generation
2026-03-27 13:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 594bd271-fbd6-5c64-b00e-c5d73b6ee034 with scrape type 1
2026-03-27 13:35:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 594bd271-fbd6-5c64-b00e-c5d73b6ee034 sending to next pipeline
2026-03-27 13:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 594bd271-fbd6-5c64-b00e-c5d73b6ee034, identifier: 1987138
2026-03-27 13:35:49 [ayvens.es] INFO: Found listing with ID: 1987146
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987146%27 HTTP/1.1" 200 None
2026-03-27 13:35:49 [ayvens.es] INFO: Scrape type for 1987146: 1
2026-03-27 13:35:49 [ayvens.es] INFO: Extracting data for car ID: 1987146
2026-03-27 13:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f816da24-c060-5d86-8bc2-5acce49f123b with identifier: 1987146
2026-03-27 13:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f816da24-c060-5d86-8bc2-5acce49f123b with scrape type 1
2026-03-27 13:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f816da24-c060-5d86-8bc2-5acce49f123b
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252Fff3aba4dcc634499aeb5c87b85f04bdb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/ff3aba4dcc634499aeb5c87b85f04bdb/images/large/1.jpg not downloaded yet
2026-03-27 13:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 76916b02-0376-5757-a798-4bf948511eb9 with identifier: 1987135
2026-03-27 13:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 76916b02-0376-5757-a798-4bf948511eb9 with identifier: 1987135
2026-03-27 13:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 76916b02-0376-5757-a798-4bf948511eb9 with identifier: 1987135 to the API
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/799/a6a17a4942524cd6be26c38a7e0d0010/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '76916b02-0376-5757-a798-4bf948511eb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 52645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76916b02-0376-5757-a798-4bf948511eb9/76916b02-0376-5757-a798-4bf948511eb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/799/a6a17a4942524cd6be26c38a7e0d0010/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 220 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 220 d 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987135%27 HTTP/1.1" 200 None
2026-03-27 13:35:49 [ayvens.es] INFO: Saving data for 1987135: {'created_time': 1774618549.57289, 'last_price_update_time': 1774618549.572903, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987135') HTTP/1.1" 204 0
2026-03-27 13:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 594bd271-fbd6-5c64-b00e-c5d73b6ee034 with identifier: 1987138
2026-03-27 13:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 594bd271-fbd6-5c64-b00e-c5d73b6ee034 with identifier: 1987138
2026-03-27 13:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 594bd271-fbd6-5c64-b00e-c5d73b6ee034 with identifier: 1987138 to the API
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/002/60fed9eca24e430586c31e450812f3e0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '594bd271-fbd6-5c64-b00e-c5d73b6ee034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 102714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_594bd271-fbd6-5c64-b00e-c5d73b6ee034/594bd271-fbd6-5c64-b00e-c5d73b6ee034_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/002/60fed9eca24e430586c31e450812f3e0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987138%27 HTTP/1.1" 200 None
2026-03-27 13:35:50 [ayvens.es] INFO: Saving data for 1987138: {'created_time': 1774618550.001225, 'last_price_update_time': 1774618550.001236, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987138') HTTP/1.1" 204 0
2026-03-27 13:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/409/af57c3c07f204c009f6d977dbfbe9b4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:50 [ayvens.es] INFO: Found listing with ID: 1987147
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987147%27 HTTP/1.1" 200 None
2026-03-27 13:35:50 [ayvens.es] INFO: Scrape type for 1987147: 1
2026-03-27 13:35:50 [ayvens.es] INFO: Extracting data for car ID: 1987147
2026-03-27 13:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11797d9e-2731-5f67-8449-56cc27b4c210 with identifier: 1987147
2026-03-27 13:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11797d9e-2731-5f67-8449-56cc27b4c210 with scrape type 1
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 11797d9e-2731-5f67-8449-56cc27b4c210
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F886%252F0fdd83f381804b29b0e26bdbd5faa405%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/886/0fdd83f381804b29b0e26bdbd5faa405/images/large/1.jpg not downloaded yet
2026-03-27 13:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/849/136784b062504a3dba0bfd0db229ac76/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5298257350>
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e9a939-740d-533c-9cf3-20b988bc47cc/33e9a939-740d-533c-9cf3-20b988bc47cc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F9cab355db6034b23953a8e25d76f6193%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/9cab355db6034b23953a8e25d76f6193/images/large/1.jpg saved to cache
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33e9a939-740d-533c-9cf3-20b988bc47cc
2026-03-27 13:35:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33e9a939-740d-533c-9cf3-20b988bc47cc, skipping ID generation
2026-03-27 13:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e9a939-740d-533c-9cf3-20b988bc47cc with scrape type 1
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33e9a939-740d-533c-9cf3-20b988bc47cc sending to next pipeline
2026-03-27 13:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 33e9a939-740d-533c-9cf3-20b988bc47cc, identifier: 1987139
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295765710>
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2cb3ee9-7791-582d-b655-6b683128d48d/f2cb3ee9-7791-582d-b655-6b683128d48d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F7a8df905bbfd494d875ef77559539a7f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/7a8df905bbfd494d875ef77559539a7f/images/large/1.jpg saved to cache
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2cb3ee9-7791-582d-b655-6b683128d48d
2026-03-27 13:35:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2cb3ee9-7791-582d-b655-6b683128d48d, skipping ID generation
2026-03-27 13:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2cb3ee9-7791-582d-b655-6b683128d48d with scrape type 1
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2cb3ee9-7791-582d-b655-6b683128d48d sending to next pipeline
2026-03-27 13:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2cb3ee9-7791-582d-b655-6b683128d48d, identifier: 1987137
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c9090>
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905d83b6-745c-587b-9f20-5e9cc35ee40f/905d83b6-745c-587b-9f20-5e9cc35ee40f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F333%252Fd1634f477ff343f9bd7206a1412319f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/333/d1634f477ff343f9bd7206a1412319f3/images/large/1.jpg saved to cache
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 905d83b6-745c-587b-9f20-5e9cc35ee40f
2026-03-27 13:35:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 905d83b6-745c-587b-9f20-5e9cc35ee40f, skipping ID generation
2026-03-27 13:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 905d83b6-745c-587b-9f20-5e9cc35ee40f with scrape type 1
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 905d83b6-745c-587b-9f20-5e9cc35ee40f sending to next pipeline
2026-03-27 13:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 905d83b6-745c-587b-9f20-5e9cc35ee40f, identifier: 1987140
2026-03-27 13:35:50 [ayvens.es] INFO: Found listing with ID: 1987148
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987148%27 HTTP/1.1" 200 None
2026-03-27 13:35:50 [ayvens.es] INFO: Scrape type for 1987148: 1
2026-03-27 13:35:50 [ayvens.es] INFO: Extracting data for car ID: 1987148
2026-03-27 13:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c1236ae-54d7-5769-92c7-c6e2b52757ac with identifier: 1987148
2026-03-27 13:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c1236ae-54d7-5769-92c7-c6e2b52757ac with scrape type 1
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1c1236ae-54d7-5769-92c7-c6e2b52757ac
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F655%252F23a7a41ae07847fb9c3a2b0912f6f821%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/655/23a7a41ae07847fb9c3a2b0912f6f821/images/large/1.jpg not downloaded yet
2026-03-27 13:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 33e9a939-740d-533c-9cf3-20b988bc47cc with identifier: 1987139
2026-03-27 13:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 33e9a939-740d-533c-9cf3-20b988bc47cc with identifier: 1987139
2026-03-27 13:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 33e9a939-740d-533c-9cf3-20b988bc47cc with identifier: 1987139 to the API
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/744/9cab355db6034b23953a8e25d76f6193/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '33e9a939-740d-533c-9cf3-20b988bc47cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 42365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e9a939-740d-533c-9cf3-20b988bc47cc/33e9a939-740d-533c-9cf3-20b988bc47cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/744/9cab355db6034b23953a8e25d76f6193/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 125cv Titanium MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125cv Titanium MHEV',
 'vin': None,
 'year': 2023}
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987139%27 HTTP/1.1" 200 None
2026-03-27 13:35:51 [ayvens.es] INFO: Saving data for 1987139: {'created_time': 1774618551.084027, 'last_price_update_time': 1774618551.084038, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987139') HTTP/1.1" 204 0
2026-03-27 13:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2cb3ee9-7791-582d-b655-6b683128d48d with identifier: 1987137
2026-03-27 13:35:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2cb3ee9-7791-582d-b655-6b683128d48d with identifier: 1987137
2026-03-27 13:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2cb3ee9-7791-582d-b655-6b683128d48d with identifier: 1987137 to the API
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/7a8df905bbfd494d875ef77559539a7f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Azul el',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f2cb3ee9-7791-582d-b655-6b683128d48d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'LEXUS',
 'model': 'UX',
 'odometer': 5308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2cb3ee9-7791-582d-b655-6b683128d48d/f2cb3ee9-7791-582d-b655-6b683128d48d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/7a8df905bbfd494d875ef77559539a7f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LEXUS UX 2.0 250h F Sport 4WD',
 'transmission': 'manual',
 'trim': '2.0 250h F Sport 4WD',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987137%27 HTTP/1.1" 200 None
2026-03-27 13:35:51 [ayvens.es] INFO: Saving data for 1987137: {'created_time': 1774618551.486642, 'last_price_update_time': 1774618551.486654, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987137') HTTP/1.1" 204 0
2026-03-27 13:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 905d83b6-745c-587b-9f20-5e9cc35ee40f with identifier: 1987140
2026-03-27 13:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 905d83b6-745c-587b-9f20-5e9cc35ee40f with identifier: 1987140
2026-03-27 13:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 905d83b6-745c-587b-9f20-5e9cc35ee40f with identifier: 1987140 to the API
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/333/d1634f477ff343f9bd7206a1412319f3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '905d83b6-745c-587b-9f20-5e9cc35ee40f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 76886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_905d83b6-745c-587b-9f20-5e9cc35ee40f/905d83b6-745c-587b-9f20-5e9cc35ee40f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/333/d1634f477ff343f9bd7206a1412319f3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987140%27 HTTP/1.1" 200 None
2026-03-27 13:35:51 [ayvens.es] INFO: Saving data for 1987140: {'created_time': 1774618551.828845, 'last_price_update_time': 1774618551.828854, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987140') HTTP/1.1" 204 0
2026-03-27 13:35:51 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-27 13:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ff25d0>
2026-03-27 13:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f261cfe-3b66-5ba5-b762-8667075a5a60/8f261cfe-3b66-5ba5-b762-8667075a5a60_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252Faf57c3c07f204c009f6d977dbfbe9b4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/af57c3c07f204c009f6d977dbfbe9b4c/images/large/1.jpg saved to cache
2026-03-27 13:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f261cfe-3b66-5ba5-b762-8667075a5a60
2026-03-27 13:35:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f261cfe-3b66-5ba5-b762-8667075a5a60, skipping ID generation
2026-03-27 13:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f261cfe-3b66-5ba5-b762-8667075a5a60 with scrape type 1
2026-03-27 13:35:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f261cfe-3b66-5ba5-b762-8667075a5a60 sending to next pipeline
2026-03-27 13:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8f261cfe-3b66-5ba5-b762-8667075a5a60, identifier: 1987141
2026-03-27 13:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295be6f10>
2026-03-27 13:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b9962a2-59a5-548c-9c41-cb7f74935fc9/2b9962a2-59a5-548c-9c41-cb7f74935fc9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F136784b062504a3dba0bfd0db229ac76%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/136784b062504a3dba0bfd0db229ac76/images/large/1.jpg saved to cache
2026-03-27 13:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b9962a2-59a5-548c-9c41-cb7f74935fc9
2026-03-27 13:35:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b9962a2-59a5-548c-9c41-cb7f74935fc9, skipping ID generation
2026-03-27 13:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9962a2-59a5-548c-9c41-cb7f74935fc9 with scrape type 1
2026-03-27 13:35:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b9962a2-59a5-548c-9c41-cb7f74935fc9 sending to next pipeline
2026-03-27 13:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2b9962a2-59a5-548c-9c41-cb7f74935fc9, identifier: 1987142
2026-03-27 13:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8f261cfe-3b66-5ba5-b762-8667075a5a60 with identifier: 1987141
2026-03-27 13:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8f261cfe-3b66-5ba5-b762-8667075a5a60 with identifier: 1987141
2026-03-27 13:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8f261cfe-3b66-5ba5-b762-8667075a5a60 with identifier: 1987141 to the API
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/409/af57c3c07f204c009f6d977dbfbe9b4c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8f261cfe-3b66-5ba5-b762-8667075a5a60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 37296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f261cfe-3b66-5ba5-b762-8667075a5a60/8f261cfe-3b66-5ba5-b762-8667075a5a60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/af57c3c07f204c009f6d977dbfbe9b4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2023}
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987141%27 HTTP/1.1" 200 None
2026-03-27 13:35:52 [ayvens.es] INFO: Saving data for 1987141: {'created_time': 1774618552.610858, 'last_price_update_time': 1774618552.610868, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987141') HTTP/1.1" 204 0
2026-03-27 13:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2b9962a2-59a5-548c-9c41-cb7f74935fc9 with identifier: 1987142
2026-03-27 13:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2b9962a2-59a5-548c-9c41-cb7f74935fc9 with identifier: 1987142
2026-03-27 13:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2b9962a2-59a5-548c-9c41-cb7f74935fc9 with identifier: 1987142 to the API
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/849/136784b062504a3dba0bfd0db229ac76/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2b9962a2-59a5-548c-9c41-cb7f74935fc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 115597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9962a2-59a5-548c-9c41-cb7f74935fc9/2b9962a2-59a5-548c-9c41-cb7f74935fc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/849/136784b062504a3dba0bfd0db229ac76/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+ SB',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+ SB',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987142%27 HTTP/1.1" 200 None
2026-03-27 13:35:52 [ayvens.es] INFO: Saving data for 1987142: {'created_time': 1774618552.971563, 'last_price_update_time': 1774618552.971573, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987142') HTTP/1.1" 204 0
2026-03-27 13:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 13:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/089/0658888ef4c34d038c0b672e9b13a4e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/769/1e27852ccda7453d82b0af5c288c237a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/311/e8e2f4c1bf0b43f8b8db0bc3897b2570/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/886/0fdd83f381804b29b0e26bdbd5faa405/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/724/ff3aba4dcc634499aeb5c87b85f04bdb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ff2c50>
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d587de-5622-5e08-814a-a129a6723aec/54d587de-5622-5e08-814a-a129a6723aec_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F089%252F0658888ef4c34d038c0b672e9b13a4e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/089/0658888ef4c34d038c0b672e9b13a4e3/images/large/1.jpg saved to cache
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54d587de-5622-5e08-814a-a129a6723aec
2026-03-27 13:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54d587de-5622-5e08-814a-a129a6723aec, skipping ID generation
2026-03-27 13:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d587de-5622-5e08-814a-a129a6723aec with scrape type 1
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54d587de-5622-5e08-814a-a129a6723aec sending to next pipeline
2026-03-27 13:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 54d587de-5622-5e08-814a-a129a6723aec, identifier: 1987143
2026-03-27 13:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 54d587de-5622-5e08-814a-a129a6723aec with identifier: 1987143
2026-03-27 13:35:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 54d587de-5622-5e08-814a-a129a6723aec with identifier: 1987143
2026-03-27 13:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 54d587de-5622-5e08-814a-a129a6723aec with identifier: 1987143 to the API
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/089/0658888ef4c34d038c0b672e9b13a4e3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris platino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '54d587de-5622-5e08-814a-a129a6723aec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 44609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d587de-5622-5e08-814a-a129a6723aec/54d587de-5622-5e08-814a-a129a6723aec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/089/0658888ef4c34d038c0b672e9b13a4e3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Pack Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987143%27 HTTP/1.1" 200 None
2026-03-27 13:35:53 [ayvens.es] INFO: Saving data for 1987143: {'created_time': 1774618553.618372, 'last_price_update_time': 1774618553.618383, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987143') HTTP/1.1" 204 0
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52965e7210>
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5fa5af-0e48-5ae9-9805-0ba6ec856a90/2a5fa5af-0e48-5ae9-9805-0ba6ec856a90_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F769%252F1e27852ccda7453d82b0af5c288c237a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/769/1e27852ccda7453d82b0af5c288c237a/images/large/1.jpg saved to cache
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90
2026-03-27 13:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90, skipping ID generation
2026-03-27 13:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90 with scrape type 1
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90 sending to next pipeline
2026-03-27 13:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90, identifier: 1987144
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bfa090>
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35e5dd10-12d6-53ee-8b96-833c992823fe/35e5dd10-12d6-53ee-8b96-833c992823fe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F311%252Fe8e2f4c1bf0b43f8b8db0bc3897b2570%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/311/e8e2f4c1bf0b43f8b8db0bc3897b2570/images/large/1.jpg saved to cache
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35e5dd10-12d6-53ee-8b96-833c992823fe
2026-03-27 13:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35e5dd10-12d6-53ee-8b96-833c992823fe, skipping ID generation
2026-03-27 13:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35e5dd10-12d6-53ee-8b96-833c992823fe with scrape type 1
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35e5dd10-12d6-53ee-8b96-833c992823fe sending to next pipeline
2026-03-27 13:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 35e5dd10-12d6-53ee-8b96-833c992823fe, identifier: 1987145
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960bd850>
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11797d9e-2731-5f67-8449-56cc27b4c210/11797d9e-2731-5f67-8449-56cc27b4c210_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F886%252F0fdd83f381804b29b0e26bdbd5faa405%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/886/0fdd83f381804b29b0e26bdbd5faa405/images/large/1.jpg saved to cache
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11797d9e-2731-5f67-8449-56cc27b4c210
2026-03-27 13:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11797d9e-2731-5f67-8449-56cc27b4c210, skipping ID generation
2026-03-27 13:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11797d9e-2731-5f67-8449-56cc27b4c210 with scrape type 1
2026-03-27 13:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11797d9e-2731-5f67-8449-56cc27b4c210 sending to next pipeline
2026-03-27 13:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 11797d9e-2731-5f67-8449-56cc27b4c210, identifier: 1987147
2026-03-27 13:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295e53a90>
2026-03-27 13:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f816da24-c060-5d86-8bc2-5acce49f123b/f816da24-c060-5d86-8bc2-5acce49f123b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252Fff3aba4dcc634499aeb5c87b85f04bdb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/ff3aba4dcc634499aeb5c87b85f04bdb/images/large/1.jpg saved to cache
2026-03-27 13:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f816da24-c060-5d86-8bc2-5acce49f123b
2026-03-27 13:35:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f816da24-c060-5d86-8bc2-5acce49f123b, skipping ID generation
2026-03-27 13:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f816da24-c060-5d86-8bc2-5acce49f123b with scrape type 1
2026-03-27 13:35:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f816da24-c060-5d86-8bc2-5acce49f123b sending to next pipeline
2026-03-27 13:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f816da24-c060-5d86-8bc2-5acce49f123b, identifier: 1987146
2026-03-27 13:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90 with identifier: 1987144
2026-03-27 13:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90 with identifier: 1987144
2026-03-27 13:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2a5fa5af-0e48-5ae9-9805-0ba6ec856a90 with identifier: 1987144 to the API
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/769/1e27852ccda7453d82b0af5c288c237a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2a5fa5af-0e48-5ae9-9805-0ba6ec856a90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 119469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a5fa5af-0e48-5ae9-9805-0ba6ec856a90/2a5fa5af-0e48-5ae9-9805-0ba6ec856a90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/769/1e27852ccda7453d82b0af5c288c237a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987144%27 HTTP/1.1" 200 None
2026-03-27 13:35:54 [ayvens.es] INFO: Saving data for 1987144: {'created_time': 1774618554.602782, 'last_price_update_time': 1774618554.602792, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987144') HTTP/1.1" 204 0
2026-03-27 13:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 35e5dd10-12d6-53ee-8b96-833c992823fe with identifier: 1987145
2026-03-27 13:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 35e5dd10-12d6-53ee-8b96-833c992823fe with identifier: 1987145
2026-03-27 13:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 35e5dd10-12d6-53ee-8b96-833c992823fe with identifier: 1987145 to the API
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/311/e8e2f4c1bf0b43f8b8db0bc3897b2570/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Gris selenita metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '35e5dd10-12d6-53ee-8b96-833c992823fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 80885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35e5dd10-12d6-53ee-8b96-833c992823fe/35e5dd10-12d6-53ee-8b96-833c992823fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/311/e8e2f4c1bf0b43f8b8db0bc3897b2570/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 200 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 200 d 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987145%27 HTTP/1.1" 200 None
2026-03-27 13:35:54 [ayvens.es] INFO: Saving data for 1987145: {'created_time': 1774618554.953931, 'last_price_update_time': 1774618554.953941, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987145') HTTP/1.1" 204 0
2026-03-27 13:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 11797d9e-2731-5f67-8449-56cc27b4c210 with identifier: 1987147
2026-03-27 13:35:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 11797d9e-2731-5f67-8449-56cc27b4c210 with identifier: 1987147
2026-03-27 13:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 11797d9e-2731-5f67-8449-56cc27b4c210 with identifier: 1987147 to the API
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/886/0fdd83f381804b29b0e26bdbd5faa405/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '11797d9e-2731-5f67-8449-56cc27b4c210',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 99406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11797d9e-2731-5f67-8449-56cc27b4c210/11797d9e-2731-5f67-8449-56cc27b4c210_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/886/0fdd83f381804b29b0e26bdbd5faa405/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.4 66kW (90CV) Expression Pro',
 'transmission': 'manual',
 'trim': '1.4 66kW (90CV) Expression Pro',
 'vin': None,
 'year': 2018}
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987147%27 HTTP/1.1" 200 None
2026-03-27 13:35:55 [ayvens.es] INFO: Saving data for 1987147: {'created_time': 1774618555.352447, 'last_price_update_time': 1774618555.352458, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987147') HTTP/1.1" 204 0
2026-03-27 13:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f816da24-c060-5d86-8bc2-5acce49f123b with identifier: 1987146
2026-03-27 13:35:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f816da24-c060-5d86-8bc2-5acce49f123b with identifier: 1987146
2026-03-27 13:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f816da24-c060-5d86-8bc2-5acce49f123b with identifier: 1987146 to the API
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/724/ff3aba4dcc634499aeb5c87b85f04bdb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Phantom black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f816da24-c060-5d86-8bc2-5acce49f123b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 64793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f816da24-c060-5d86-8bc2-5acce49f123b/f816da24-c060-5d86-8bc2-5acce49f123b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/724/ff3aba4dcc634499aeb5c87b85f04bdb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON (O) 1.6 CRDI 100kW (136CV) 48V Style DCT 4x4',
 'transmission': 'manual',
 'trim': '(O) 1.6 CRDI 100kW (136CV) 48V Style DCT 4x4',
 'vin': None,
 'year': 2022}
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987146%27 HTTP/1.1" 200 None
2026-03-27 13:35:55 [ayvens.es] INFO: Saving data for 1987146: {'created_time': 1774618555.755715, 'last_price_update_time': 1774618555.755729, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987146') HTTP/1.1" 204 0
2026-03-27 13:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/655/23a7a41ae07847fb9c3a2b0912f6f821/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632c2d0>
2026-03-27 13:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1236ae-54d7-5769-92c7-c6e2b52757ac/1c1236ae-54d7-5769-92c7-c6e2b52757ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F655%252F23a7a41ae07847fb9c3a2b0912f6f821%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/655/23a7a41ae07847fb9c3a2b0912f6f821/images/large/1.jpg saved to cache
2026-03-27 13:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c1236ae-54d7-5769-92c7-c6e2b52757ac
2026-03-27 13:35:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c1236ae-54d7-5769-92c7-c6e2b52757ac, skipping ID generation
2026-03-27 13:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c1236ae-54d7-5769-92c7-c6e2b52757ac with scrape type 1
2026-03-27 13:35:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c1236ae-54d7-5769-92c7-c6e2b52757ac sending to next pipeline
2026-03-27 13:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1c1236ae-54d7-5769-92c7-c6e2b52757ac, identifier: 1987148
2026-03-27 13:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1c1236ae-54d7-5769-92c7-c6e2b52757ac with identifier: 1987148
2026-03-27 13:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1c1236ae-54d7-5769-92c7-c6e2b52757ac with identifier: 1987148
2026-03-27 13:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1c1236ae-54d7-5769-92c7-c6e2b52757ac with identifier: 1987148 to the API
2026-03-27 13:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/655/23a7a41ae07847fb9c3a2b0912f6f821/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '1c1236ae-54d7-5769-92c7-c6e2b52757ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 50605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1236ae-54d7-5769-92c7-c6e2b52757ac/1c1236ae-54d7-5769-92c7-c6e2b52757ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/655/23a7a41ae07847fb9c3a2b0912f6f821/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.0 EcoBoost 74kW Trend S/S 5p',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 74kW Trend S/S 5p',
 'vin': None,
 'year': 2019}
2026-03-27 13:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987148%27 HTTP/1.1" 200 None
2026-03-27 13:35:56 [ayvens.es] INFO: Saving data for 1987148: {'created_time': 1774618556.420383, 'last_price_update_time': 1774618556.420394, 'auction_closing_time': 1774868400.0}
2026-03-27 13:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987148') HTTP/1.1" 204 0
2026-03-27 13:36:05 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -2 pages/min), scraped 500 items (at 76 items/min)
2026-03-27 13:36:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-27 13:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987149
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987149%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987149: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987149
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7331d2-1908-5458-b437-0b8e0fbd5d49 with identifier: 1987149
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7331d2-1908-5458-b437-0b8e0fbd5d49 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7b7331d2-1908-5458-b437-0b8e0fbd5d49
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F011%252F129796617ca74f96b3989aa9772669ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/011/129796617ca74f96b3989aa9772669ea/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987150
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987150%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987150: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987150
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 122e810a-626c-5103-89f7-1793d5ad9eda with identifier: 1987150
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 122e810a-626c-5103-89f7-1793d5ad9eda with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 122e810a-626c-5103-89f7-1793d5ad9eda
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F394%252Ff2f726c42e0d4b159ec88b770684745f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/394/f2f726c42e0d4b159ec88b770684745f/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987151
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987151%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987151: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987151
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07857f22-c024-5def-929d-836f70810b3f with identifier: 1987151
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07857f22-c024-5def-929d-836f70810b3f with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 07857f22-c024-5def-929d-836f70810b3f
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F127%252F57dc17e00c184dae85326bee577aad8e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/127/57dc17e00c184dae85326bee577aad8e/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987152
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987152%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987152: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987152
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f473fdea-7212-520f-9801-788c8b480640 with identifier: 1987152
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f473fdea-7212-520f-9801-788c8b480640 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f473fdea-7212-520f-9801-788c8b480640
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F343%252Fbb772434dfb94f8a89acd165caf1bec9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/343/bb772434dfb94f8a89acd165caf1bec9/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987153
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987153%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987153: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987153
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95dd000b-7277-5974-b80c-dc99e51402aa with identifier: 1987153
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95dd000b-7277-5974-b80c-dc99e51402aa with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 95dd000b-7277-5974-b80c-dc99e51402aa
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252F42d9a1109f334a4abc1d0c2981a73bdb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/42d9a1109f334a4abc1d0c2981a73bdb/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987154
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987154%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987154: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987154
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5a10a9c-5ccd-5223-bb1f-8583a5672f41 with identifier: 1987154
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5a10a9c-5ccd-5223-bb1f-8583a5672f41 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a5a10a9c-5ccd-5223-bb1f-8583a5672f41
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F775%252F6471f4f5accf4a05978cbc5feb0d422e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/775/6471f4f5accf4a05978cbc5feb0d422e/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987155
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987155%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987155: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987155
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799f5eba-f2ac-589e-a237-e4028ad0a27e with identifier: 1987155
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799f5eba-f2ac-589e-a237-e4028ad0a27e with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 799f5eba-f2ac-589e-a237-e4028ad0a27e
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252Fb1188c70372a42efb4afedac6f2f4271%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/b1188c70372a42efb4afedac6f2f4271/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987156
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987156%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987156: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987156
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21194aef-569c-5e39-86cb-5f48ac24c48f with identifier: 1987156
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21194aef-569c-5e39-86cb-5f48ac24c48f with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21194aef-569c-5e39-86cb-5f48ac24c48f
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F601%252Fd03b853bd0b24fab99ad6ec0a6a235f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/601/d03b853bd0b24fab99ad6ec0a6a235f4/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987157
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987157%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987157: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987157
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed1b9e17-5258-5674-9d84-5cc6bdb80fe8 with identifier: 1987157
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1b9e17-5258-5674-9d84-5cc6bdb80fe8 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ed1b9e17-5258-5674-9d84-5cc6bdb80fe8
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F331%252Fe85835235a0b4b6dbc14666aafe48c05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/331/e85835235a0b4b6dbc14666aafe48c05/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987158
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987158%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987158: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987158
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14efd0c5-7821-539f-a430-a9d7bf9c33b7 with identifier: 1987158
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14efd0c5-7821-539f-a430-a9d7bf9c33b7 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 14efd0c5-7821-539f-a430-a9d7bf9c33b7
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252Fb0a3c60221e54acc8124515bedd9f09a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/b0a3c60221e54acc8124515bedd9f09a/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987159
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987159%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987159: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987159
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17cdc775-95a9-5fd1-81d0-ccdd4281475e with identifier: 1987159
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17cdc775-95a9-5fd1-81d0-ccdd4281475e with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 17cdc775-95a9-5fd1-81d0-ccdd4281475e
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252Ff04410914cd9444092c228ed28628de7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/f04410914cd9444092c228ed28628de7/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/394/f2f726c42e0d4b159ec88b770684745f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987160
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987160%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987160: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987160
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e8a2a2-3779-5308-91e0-85f8c5fd98d4 with identifier: 1987160
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e8a2a2-3779-5308-91e0-85f8c5fd98d4 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88e8a2a2-3779-5308-91e0-85f8c5fd98d4
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F708%252Fe39f05437ca34a1a89919e139a431c18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/708/e39f05437ca34a1a89919e139a431c18/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/011/129796617ca74f96b3989aa9772669ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987161
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987161%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987161: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987161
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5406a190-41a7-5b78-b82c-912928bfbfe4 with identifier: 1987161
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5406a190-41a7-5b78-b82c-912928bfbfe4 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5406a190-41a7-5b78-b82c-912928bfbfe4
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252Fb4ac476d68d04a8898cc61fe4f59dbee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/b4ac476d68d04a8898cc61fe4f59dbee/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/775/6471f4f5accf4a05978cbc5feb0d422e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/127/57dc17e00c184dae85326bee577aad8e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987162
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987162%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987162: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987162
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af559950-393f-5544-8d5c-6c7a90efc733 with identifier: 1987162
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af559950-393f-5544-8d5c-6c7a90efc733 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af559950-393f-5544-8d5c-6c7a90efc733
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F231%252F6fe7527791e54596b09005c61818aab7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/231/6fe7527791e54596b09005c61818aab7/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [ayvens.es] INFO: Found listing with ID: 1987163
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987163%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [ayvens.es] INFO: Scrape type for 1987163: 1
2026-03-27 13:36:28 [ayvens.es] INFO: Extracting data for car ID: 1987163
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7711abc1-4968-5e24-8a2f-7952310a1e68 with identifier: 1987163
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7711abc1-4968-5e24-8a2f-7952310a1e68 with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7711abc1-4968-5e24-8a2f-7952310a1e68
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F423%252F778b075424e24c46a32b6c62ab04c051%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/423/778b075424e24c46a32b6c62ab04c051/images/large/1.jpg not downloaded yet
2026-03-27 13:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529579c290>
2026-03-27 13:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122e810a-626c-5103-89f7-1793d5ad9eda/122e810a-626c-5103-89f7-1793d5ad9eda_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F394%252Ff2f726c42e0d4b159ec88b770684745f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/394/f2f726c42e0d4b159ec88b770684745f/images/large/1.jpg saved to cache
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 122e810a-626c-5103-89f7-1793d5ad9eda
2026-03-27 13:36:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 122e810a-626c-5103-89f7-1793d5ad9eda, skipping ID generation
2026-03-27 13:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 122e810a-626c-5103-89f7-1793d5ad9eda with scrape type 1
2026-03-27 13:36:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 122e810a-626c-5103-89f7-1793d5ad9eda sending to next pipeline
2026-03-27 13:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 122e810a-626c-5103-89f7-1793d5ad9eda, identifier: 1987150
2026-03-27 13:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52a5631410>
2026-03-27 13:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7331d2-1908-5458-b437-0b8e0fbd5d49/7b7331d2-1908-5458-b437-0b8e0fbd5d49_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F011%252F129796617ca74f96b3989aa9772669ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/011/129796617ca74f96b3989aa9772669ea/images/large/1.jpg saved to cache
2026-03-27 13:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b7331d2-1908-5458-b437-0b8e0fbd5d49
2026-03-27 13:36:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b7331d2-1908-5458-b437-0b8e0fbd5d49, skipping ID generation
2026-03-27 13:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7331d2-1908-5458-b437-0b8e0fbd5d49 with scrape type 1
2026-03-27 13:36:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b7331d2-1908-5458-b437-0b8e0fbd5d49 sending to next pipeline
2026-03-27 13:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7b7331d2-1908-5458-b437-0b8e0fbd5d49, identifier: 1987149
2026-03-27 13:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 122e810a-626c-5103-89f7-1793d5ad9eda with identifier: 1987150
2026-03-27 13:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 122e810a-626c-5103-89f7-1793d5ad9eda with identifier: 1987150
2026-03-27 13:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 122e810a-626c-5103-89f7-1793d5ad9eda with identifier: 1987150 to the API
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/394/f2f726c42e0d4b159ec88b770684745f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '122e810a-626c-5103-89f7-1793d5ad9eda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 191082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122e810a-626c-5103-89f7-1793d5ad9eda/122e810a-626c-5103-89f7-1793d5ad9eda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/394/f2f726c42e0d4b159ec88b770684745f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987150%27 HTTP/1.1" 200 None
2026-03-27 13:36:29 [ayvens.es] INFO: Saving data for 1987150: {'created_time': 1774618589.620736, 'last_price_update_time': 1774618589.620746, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987150') HTTP/1.1" 204 0
2026-03-27 13:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7b7331d2-1908-5458-b437-0b8e0fbd5d49 with identifier: 1987149
2026-03-27 13:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7b7331d2-1908-5458-b437-0b8e0fbd5d49 with identifier: 1987149
2026-03-27 13:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7b7331d2-1908-5458-b437-0b8e0fbd5d49 with identifier: 1987149 to the API
2026-03-27 13:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/011/129796617ca74f96b3989aa9772669ea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b7331d2-1908-5458-b437-0b8e0fbd5d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 61093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7331d2-1908-5458-b437-0b8e0fbd5d49/7b7331d2-1908-5458-b437-0b8e0fbd5d49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/011/129796617ca74f96b3989aa9772669ea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987149%27 HTTP/1.1" 200 None
2026-03-27 13:36:30 [ayvens.es] INFO: Saving data for 1987149: {'created_time': 1774618590.121369, 'last_price_update_time': 1774618590.121381, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987149') HTTP/1.1" 204 0
2026-03-27 13:36:30 [ayvens.es] INFO: Found listing with ID: 1987164
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987164%27 HTTP/1.1" 200 None
2026-03-27 13:36:30 [ayvens.es] INFO: Scrape type for 1987164: 1
2026-03-27 13:36:30 [ayvens.es] INFO: Extracting data for car ID: 1987164
2026-03-27 13:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 474fdd4d-48a8-5ddf-b6fe-7b65974b920c with identifier: 1987164
2026-03-27 13:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474fdd4d-48a8-5ddf-b6fe-7b65974b920c with scrape type 1
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 474fdd4d-48a8-5ddf-b6fe-7b65974b920c
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F58188d9c034b43249a40587bce1d2d5a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/58188d9c034b43249a40587bce1d2d5a/images/large/1.jpg not downloaded yet
2026-03-27 13:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/418/42d9a1109f334a4abc1d0c2981a73bdb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/343/bb772434dfb94f8a89acd165caf1bec9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/601/d03b853bd0b24fab99ad6ec0a6a235f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/946/b1188c70372a42efb4afedac6f2f4271/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:30 [ayvens.es] INFO: Found listing with ID: 1987165
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987165%27 HTTP/1.1" 200 None
2026-03-27 13:36:30 [ayvens.es] INFO: Scrape type for 1987165: 1
2026-03-27 13:36:30 [ayvens.es] INFO: Extracting data for car ID: 1987165
2026-03-27 13:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbde3646-e01c-5e6a-a7d5-18ee4d3e116f with identifier: 1987165
2026-03-27 13:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbde3646-e01c-5e6a-a7d5-18ee4d3e116f with scrape type 1
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fbde3646-e01c-5e6a-a7d5-18ee4d3e116f
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F496%252F41a6bfea9b7c480e94652d39152928a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/496/41a6bfea9b7c480e94652d39152928a7/images/large/1.jpg not downloaded yet
2026-03-27 13:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295fa9750>
2026-03-27 13:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5a10a9c-5ccd-5223-bb1f-8583a5672f41/a5a10a9c-5ccd-5223-bb1f-8583a5672f41_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F775%252F6471f4f5accf4a05978cbc5feb0d422e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/775/6471f4f5accf4a05978cbc5feb0d422e/images/large/1.jpg saved to cache
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5a10a9c-5ccd-5223-bb1f-8583a5672f41
2026-03-27 13:36:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5a10a9c-5ccd-5223-bb1f-8583a5672f41, skipping ID generation
2026-03-27 13:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5a10a9c-5ccd-5223-bb1f-8583a5672f41 with scrape type 1
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5a10a9c-5ccd-5223-bb1f-8583a5672f41 sending to next pipeline
2026-03-27 13:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a5a10a9c-5ccd-5223-bb1f-8583a5672f41, identifier: 1987154
2026-03-27 13:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957073d0>
2026-03-27 13:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07857f22-c024-5def-929d-836f70810b3f/07857f22-c024-5def-929d-836f70810b3f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F127%252F57dc17e00c184dae85326bee577aad8e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/127/57dc17e00c184dae85326bee577aad8e/images/large/1.jpg saved to cache
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07857f22-c024-5def-929d-836f70810b3f
2026-03-27 13:36:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07857f22-c024-5def-929d-836f70810b3f, skipping ID generation
2026-03-27 13:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07857f22-c024-5def-929d-836f70810b3f with scrape type 1
2026-03-27 13:36:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07857f22-c024-5def-929d-836f70810b3f sending to next pipeline
2026-03-27 13:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 07857f22-c024-5def-929d-836f70810b3f, identifier: 1987151
2026-03-27 13:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a5a10a9c-5ccd-5223-bb1f-8583a5672f41 with identifier: 1987154
2026-03-27 13:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a5a10a9c-5ccd-5223-bb1f-8583a5672f41 with identifier: 1987154
2026-03-27 13:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a5a10a9c-5ccd-5223-bb1f-8583a5672f41 with identifier: 1987154 to the API
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/775/6471f4f5accf4a05978cbc5feb0d422e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'gas',
 'id': 'a5a10a9c-5ccd-5223-bb1f-8583a5672f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 64892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5a10a9c-5ccd-5223-bb1f-8583a5672f41/a5a10a9c-5ccd-5223-bb1f-8583a5672f41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/775/6471f4f5accf4a05978cbc5feb0d422e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA (O) 1.0 TGI 66kW (90CV) Reference Busine',
 'transmission': 'manual',
 'trim': '(O) 1.0 TGI 66kW (90CV) Reference Busine',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987154%27 HTTP/1.1" 200 None
2026-03-27 13:36:30 [ayvens.es] INFO: Saving data for 1987154: {'created_time': 1774618590.94167, 'last_price_update_time': 1774618590.94168, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987154') HTTP/1.1" 204 0
2026-03-27 13:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 07857f22-c024-5def-929d-836f70810b3f with identifier: 1987151
2026-03-27 13:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 07857f22-c024-5def-929d-836f70810b3f with identifier: 1987151
2026-03-27 13:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 07857f22-c024-5def-929d-836f70810b3f with identifier: 1987151 to the API
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/127/57dc17e00c184dae85326bee577aad8e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '07857f22-c024-5def-929d-836f70810b3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 86418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07857f22-c024-5def-929d-836f70810b3f/07857f22-c024-5def-929d-836f70810b3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/127/57dc17e00c184dae85326bee577aad8e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987151%27 HTTP/1.1" 200 None
2026-03-27 13:36:31 [ayvens.es] INFO: Saving data for 1987151: {'created_time': 1774618591.756961, 'last_price_update_time': 1774618591.756971, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987151') HTTP/1.1" 204 0
2026-03-27 13:36:31 [ayvens.es] INFO: Found listing with ID: 1987166
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987166%27 HTTP/1.1" 200 None
2026-03-27 13:36:31 [ayvens.es] INFO: Scrape type for 1987166: 1
2026-03-27 13:36:31 [ayvens.es] INFO: Extracting data for car ID: 1987166
2026-03-27 13:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5d0933-3765-5ddd-97e7-915e3f7acc30 with identifier: 1987166
2026-03-27 13:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5d0933-3765-5ddd-97e7-915e3f7acc30 with scrape type 1
2026-03-27 13:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5d5d0933-3765-5ddd-97e7-915e3f7acc30
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252Fdaf4b06326e4448ab21ae36cb83e7e44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/daf4b06326e4448ab21ae36cb83e7e44/images/large/1.jpg not downloaded yet
2026-03-27 13:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/122/f04410914cd9444092c228ed28628de7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/442/b0a3c60221e54acc8124515bedd9f09a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/708/e39f05437ca34a1a89919e139a431c18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:31 [ayvens.es] INFO: Found listing with ID: 1987167
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987167%27 HTTP/1.1" 200 None
2026-03-27 13:36:31 [ayvens.es] INFO: Scrape type for 1987167: 1
2026-03-27 13:36:31 [ayvens.es] INFO: Extracting data for car ID: 1987167
2026-03-27 13:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e10d9aea-3c77-5e88-becb-34b98d1a5aef with identifier: 1987167
2026-03-27 13:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e10d9aea-3c77-5e88-becb-34b98d1a5aef with scrape type 1
2026-03-27 13:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e10d9aea-3c77-5e88-becb-34b98d1a5aef
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252Fca1b70dbf61a4e96ae3d4335c2bc12a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/ca1b70dbf61a4e96ae3d4335c2bc12a6/images/large/1.jpg not downloaded yet
2026-03-27 13:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1a750>
2026-03-27 13:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95dd000b-7277-5974-b80c-dc99e51402aa/95dd000b-7277-5974-b80c-dc99e51402aa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252F42d9a1109f334a4abc1d0c2981a73bdb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/42d9a1109f334a4abc1d0c2981a73bdb/images/large/1.jpg saved to cache
2026-03-27 13:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95dd000b-7277-5974-b80c-dc99e51402aa
2026-03-27 13:36:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95dd000b-7277-5974-b80c-dc99e51402aa, skipping ID generation
2026-03-27 13:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95dd000b-7277-5974-b80c-dc99e51402aa with scrape type 1
2026-03-27 13:36:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95dd000b-7277-5974-b80c-dc99e51402aa sending to next pipeline
2026-03-27 13:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 95dd000b-7277-5974-b80c-dc99e51402aa, identifier: 1987153
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961aa850>
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f473fdea-7212-520f-9801-788c8b480640/f473fdea-7212-520f-9801-788c8b480640_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F343%252Fbb772434dfb94f8a89acd165caf1bec9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/343/bb772434dfb94f8a89acd165caf1bec9/images/large/1.jpg saved to cache
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f473fdea-7212-520f-9801-788c8b480640
2026-03-27 13:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f473fdea-7212-520f-9801-788c8b480640, skipping ID generation
2026-03-27 13:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f473fdea-7212-520f-9801-788c8b480640 with scrape type 1
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f473fdea-7212-520f-9801-788c8b480640 sending to next pipeline
2026-03-27 13:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f473fdea-7212-520f-9801-788c8b480640, identifier: 1987152
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bcc890>
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21194aef-569c-5e39-86cb-5f48ac24c48f/21194aef-569c-5e39-86cb-5f48ac24c48f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F601%252Fd03b853bd0b24fab99ad6ec0a6a235f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/601/d03b853bd0b24fab99ad6ec0a6a235f4/images/large/1.jpg saved to cache
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21194aef-569c-5e39-86cb-5f48ac24c48f
2026-03-27 13:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21194aef-569c-5e39-86cb-5f48ac24c48f, skipping ID generation
2026-03-27 13:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21194aef-569c-5e39-86cb-5f48ac24c48f with scrape type 1
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21194aef-569c-5e39-86cb-5f48ac24c48f sending to next pipeline
2026-03-27 13:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 21194aef-569c-5e39-86cb-5f48ac24c48f, identifier: 1987156
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529602a090>
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799f5eba-f2ac-589e-a237-e4028ad0a27e/799f5eba-f2ac-589e-a237-e4028ad0a27e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252Fb1188c70372a42efb4afedac6f2f4271%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/b1188c70372a42efb4afedac6f2f4271/images/large/1.jpg saved to cache
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799f5eba-f2ac-589e-a237-e4028ad0a27e
2026-03-27 13:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799f5eba-f2ac-589e-a237-e4028ad0a27e, skipping ID generation
2026-03-27 13:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799f5eba-f2ac-589e-a237-e4028ad0a27e with scrape type 1
2026-03-27 13:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 799f5eba-f2ac-589e-a237-e4028ad0a27e sending to next pipeline
2026-03-27 13:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 799f5eba-f2ac-589e-a237-e4028ad0a27e, identifier: 1987155
2026-03-27 13:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 95dd000b-7277-5974-b80c-dc99e51402aa with identifier: 1987153
2026-03-27 13:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 95dd000b-7277-5974-b80c-dc99e51402aa with identifier: 1987153
2026-03-27 13:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 95dd000b-7277-5974-b80c-dc99e51402aa with identifier: 1987153 to the API
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/418/42d9a1109f334a4abc1d0c2981a73bdb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '95dd000b-7277-5974-b80c-dc99e51402aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 146904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95dd000b-7277-5974-b80c-dc99e51402aa/95dd000b-7277-5974-b80c-dc99e51402aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/418/42d9a1109f334a4abc1d0c2981a73bdb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987153%27 HTTP/1.1" 200 None
2026-03-27 13:36:33 [ayvens.es] INFO: Saving data for 1987153: {'created_time': 1774618593.027677, 'last_price_update_time': 1774618593.027688, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987153') HTTP/1.1" 204 0
2026-03-27 13:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f473fdea-7212-520f-9801-788c8b480640 with identifier: 1987152
2026-03-27 13:36:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f473fdea-7212-520f-9801-788c8b480640 with identifier: 1987152
2026-03-27 13:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f473fdea-7212-520f-9801-788c8b480640 with identifier: 1987152 to the API
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/343/bb772434dfb94f8a89acd165caf1bec9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Gris nano',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f473fdea-7212-520f-9801-788c8b480640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 77138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f473fdea-7212-520f-9801-788c8b480640/f473fdea-7212-520f-9801-788c8b480640_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/343/bb772434dfb94f8a89acd165caf1bec9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 Advanced 30 TDI 85kW (116CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 30 TDI 85kW (116CV) S tronic',
 'vin': None,
 'year': 2019}
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987152%27 HTTP/1.1" 200 None
2026-03-27 13:36:33 [ayvens.es] INFO: Saving data for 1987152: {'created_time': 1774618593.397401, 'last_price_update_time': 1774618593.39741, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987152') HTTP/1.1" 204 0
2026-03-27 13:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 21194aef-569c-5e39-86cb-5f48ac24c48f with identifier: 1987156
2026-03-27 13:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 21194aef-569c-5e39-86cb-5f48ac24c48f with identifier: 1987156
2026-03-27 13:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 21194aef-569c-5e39-86cb-5f48ac24c48f with identifier: 1987156 to the API
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/601/d03b853bd0b24fab99ad6ec0a6a235f4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '21194aef-569c-5e39-86cb-5f48ac24c48f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 151372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21194aef-569c-5e39-86cb-5f48ac24c48f/21194aef-569c-5e39-86cb-5f48ac24c48f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/601/d03b853bd0b24fab99ad6ec0a6a235f4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Comfort Blue dCi 85kW (115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Comfort Blue dCi 85kW (115CV) 4X4',
 'vin': None,
 'year': 2022}
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987156%27 HTTP/1.1" 200 None
2026-03-27 13:36:33 [ayvens.es] INFO: Saving data for 1987156: {'created_time': 1774618593.746411, 'last_price_update_time': 1774618593.746422, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987156') HTTP/1.1" 204 0
2026-03-27 13:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 799f5eba-f2ac-589e-a237-e4028ad0a27e with identifier: 1987155
2026-03-27 13:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 799f5eba-f2ac-589e-a237-e4028ad0a27e with identifier: 1987155
2026-03-27 13:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 799f5eba-f2ac-589e-a237-e4028ad0a27e with identifier: 1987155 to the API
2026-03-27 13:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/946/b1188c70372a42efb4afedac6f2f4271/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '799f5eba-f2ac-589e-a237-e4028ad0a27e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 85180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799f5eba-f2ac-589e-a237-e4028ad0a27e/799f5eba-f2ac-589e-a237-e4028ad0a27e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/946/b1188c70372a42efb4afedac6f2f4271/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Ecomotive',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Ecomotive',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987155%27 HTTP/1.1" 200 None
2026-03-27 13:36:34 [ayvens.es] INFO: Saving data for 1987155: {'created_time': 1774618594.167335, 'last_price_update_time': 1774618594.167345, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987155') HTTP/1.1" 204 0
2026-03-27 13:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/331/e85835235a0b4b6dbc14666aafe48c05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:34 [ayvens.es] INFO: Found listing with ID: 1987168
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987168%27 HTTP/1.1" 200 None
2026-03-27 13:36:34 [ayvens.es] INFO: Scrape type for 1987168: 1
2026-03-27 13:36:34 [ayvens.es] INFO: Extracting data for car ID: 1987168
2026-03-27 13:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a04f4b0f-c901-58f4-83c7-c841f1616b84 with identifier: 1987168
2026-03-27 13:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a04f4b0f-c901-58f4-83c7-c841f1616b84 with scrape type 1
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a04f4b0f-c901-58f4-83c7-c841f1616b84
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252Fc1576a426df94e1d8727d3dc78d8b5fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/c1576a426df94e1d8727d3dc78d8b5fd/images/large/1.jpg not downloaded yet
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961a9e90>
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17cdc775-95a9-5fd1-81d0-ccdd4281475e/17cdc775-95a9-5fd1-81d0-ccdd4281475e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252Ff04410914cd9444092c228ed28628de7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/f04410914cd9444092c228ed28628de7/images/large/1.jpg saved to cache
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17cdc775-95a9-5fd1-81d0-ccdd4281475e
2026-03-27 13:36:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17cdc775-95a9-5fd1-81d0-ccdd4281475e, skipping ID generation
2026-03-27 13:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17cdc775-95a9-5fd1-81d0-ccdd4281475e with scrape type 1
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17cdc775-95a9-5fd1-81d0-ccdd4281475e sending to next pipeline
2026-03-27 13:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 17cdc775-95a9-5fd1-81d0-ccdd4281475e, identifier: 1987159
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296009810>
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14efd0c5-7821-539f-a430-a9d7bf9c33b7/14efd0c5-7821-539f-a430-a9d7bf9c33b7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252Fb0a3c60221e54acc8124515bedd9f09a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/b0a3c60221e54acc8124515bedd9f09a/images/large/1.jpg saved to cache
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14efd0c5-7821-539f-a430-a9d7bf9c33b7
2026-03-27 13:36:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14efd0c5-7821-539f-a430-a9d7bf9c33b7, skipping ID generation
2026-03-27 13:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14efd0c5-7821-539f-a430-a9d7bf9c33b7 with scrape type 1
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14efd0c5-7821-539f-a430-a9d7bf9c33b7 sending to next pipeline
2026-03-27 13:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 14efd0c5-7821-539f-a430-a9d7bf9c33b7, identifier: 1987158
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296084c50>
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e8a2a2-3779-5308-91e0-85f8c5fd98d4/88e8a2a2-3779-5308-91e0-85f8c5fd98d4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F708%252Fe39f05437ca34a1a89919e139a431c18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/708/e39f05437ca34a1a89919e139a431c18/images/large/1.jpg saved to cache
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88e8a2a2-3779-5308-91e0-85f8c5fd98d4
2026-03-27 13:36:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88e8a2a2-3779-5308-91e0-85f8c5fd98d4, skipping ID generation
2026-03-27 13:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e8a2a2-3779-5308-91e0-85f8c5fd98d4 with scrape type 1
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88e8a2a2-3779-5308-91e0-85f8c5fd98d4 sending to next pipeline
2026-03-27 13:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 88e8a2a2-3779-5308-91e0-85f8c5fd98d4, identifier: 1987160
2026-03-27 13:36:34 [ayvens.es] INFO: Found listing with ID: 1987169
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987169%27 HTTP/1.1" 200 None
2026-03-27 13:36:34 [ayvens.es] INFO: Scrape type for 1987169: 1
2026-03-27 13:36:34 [ayvens.es] INFO: Extracting data for car ID: 1987169
2026-03-27 13:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0282b5c-dbb1-513a-8187-da2337459cc3 with identifier: 1987169
2026-03-27 13:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0282b5c-dbb1-513a-8187-da2337459cc3 with scrape type 1
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0282b5c-dbb1-513a-8187-da2337459cc3
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F918%252F171a8d1a76a740c3bf9fed036682e4e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/918/171a8d1a76a740c3bf9fed036682e4e1/images/large/1.jpg not downloaded yet
2026-03-27 13:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 17cdc775-95a9-5fd1-81d0-ccdd4281475e with identifier: 1987159
2026-03-27 13:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 17cdc775-95a9-5fd1-81d0-ccdd4281475e with identifier: 1987159
2026-03-27 13:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 17cdc775-95a9-5fd1-81d0-ccdd4281475e with identifier: 1987159 to the API
2026-03-27 13:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/122/f04410914cd9444092c228ed28628de7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Gris nano',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '17cdc775-95a9-5fd1-81d0-ccdd4281475e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 143444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17cdc775-95a9-5fd1-81d0-ccdd4281475e/17cdc775-95a9-5fd1-81d0-ccdd4281475e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/122/f04410914cd9444092c228ed28628de7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987159%27 HTTP/1.1" 200 None
2026-03-27 13:36:35 [ayvens.es] INFO: Saving data for 1987159: {'created_time': 1774618595.189853, 'last_price_update_time': 1774618595.189863, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987159') HTTP/1.1" 204 0
2026-03-27 13:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 14efd0c5-7821-539f-a430-a9d7bf9c33b7 with identifier: 1987158
2026-03-27 13:36:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 14efd0c5-7821-539f-a430-a9d7bf9c33b7 with identifier: 1987158
2026-03-27 13:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 14efd0c5-7821-539f-a430-a9d7bf9c33b7 with identifier: 1987158 to the API
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/442/b0a3c60221e54acc8124515bedd9f09a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco nevada',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '14efd0c5-7821-539f-a430-a9d7bf9c33b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 95850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14efd0c5-7821-539f-a430-a9d7bf9c33b7/14efd0c5-7821-539f-a430-a9d7bf9c33b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/442/b0a3c60221e54acc8124515bedd9f09a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.6 TDI 85kW St&Sp Xcellence Edition Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW St&Sp Xcellence Edition Eco',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987158%27 HTTP/1.1" 200 None
2026-03-27 13:36:35 [ayvens.es] INFO: Saving data for 1987158: {'created_time': 1774618595.5912, 'last_price_update_time': 1774618595.59121, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987158') HTTP/1.1" 204 0
2026-03-27 13:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 88e8a2a2-3779-5308-91e0-85f8c5fd98d4 with identifier: 1987160
2026-03-27 13:36:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 88e8a2a2-3779-5308-91e0-85f8c5fd98d4 with identifier: 1987160
2026-03-27 13:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 88e8a2a2-3779-5308-91e0-85f8c5fd98d4 with identifier: 1987160 to the API
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/708/e39f05437ca34a1a89919e139a431c18/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Rojo deseo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '88e8a2a2-3779-5308-91e0-85f8c5fd98d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 150525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e8a2a2-3779-5308-91e0-85f8c5fd98d4/88e8a2a2-3779-5308-91e0-85f8c5fd98d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/708/e39f05437ca34a1a89919e139a431c18/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR evolution E-Tech full hybr 105kW (145CV)',
 'transmission': 'manual',
 'trim': 'evolution E-Tech full hybr 105kW (145CV)',
 'vin': None,
 'year': 2023}
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987160%27 HTTP/1.1" 200 None
2026-03-27 13:36:35 [ayvens.es] INFO: Saving data for 1987160: {'created_time': 1774618595.999702, 'last_price_update_time': 1774618595.999712, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987160') HTTP/1.1" 204 0
2026-03-27 13:36:36 [ayvens.es] INFO: Found listing with ID: 1987170
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987170%27 HTTP/1.1" 200 None
2026-03-27 13:36:36 [ayvens.es] INFO: Scrape type for 1987170: 1
2026-03-27 13:36:36 [ayvens.es] INFO: Extracting data for car ID: 1987170
2026-03-27 13:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5 with identifier: 1987170
2026-03-27 13:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5 with scrape type 1
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F019%252Fe5f29366b0f24a8db65a737ea7e7b46f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/019/e5f29366b0f24a8db65a737ea7e7b46f/images/large/1.jpg not downloaded yet
2026-03-27 13:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bce490>
2026-03-27 13:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1b9e17-5258-5674-9d84-5cc6bdb80fe8/ed1b9e17-5258-5674-9d84-5cc6bdb80fe8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F331%252Fe85835235a0b4b6dbc14666aafe48c05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/331/e85835235a0b4b6dbc14666aafe48c05/images/large/1.jpg saved to cache
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed1b9e17-5258-5674-9d84-5cc6bdb80fe8
2026-03-27 13:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed1b9e17-5258-5674-9d84-5cc6bdb80fe8, skipping ID generation
2026-03-27 13:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1b9e17-5258-5674-9d84-5cc6bdb80fe8 with scrape type 1
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed1b9e17-5258-5674-9d84-5cc6bdb80fe8 sending to next pipeline
2026-03-27 13:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ed1b9e17-5258-5674-9d84-5cc6bdb80fe8, identifier: 1987157
2026-03-27 13:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/034/58188d9c034b43249a40587bce1d2d5a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ed1b9e17-5258-5674-9d84-5cc6bdb80fe8 with identifier: 1987157
2026-03-27 13:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ed1b9e17-5258-5674-9d84-5cc6bdb80fe8 with identifier: 1987157
2026-03-27 13:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ed1b9e17-5258-5674-9d84-5cc6bdb80fe8 with identifier: 1987157 to the API
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/331/e85835235a0b4b6dbc14666aafe48c05/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ed1b9e17-5258-5674-9d84-5cc6bdb80fe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 46439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1b9e17-5258-5674-9d84-5cc6bdb80fe8/ed1b9e17-5258-5674-9d84-5cc6bdb80fe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/331/e85835235a0b4b6dbc14666aafe48c05/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Black Edition 100kW (136CV) 4x2',
 'transmission': 'manual',
 'trim': '1.6 MHEV Black Edition 100kW (136CV) 4x2',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987157%27 HTTP/1.1" 200 None
2026-03-27 13:36:36 [ayvens.es] INFO: Saving data for 1987157: {'created_time': 1774618596.60014, 'last_price_update_time': 1774618596.60016, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987157') HTTP/1.1" 204 0
2026-03-27 13:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/629/b4ac476d68d04a8898cc61fe4f59dbee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/423/778b075424e24c46a32b6c62ab04c051/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/231/6fe7527791e54596b09005c61818aab7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/496/41a6bfea9b7c480e94652d39152928a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:36 [ayvens.es] INFO: Found listing with ID: 1987171
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987171%27 HTTP/1.1" 200 None
2026-03-27 13:36:36 [ayvens.es] INFO: Scrape type for 1987171: 1
2026-03-27 13:36:36 [ayvens.es] INFO: Extracting data for car ID: 1987171
2026-03-27 13:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb40292d-6e75-5cd1-8acd-f7fd5ae781fc with identifier: 1987171
2026-03-27 13:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb40292d-6e75-5cd1-8acd-f7fd5ae781fc with scrape type 1
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cb40292d-6e75-5cd1-8acd-f7fd5ae781fc
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252Fa73fb77a684a4e44a7177c0771f2a8da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/a73fb77a684a4e44a7177c0771f2a8da/images/large/1.jpg not downloaded yet
2026-03-27 13:36:36 [ayvens.es] INFO: Found listing with ID: 1987172
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987172%27 HTTP/1.1" 200 None
2026-03-27 13:36:36 [ayvens.es] INFO: Scrape type for 1987172: 1
2026-03-27 13:36:36 [ayvens.es] INFO: Extracting data for car ID: 1987172
2026-03-27 13:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b755a55-edba-5dd5-9241-cd9eb854ce78 with identifier: 1987172
2026-03-27 13:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b755a55-edba-5dd5-9241-cd9eb854ce78 with scrape type 1
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7b755a55-edba-5dd5-9241-cd9eb854ce78
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F641%252Fe48cd81e51654d3d97df51909c2ac664%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/641/e48cd81e51654d3d97df51909c2ac664/images/large/1.jpg not downloaded yet
2026-03-27 13:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ef7ed0>
2026-03-27 13:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_474fdd4d-48a8-5ddf-b6fe-7b65974b920c/474fdd4d-48a8-5ddf-b6fe-7b65974b920c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F58188d9c034b43249a40587bce1d2d5a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/58188d9c034b43249a40587bce1d2d5a/images/large/1.jpg saved to cache
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 474fdd4d-48a8-5ddf-b6fe-7b65974b920c
2026-03-27 13:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 474fdd4d-48a8-5ddf-b6fe-7b65974b920c, skipping ID generation
2026-03-27 13:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474fdd4d-48a8-5ddf-b6fe-7b65974b920c with scrape type 1
2026-03-27 13:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 474fdd4d-48a8-5ddf-b6fe-7b65974b920c sending to next pipeline
2026-03-27 13:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 474fdd4d-48a8-5ddf-b6fe-7b65974b920c, identifier: 1987164
2026-03-27 13:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/706/daf4b06326e4448ab21ae36cb83e7e44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:36 [ayvens.es] INFO: Found listing with ID: 1987173
2026-03-27 13:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987173%27 HTTP/1.1" 200 None
2026-03-27 13:36:37 [ayvens.es] INFO: Scrape type for 1987173: 1
2026-03-27 13:36:37 [ayvens.es] INFO: Extracting data for car ID: 1987173
2026-03-27 13:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4210624e-eeff-5ed6-8e77-3f7a9218db8d with identifier: 1987173
2026-03-27 13:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4210624e-eeff-5ed6-8e77-3f7a9218db8d with scrape type 1
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4210624e-eeff-5ed6-8e77-3f7a9218db8d
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F007%252Fd1f330e6b0974e8c94f312749dd6625c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/007/d1f330e6b0974e8c94f312749dd6625c/images/large/1.jpg not downloaded yet
2026-03-27 13:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 474fdd4d-48a8-5ddf-b6fe-7b65974b920c with identifier: 1987164
2026-03-27 13:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 474fdd4d-48a8-5ddf-b6fe-7b65974b920c with identifier: 1987164
2026-03-27 13:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 474fdd4d-48a8-5ddf-b6fe-7b65974b920c with identifier: 1987164 to the API
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/034/58188d9c034b43249a40587bce1d2d5a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '474fdd4d-48a8-5ddf-b6fe-7b65974b920c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 56965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474fdd4d-48a8-5ddf-b6fe-7b65974b920c/474fdd4d-48a8-5ddf-b6fe-7b65974b920c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/034/58188d9c034b43249a40587bce1d2d5a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987164%27 HTTP/1.1" 200 None
2026-03-27 13:36:37 [ayvens.es] INFO: Saving data for 1987164: {'created_time': 1774618597.39736, 'last_price_update_time': 1774618597.397373, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987164') HTTP/1.1" 204 0
2026-03-27 13:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/810/c1576a426df94e1d8727d3dc78d8b5fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:37 [ayvens.es] INFO: Found listing with ID: 1987174
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987174%27 HTTP/1.1" 200 None
2026-03-27 13:36:37 [ayvens.es] INFO: Scrape type for 1987174: 1
2026-03-27 13:36:37 [ayvens.es] INFO: Extracting data for car ID: 1987174
2026-03-27 13:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9302a398-74e5-5568-a2db-546c3123ac80 with identifier: 1987174
2026-03-27 13:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9302a398-74e5-5568-a2db-546c3123ac80 with scrape type 1
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9302a398-74e5-5568-a2db-546c3123ac80
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Fcebdb13486514a89a339574c5925cbe9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/cebdb13486514a89a339574c5925cbe9/images/large/1.jpg not downloaded yet
2026-03-27 13:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/824/ca1b70dbf61a4e96ae3d4335c2bc12a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961d9710>
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5406a190-41a7-5b78-b82c-912928bfbfe4/5406a190-41a7-5b78-b82c-912928bfbfe4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252Fb4ac476d68d04a8898cc61fe4f59dbee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/b4ac476d68d04a8898cc61fe4f59dbee/images/large/1.jpg saved to cache
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5406a190-41a7-5b78-b82c-912928bfbfe4
2026-03-27 13:36:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5406a190-41a7-5b78-b82c-912928bfbfe4, skipping ID generation
2026-03-27 13:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5406a190-41a7-5b78-b82c-912928bfbfe4 with scrape type 1
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5406a190-41a7-5b78-b82c-912928bfbfe4 sending to next pipeline
2026-03-27 13:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5406a190-41a7-5b78-b82c-912928bfbfe4, identifier: 1987161
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f80110>
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7711abc1-4968-5e24-8a2f-7952310a1e68/7711abc1-4968-5e24-8a2f-7952310a1e68_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F423%252F778b075424e24c46a32b6c62ab04c051%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/423/778b075424e24c46a32b6c62ab04c051/images/large/1.jpg saved to cache
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7711abc1-4968-5e24-8a2f-7952310a1e68
2026-03-27 13:36:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7711abc1-4968-5e24-8a2f-7952310a1e68, skipping ID generation
2026-03-27 13:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7711abc1-4968-5e24-8a2f-7952310a1e68 with scrape type 1
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7711abc1-4968-5e24-8a2f-7952310a1e68 sending to next pipeline
2026-03-27 13:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7711abc1-4968-5e24-8a2f-7952310a1e68, identifier: 1987163
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ef7d50>
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af559950-393f-5544-8d5c-6c7a90efc733/af559950-393f-5544-8d5c-6c7a90efc733_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F231%252F6fe7527791e54596b09005c61818aab7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/231/6fe7527791e54596b09005c61818aab7/images/large/1.jpg saved to cache
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af559950-393f-5544-8d5c-6c7a90efc733
2026-03-27 13:36:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af559950-393f-5544-8d5c-6c7a90efc733, skipping ID generation
2026-03-27 13:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af559950-393f-5544-8d5c-6c7a90efc733 with scrape type 1
2026-03-27 13:36:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af559950-393f-5544-8d5c-6c7a90efc733 sending to next pipeline
2026-03-27 13:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: af559950-393f-5544-8d5c-6c7a90efc733, identifier: 1987162
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bf0750>
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde3646-e01c-5e6a-a7d5-18ee4d3e116f/fbde3646-e01c-5e6a-a7d5-18ee4d3e116f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F496%252F41a6bfea9b7c480e94652d39152928a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/496/41a6bfea9b7c480e94652d39152928a7/images/large/1.jpg saved to cache
2026-03-27 13:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbde3646-e01c-5e6a-a7d5-18ee4d3e116f
2026-03-27 13:36:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbde3646-e01c-5e6a-a7d5-18ee4d3e116f, skipping ID generation
2026-03-27 13:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbde3646-e01c-5e6a-a7d5-18ee4d3e116f with scrape type 1
2026-03-27 13:36:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbde3646-e01c-5e6a-a7d5-18ee4d3e116f sending to next pipeline
2026-03-27 13:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fbde3646-e01c-5e6a-a7d5-18ee4d3e116f, identifier: 1987165
2026-03-27 13:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f1a390>
2026-03-27 13:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5d0933-3765-5ddd-97e7-915e3f7acc30/5d5d0933-3765-5ddd-97e7-915e3f7acc30_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252Fdaf4b06326e4448ab21ae36cb83e7e44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/daf4b06326e4448ab21ae36cb83e7e44/images/large/1.jpg saved to cache
2026-03-27 13:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d5d0933-3765-5ddd-97e7-915e3f7acc30
2026-03-27 13:36:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d5d0933-3765-5ddd-97e7-915e3f7acc30, skipping ID generation
2026-03-27 13:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5d0933-3765-5ddd-97e7-915e3f7acc30 with scrape type 1
2026-03-27 13:36:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d5d0933-3765-5ddd-97e7-915e3f7acc30 sending to next pipeline
2026-03-27 13:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5d5d0933-3765-5ddd-97e7-915e3f7acc30, identifier: 1987166
2026-03-27 13:36:38 [ayvens.es] INFO: Found listing with ID: 1987175
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987175%27 HTTP/1.1" 200 None
2026-03-27 13:36:38 [ayvens.es] INFO: Scrape type for 1987175: 1
2026-03-27 13:36:38 [ayvens.es] INFO: Extracting data for car ID: 1987175
2026-03-27 13:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6 with identifier: 1987175
2026-03-27 13:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6 with scrape type 1
2026-03-27 13:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F524%252Fa04a46f97bc142a19bc0c17ba66fd731%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/524/a04a46f97bc142a19bc0c17ba66fd731/images/large/1.jpg not downloaded yet
2026-03-27 13:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5406a190-41a7-5b78-b82c-912928bfbfe4 with identifier: 1987161
2026-03-27 13:36:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5406a190-41a7-5b78-b82c-912928bfbfe4 with identifier: 1987161
2026-03-27 13:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5406a190-41a7-5b78-b82c-912928bfbfe4 with identifier: 1987161 to the API
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/629/b4ac476d68d04a8898cc61fe4f59dbee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Firenze red metallic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5406a190-41a7-5b78-b82c-912928bfbfe4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 85496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5406a190-41a7-5b78-b82c-912928bfbfe4/5406a190-41a7-5b78-b82c-912928bfbfe4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/629/b4ac476d68d04a8898cc61fe4f59dbee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 S AUTO 4WD MHEV',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987161%27 HTTP/1.1" 200 None
2026-03-27 13:36:38 [ayvens.es] INFO: Saving data for 1987161: {'created_time': 1774618598.826076, 'last_price_update_time': 1774618598.82609, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987161') HTTP/1.1" 204 0
2026-03-27 13:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7711abc1-4968-5e24-8a2f-7952310a1e68 with identifier: 1987163
2026-03-27 13:36:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7711abc1-4968-5e24-8a2f-7952310a1e68 with identifier: 1987163
2026-03-27 13:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7711abc1-4968-5e24-8a2f-7952310a1e68 with identifier: 1987163 to the API
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/423/778b075424e24c46a32b6c62ab04c051/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Azul oasis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7711abc1-4968-5e24-8a2f-7952310a1e68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 253029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7711abc1-4968-5e24-8a2f-7952310a1e68/7711abc1-4968-5e24-8a2f-7952310a1e68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/423/778b075424e24c46a32b6c62ab04c051/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Active Auto',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Active Auto',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987163%27 HTTP/1.1" 200 None
2026-03-27 13:36:39 [ayvens.es] INFO: Saving data for 1987163: {'created_time': 1774618599.32323, 'last_price_update_time': 1774618599.32324, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987163') HTTP/1.1" 204 0
2026-03-27 13:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: af559950-393f-5544-8d5c-6c7a90efc733 with identifier: 1987162
2026-03-27 13:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: af559950-393f-5544-8d5c-6c7a90efc733 with identifier: 1987162
2026-03-27 13:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: af559950-393f-5544-8d5c-6c7a90efc733 with identifier: 1987162 to the API
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/231/6fe7527791e54596b09005c61818aab7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'af559950-393f-5544-8d5c-6c7a90efc733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 135542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af559950-393f-5544-8d5c-6c7a90efc733/af559950-393f-5544-8d5c-6c7a90efc733_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/231/6fe7527791e54596b09005c61818aab7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive16d',
 'transmission': 'manual',
 'trim': 'sDrive16d',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987162%27 HTTP/1.1" 200 None
2026-03-27 13:36:39 [ayvens.es] INFO: Saving data for 1987162: {'created_time': 1774618599.683584, 'last_price_update_time': 1774618599.683594, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987162') HTTP/1.1" 204 0
2026-03-27 13:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fbde3646-e01c-5e6a-a7d5-18ee4d3e116f with identifier: 1987165
2026-03-27 13:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fbde3646-e01c-5e6a-a7d5-18ee4d3e116f with identifier: 1987165
2026-03-27 13:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fbde3646-e01c-5e6a-a7d5-18ee4d3e116f with identifier: 1987165 to the API
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/496/41a6bfea9b7c480e94652d39152928a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fbde3646-e01c-5e6a-a7d5-18ee4d3e116f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 218414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde3646-e01c-5e6a-a7d5-18ee4d3e116f/fbde3646-e01c-5e6a-a7d5-18ee4d3e116f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/496/41a6bfea9b7c480e94652d39152928a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 Bl dCi 100kW (135CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 Bl dCi 100kW (135CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987165%27 HTTP/1.1" 200 None
2026-03-27 13:36:40 [ayvens.es] INFO: Saving data for 1987165: {'created_time': 1774618600.075282, 'last_price_update_time': 1774618600.075293, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987165') HTTP/1.1" 204 0
2026-03-27 13:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5d5d0933-3765-5ddd-97e7-915e3f7acc30 with identifier: 1987166
2026-03-27 13:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5d5d0933-3765-5ddd-97e7-915e3f7acc30 with identifier: 1987166
2026-03-27 13:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5d5d0933-3765-5ddd-97e7-915e3f7acc30 with identifier: 1987166 to the API
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/706/daf4b06326e4448ab21ae36cb83e7e44/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5d5d0933-3765-5ddd-97e7-915e3f7acc30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 125446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5d0933-3765-5ddd-97e7-915e3f7acc30/5d5d0933-3765-5ddd-97e7-915e3f7acc30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/706/daf4b06326e4448ab21ae36cb83e7e44/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987166%27 HTTP/1.1" 200 None
2026-03-27 13:36:40 [ayvens.es] INFO: Saving data for 1987166: {'created_time': 1774618600.449658, 'last_price_update_time': 1774618600.449668, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987166') HTTP/1.1" 204 0
2026-03-27 13:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/019/e5f29366b0f24a8db65a737ea7e7b46f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/918/171a8d1a76a740c3bf9fed036682e4e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:40 [ayvens.es] INFO: Found listing with ID: 1987176
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987176%27 HTTP/1.1" 200 None
2026-03-27 13:36:40 [ayvens.es] INFO: Scrape type for 1987176: 1
2026-03-27 13:36:40 [ayvens.es] INFO: Extracting data for car ID: 1987176
2026-03-27 13:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with identifier: 1987176
2026-03-27 13:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with scrape type 1
2026-03-27 13:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252F4d86354a07ee43739e9d13094ea78c69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/4d86354a07ee43739e9d13094ea78c69/images/large/1.jpg not downloaded yet
2026-03-27 13:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bf23d0>
2026-03-27 13:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a04f4b0f-c901-58f4-83c7-c841f1616b84/a04f4b0f-c901-58f4-83c7-c841f1616b84_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252Fc1576a426df94e1d8727d3dc78d8b5fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/c1576a426df94e1d8727d3dc78d8b5fd/images/large/1.jpg saved to cache
2026-03-27 13:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a04f4b0f-c901-58f4-83c7-c841f1616b84
2026-03-27 13:36:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a04f4b0f-c901-58f4-83c7-c841f1616b84, skipping ID generation
2026-03-27 13:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a04f4b0f-c901-58f4-83c7-c841f1616b84 with scrape type 1
2026-03-27 13:36:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a04f4b0f-c901-58f4-83c7-c841f1616b84 sending to next pipeline
2026-03-27 13:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a04f4b0f-c901-58f4-83c7-c841f1616b84, identifier: 1987168
2026-03-27 13:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f10410>
2026-03-27 13:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10d9aea-3c77-5e88-becb-34b98d1a5aef/e10d9aea-3c77-5e88-becb-34b98d1a5aef_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252Fca1b70dbf61a4e96ae3d4335c2bc12a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/ca1b70dbf61a4e96ae3d4335c2bc12a6/images/large/1.jpg saved to cache
2026-03-27 13:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e10d9aea-3c77-5e88-becb-34b98d1a5aef
2026-03-27 13:36:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e10d9aea-3c77-5e88-becb-34b98d1a5aef, skipping ID generation
2026-03-27 13:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e10d9aea-3c77-5e88-becb-34b98d1a5aef with scrape type 1
2026-03-27 13:36:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e10d9aea-3c77-5e88-becb-34b98d1a5aef sending to next pipeline
2026-03-27 13:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e10d9aea-3c77-5e88-becb-34b98d1a5aef, identifier: 1987167
2026-03-27 13:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a04f4b0f-c901-58f4-83c7-c841f1616b84 with identifier: 1987168
2026-03-27 13:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a04f4b0f-c901-58f4-83c7-c841f1616b84 with identifier: 1987168
2026-03-27 13:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a04f4b0f-c901-58f4-83c7-c841f1616b84 with identifier: 1987168 to the API
2026-03-27 13:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/810/c1576a426df94e1d8727d3dc78d8b5fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a04f4b0f-c901-58f4-83c7-c841f1616b84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 171166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a04f4b0f-c901-58f4-83c7-c841f1616b84/a04f4b0f-c901-58f4-83c7-c841f1616b84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/810/c1576a426df94e1d8727d3dc78d8b5fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987168%27 HTTP/1.1" 200 None
2026-03-27 13:36:41 [ayvens.es] INFO: Saving data for 1987168: {'created_time': 1774618601.231018, 'last_price_update_time': 1774618601.231031, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987168') HTTP/1.1" 204 0
2026-03-27 13:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e10d9aea-3c77-5e88-becb-34b98d1a5aef with identifier: 1987167
2026-03-27 13:36:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e10d9aea-3c77-5e88-becb-34b98d1a5aef with identifier: 1987167
2026-03-27 13:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e10d9aea-3c77-5e88-becb-34b98d1a5aef with identifier: 1987167 to the API
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/824/ca1b70dbf61a4e96ae3d4335c2bc12a6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e10d9aea-3c77-5e88-becb-34b98d1a5aef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 131610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e10d9aea-3c77-5e88-becb-34b98d1a5aef/e10d9aea-3c77-5e88-becb-34b98d1a5aef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/824/ca1b70dbf61a4e96ae3d4335c2bc12a6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987167%27 HTTP/1.1" 200 None
2026-03-27 13:36:41 [ayvens.es] INFO: Saving data for 1987167: {'created_time': 1774618601.617316, 'last_price_update_time': 1774618601.617327, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987167') HTTP/1.1" 204 0
2026-03-27 13:36:41 [ayvens.es] INFO: Found listing with ID: 1987177
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987177%27 HTTP/1.1" 200 None
2026-03-27 13:36:41 [ayvens.es] INFO: Scrape type for 1987177: 1
2026-03-27 13:36:41 [ayvens.es] INFO: Extracting data for car ID: 1987177
2026-03-27 13:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff585bc6-f345-53a5-b8fe-90866a77408f with identifier: 1987177
2026-03-27 13:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff585bc6-f345-53a5-b8fe-90866a77408f with scrape type 1
2026-03-27 13:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff585bc6-f345-53a5-b8fe-90866a77408f
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F72d62823913a4a80a13a9bc25eb82117%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/72d62823913a4a80a13a9bc25eb82117/images/large/1.jpg not downloaded yet
2026-03-27 13:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295717d50>
2026-03-27 13:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5/bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F019%252Fe5f29366b0f24a8db65a737ea7e7b46f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/019/e5f29366b0f24a8db65a737ea7e7b46f/images/large/1.jpg saved to cache
2026-03-27 13:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5
2026-03-27 13:36:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5, skipping ID generation
2026-03-27 13:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5 with scrape type 1
2026-03-27 13:36:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5 sending to next pipeline
2026-03-27 13:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5, identifier: 1987170
2026-03-27 13:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f28ed0>
2026-03-27 13:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0282b5c-dbb1-513a-8187-da2337459cc3/e0282b5c-dbb1-513a-8187-da2337459cc3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F918%252F171a8d1a76a740c3bf9fed036682e4e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/918/171a8d1a76a740c3bf9fed036682e4e1/images/large/1.jpg saved to cache
2026-03-27 13:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0282b5c-dbb1-513a-8187-da2337459cc3
2026-03-27 13:36:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0282b5c-dbb1-513a-8187-da2337459cc3, skipping ID generation
2026-03-27 13:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0282b5c-dbb1-513a-8187-da2337459cc3 with scrape type 1
2026-03-27 13:36:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0282b5c-dbb1-513a-8187-da2337459cc3 sending to next pipeline
2026-03-27 13:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0282b5c-dbb1-513a-8187-da2337459cc3, identifier: 1987169
2026-03-27 13:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/641/e48cd81e51654d3d97df51909c2ac664/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:42 [ayvens.es] INFO: Found listing with ID: 1987178
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987178%27 HTTP/1.1" 200 None
2026-03-27 13:36:42 [ayvens.es] INFO: Scrape type for 1987178: 1
2026-03-27 13:36:42 [ayvens.es] INFO: Extracting data for car ID: 1987178
2026-03-27 13:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with identifier: 1987178
2026-03-27 13:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with scrape type 1
2026-03-27 13:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F258%252Fcdfbdf0a74e241f282b457f1c1a27b68%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/258/cdfbdf0a74e241f282b457f1c1a27b68/images/large/1.jpg not downloaded yet
2026-03-27 13:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5 with identifier: 1987170
2026-03-27 13:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5 with identifier: 1987170
2026-03-27 13:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5 with identifier: 1987170 to the API
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/019/e5f29366b0f24a8db65a737ea7e7b46f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 134743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5/bd1e4a0f-bab7-5927-9802-cfb77ed0a5d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/019/e5f29366b0f24a8db65a737ea7e7b46f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A1 Sportback Advanced 30 TFSI 85kW (116CV)',
 'transmission': 'manual',
 'trim': 'Sportback Advanced 30 TFSI 85kW (116CV)',
 'vin': None,
 'year': 2019}
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987170%27 HTTP/1.1" 200 None
2026-03-27 13:36:42 [ayvens.es] INFO: Saving data for 1987170: {'created_time': 1774618602.477576, 'last_price_update_time': 1774618602.477587, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987170') HTTP/1.1" 204 0
2026-03-27 13:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0282b5c-dbb1-513a-8187-da2337459cc3 with identifier: 1987169
2026-03-27 13:36:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0282b5c-dbb1-513a-8187-da2337459cc3 with identifier: 1987169
2026-03-27 13:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0282b5c-dbb1-513a-8187-da2337459cc3 with identifier: 1987169 to the API
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/918/171a8d1a76a740c3bf9fed036682e4e1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e0282b5c-dbb1-513a-8187-da2337459cc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 53662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0282b5c-dbb1-513a-8187-da2337459cc3/e0282b5c-dbb1-513a-8187-da2337459cc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/918/171a8d1a76a740c3bf9fed036682e4e1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Intens Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': '(O) Intens Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987169%27 HTTP/1.1" 200 None
2026-03-27 13:36:42 [ayvens.es] INFO: Saving data for 1987169: {'created_time': 1774618602.869658, 'last_price_update_time': 1774618602.869669, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987169') HTTP/1.1" 204 0
2026-03-27 13:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/463/a73fb77a684a4e44a7177c0771f2a8da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:42 [ayvens.es] INFO: Found listing with ID: 1987179
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987179%27 HTTP/1.1" 200 None
2026-03-27 13:36:42 [ayvens.es] INFO: Scrape type for 1987179: 1
2026-03-27 13:36:42 [ayvens.es] INFO: Extracting data for car ID: 1987179
2026-03-27 13:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3090931-9851-5578-a792-179afbece4dc with identifier: 1987179
2026-03-27 13:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3090931-9851-5578-a792-179afbece4dc with scrape type 1
2026-03-27 13:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3090931-9851-5578-a792-179afbece4dc
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F555%252F87ca7d36876c43e9b0888e22c3d80bc0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/555/87ca7d36876c43e9b0888e22c3d80bc0/images/large/1.jpg not downloaded yet
2026-03-27 13:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/007/d1f330e6b0974e8c94f312749dd6625c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/857/cebdb13486514a89a339574c5925cbe9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295753e50>
2026-03-27 13:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b755a55-edba-5dd5-9241-cd9eb854ce78/7b755a55-edba-5dd5-9241-cd9eb854ce78_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F641%252Fe48cd81e51654d3d97df51909c2ac664%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/641/e48cd81e51654d3d97df51909c2ac664/images/large/1.jpg saved to cache
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b755a55-edba-5dd5-9241-cd9eb854ce78
2026-03-27 13:36:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b755a55-edba-5dd5-9241-cd9eb854ce78, skipping ID generation
2026-03-27 13:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b755a55-edba-5dd5-9241-cd9eb854ce78 with scrape type 1
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b755a55-edba-5dd5-9241-cd9eb854ce78 sending to next pipeline
2026-03-27 13:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7b755a55-edba-5dd5-9241-cd9eb854ce78, identifier: 1987172
2026-03-27 13:36:43 [ayvens.es] INFO: Found listing with ID: 1987180
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987180%27 HTTP/1.1" 200 None
2026-03-27 13:36:43 [ayvens.es] INFO: Scrape type for 1987180: 1
2026-03-27 13:36:43 [ayvens.es] INFO: Extracting data for car ID: 1987180
2026-03-27 13:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53a02e9-86c8-5b98-9994-fae7cbe38302 with identifier: 1987180
2026-03-27 13:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53a02e9-86c8-5b98-9994-fae7cbe38302 with scrape type 1
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e53a02e9-86c8-5b98-9994-fae7cbe38302
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F455%252F468cfebfc8ce41a8bd1a45ea97c9ac3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/455/468cfebfc8ce41a8bd1a45ea97c9ac3f/images/large/1.jpg not downloaded yet
2026-03-27 13:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7b755a55-edba-5dd5-9241-cd9eb854ce78 with identifier: 1987172
2026-03-27 13:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7b755a55-edba-5dd5-9241-cd9eb854ce78 with identifier: 1987172
2026-03-27 13:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7b755a55-edba-5dd5-9241-cd9eb854ce78 with identifier: 1987172 to the API
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/641/e48cd81e51654d3d97df51909c2ac664/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b755a55-edba-5dd5-9241-cd9eb854ce78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 142561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b755a55-edba-5dd5-9241-cd9eb854ce78/7b755a55-edba-5dd5-9241-cd9eb854ce78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/641/e48cd81e51654d3d97df51909c2ac664/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987172%27 HTTP/1.1" 200 None
2026-03-27 13:36:43 [ayvens.es] INFO: Saving data for 1987172: {'created_time': 1774618603.616481, 'last_price_update_time': 1774618603.616492, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987172') HTTP/1.1" 204 0
2026-03-27 13:36:43 [ayvens.es] INFO: Found listing with ID: 1987181
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987181%27 HTTP/1.1" 200 None
2026-03-27 13:36:43 [ayvens.es] INFO: Scrape type for 1987181: 1
2026-03-27 13:36:43 [ayvens.es] INFO: Extracting data for car ID: 1987181
2026-03-27 13:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f82a3d-f45f-5818-abab-c152b735de4c with identifier: 1987181
2026-03-27 13:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f82a3d-f45f-5818-abab-c152b735de4c with scrape type 1
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 28f82a3d-f45f-5818-abab-c152b735de4c
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F435%252F320f9ea4df264399bbff9e244124c53f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/435/320f9ea4df264399bbff9e244124c53f/images/large/1.jpg not downloaded yet
2026-03-27 13:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295747e10>
2026-03-27 13:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb40292d-6e75-5cd1-8acd-f7fd5ae781fc/cb40292d-6e75-5cd1-8acd-f7fd5ae781fc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252Fa73fb77a684a4e44a7177c0771f2a8da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/a73fb77a684a4e44a7177c0771f2a8da/images/large/1.jpg saved to cache
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb40292d-6e75-5cd1-8acd-f7fd5ae781fc
2026-03-27 13:36:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb40292d-6e75-5cd1-8acd-f7fd5ae781fc, skipping ID generation
2026-03-27 13:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb40292d-6e75-5cd1-8acd-f7fd5ae781fc with scrape type 1
2026-03-27 13:36:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb40292d-6e75-5cd1-8acd-f7fd5ae781fc sending to next pipeline
2026-03-27 13:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cb40292d-6e75-5cd1-8acd-f7fd5ae781fc, identifier: 1987171
2026-03-27 13:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296008ad0>
2026-03-27 13:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4210624e-eeff-5ed6-8e77-3f7a9218db8d/4210624e-eeff-5ed6-8e77-3f7a9218db8d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F007%252Fd1f330e6b0974e8c94f312749dd6625c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/007/d1f330e6b0974e8c94f312749dd6625c/images/large/1.jpg saved to cache
2026-03-27 13:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4210624e-eeff-5ed6-8e77-3f7a9218db8d
2026-03-27 13:36:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4210624e-eeff-5ed6-8e77-3f7a9218db8d, skipping ID generation
2026-03-27 13:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4210624e-eeff-5ed6-8e77-3f7a9218db8d with scrape type 1
2026-03-27 13:36:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4210624e-eeff-5ed6-8e77-3f7a9218db8d sending to next pipeline
2026-03-27 13:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4210624e-eeff-5ed6-8e77-3f7a9218db8d, identifier: 1987173
2026-03-27 13:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296057d50>
2026-03-27 13:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9302a398-74e5-5568-a2db-546c3123ac80/9302a398-74e5-5568-a2db-546c3123ac80_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Fcebdb13486514a89a339574c5925cbe9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/cebdb13486514a89a339574c5925cbe9/images/large/1.jpg saved to cache
2026-03-27 13:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9302a398-74e5-5568-a2db-546c3123ac80
2026-03-27 13:36:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9302a398-74e5-5568-a2db-546c3123ac80, skipping ID generation
2026-03-27 13:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9302a398-74e5-5568-a2db-546c3123ac80 with scrape type 1
2026-03-27 13:36:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9302a398-74e5-5568-a2db-546c3123ac80 sending to next pipeline
2026-03-27 13:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9302a398-74e5-5568-a2db-546c3123ac80, identifier: 1987174
2026-03-27 13:36:44 [ayvens.es] INFO: Found listing with ID: 1987182
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987182%27 HTTP/1.1" 200 None
2026-03-27 13:36:44 [ayvens.es] INFO: Scrape type for 1987182: 1
2026-03-27 13:36:44 [ayvens.es] INFO: Extracting data for car ID: 1987182
2026-03-27 13:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with identifier: 1987182
2026-03-27 13:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with scrape type 1
2026-03-27 13:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252F11aa7c4263f443ef8cd4143780314dc0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/11aa7c4263f443ef8cd4143780314dc0/images/large/1.jpg not downloaded yet
2026-03-27 13:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cb40292d-6e75-5cd1-8acd-f7fd5ae781fc with identifier: 1987171
2026-03-27 13:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cb40292d-6e75-5cd1-8acd-f7fd5ae781fc with identifier: 1987171
2026-03-27 13:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cb40292d-6e75-5cd1-8acd-f7fd5ae781fc with identifier: 1987171 to the API
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/463/a73fb77a684a4e44a7177c0771f2a8da/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cb40292d-6e75-5cd1-8acd-f7fd5ae781fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 79594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb40292d-6e75-5cd1-8acd-f7fd5ae781fc/cb40292d-6e75-5cd1-8acd-f7fd5ae781fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/463/a73fb77a684a4e44a7177c0771f2a8da/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Equilibre Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987171%27 HTTP/1.1" 200 None
2026-03-27 13:36:44 [ayvens.es] INFO: Saving data for 1987171: {'created_time': 1774618604.677778, 'last_price_update_time': 1774618604.677788, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987171') HTTP/1.1" 204 0
2026-03-27 13:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4210624e-eeff-5ed6-8e77-3f7a9218db8d with identifier: 1987173
2026-03-27 13:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4210624e-eeff-5ed6-8e77-3f7a9218db8d with identifier: 1987173
2026-03-27 13:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4210624e-eeff-5ed6-8e77-3f7a9218db8d with identifier: 1987173 to the API
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/007/d1f330e6b0974e8c94f312749dd6625c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '4210624e-eeff-5ed6-8e77-3f7a9218db8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 13260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4210624e-eeff-5ed6-8e77-3f7a9218db8d/4210624e-eeff-5ed6-8e77-3f7a9218db8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/007/d1f330e6b0974e8c94f312749dd6625c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987173%27 HTTP/1.1" 200 None
2026-03-27 13:36:45 [ayvens.es] INFO: Saving data for 1987173: {'created_time': 1774618605.062245, 'last_price_update_time': 1774618605.062255, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987173') HTTP/1.1" 204 0
2026-03-27 13:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9302a398-74e5-5568-a2db-546c3123ac80 with identifier: 1987174
2026-03-27 13:36:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9302a398-74e5-5568-a2db-546c3123ac80 with identifier: 1987174
2026-03-27 13:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9302a398-74e5-5568-a2db-546c3123ac80 with identifier: 1987174 to the API
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/857/cebdb13486514a89a339574c5925cbe9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco antartico',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9302a398-74e5-5568-a2db-546c3123ac80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 202124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9302a398-74e5-5568-a2db-546c3123ac80/9302a398-74e5-5568-a2db-546c3123ac80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/857/cebdb13486514a89a339574c5925cbe9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 CDTi Design & Tech',
 'transmission': 'manual',
 'trim': '1.5 CDTi Design & Tech',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987174%27 HTTP/1.1" 200 None
2026-03-27 13:36:45 [ayvens.es] INFO: Saving data for 1987174: {'created_time': 1774618605.414655, 'last_price_update_time': 1774618605.414666, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987174') HTTP/1.1" 204 0
2026-03-27 13:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/524/a04a46f97bc142a19bc0c17ba66fd731/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/353/72d62823913a4a80a13a9bc25eb82117/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/316/4d86354a07ee43739e9d13094ea78c69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:45 [ayvens.es] INFO: Found listing with ID: 1987183
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987183%27 HTTP/1.1" 200 None
2026-03-27 13:36:45 [ayvens.es] INFO: Scrape type for 1987183: 1
2026-03-27 13:36:45 [ayvens.es] INFO: Extracting data for car ID: 1987183
2026-03-27 13:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with identifier: 1987183
2026-03-27 13:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with scrape type 1
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F861%252F7c783eee12ba4336978165875779576d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/861/7c783eee12ba4336978165875779576d/images/large/1.jpg not downloaded yet
2026-03-27 13:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/258/cdfbdf0a74e241f282b457f1c1a27b68/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:45 [ayvens.es] INFO: Found listing with ID: 1987184
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987184%27 HTTP/1.1" 200 None
2026-03-27 13:36:45 [ayvens.es] INFO: Scrape type for 1987184: 1
2026-03-27 13:36:45 [ayvens.es] INFO: Extracting data for car ID: 1987184
2026-03-27 13:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e848f52-90f3-5169-93b5-0ad760c23dea with identifier: 1987184
2026-03-27 13:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e848f52-90f3-5169-93b5-0ad760c23dea with scrape type 1
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7e848f52-90f3-5169-93b5-0ad760c23dea
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252Fcb92fb14c52e4b9e809e8e7105598278%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/cb92fb14c52e4b9e809e8e7105598278/images/large/1.jpg not downloaded yet
2026-03-27 13:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/555/87ca7d36876c43e9b0888e22c3d80bc0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:45 [ayvens.es] INFO: Found listing with ID: 1987185
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987185%27 HTTP/1.1" 200 None
2026-03-27 13:36:45 [ayvens.es] INFO: Scrape type for 1987185: 1
2026-03-27 13:36:45 [ayvens.es] INFO: Extracting data for car ID: 1987185
2026-03-27 13:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with identifier: 1987185
2026-03-27 13:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with scrape type 1
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F097445d18b33455dbba54b0b68854bc4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/097445d18b33455dbba54b0b68854bc4/images/large/1.jpg not downloaded yet
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296056b90>
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6/8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F524%252Fa04a46f97bc142a19bc0c17ba66fd731%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/524/a04a46f97bc142a19bc0c17ba66fd731/images/large/1.jpg saved to cache
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6
2026-03-27 13:36:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6, skipping ID generation
2026-03-27 13:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6 with scrape type 1
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6 sending to next pipeline
2026-03-27 13:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6, identifier: 1987175
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529578ce10>
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff585bc6-f345-53a5-b8fe-90866a77408f/ff585bc6-f345-53a5-b8fe-90866a77408f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F72d62823913a4a80a13a9bc25eb82117%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/72d62823913a4a80a13a9bc25eb82117/images/large/1.jpg saved to cache
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff585bc6-f345-53a5-b8fe-90866a77408f
2026-03-27 13:36:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff585bc6-f345-53a5-b8fe-90866a77408f, skipping ID generation
2026-03-27 13:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff585bc6-f345-53a5-b8fe-90866a77408f with scrape type 1
2026-03-27 13:36:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff585bc6-f345-53a5-b8fe-90866a77408f sending to next pipeline
2026-03-27 13:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff585bc6-f345-53a5-b8fe-90866a77408f, identifier: 1987177
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295f10d50>
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6481a1d-4cbf-5930-8bdd-b162c36ff6e3/f6481a1d-4cbf-5930-8bdd-b162c36ff6e3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252F4d86354a07ee43739e9d13094ea78c69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/4d86354a07ee43739e9d13094ea78c69/images/large/1.jpg saved to cache
2026-03-27 13:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3
2026-03-27 13:36:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3, skipping ID generation
2026-03-27 13:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with scrape type 1
2026-03-27 13:36:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 sending to next pipeline
2026-03-27 13:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3, identifier: 1987176
2026-03-27 13:36:46 [ayvens.es] INFO: Found listing with ID: 1987186
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987186%27 HTTP/1.1" 200 None
2026-03-27 13:36:46 [ayvens.es] INFO: Scrape type for 1987186: 1
2026-03-27 13:36:46 [ayvens.es] INFO: Extracting data for car ID: 1987186
2026-03-27 13:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2942e398-94ca-57af-af16-9e114a9cb64e with identifier: 1987186
2026-03-27 13:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2942e398-94ca-57af-af16-9e114a9cb64e with scrape type 1
2026-03-27 13:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2942e398-94ca-57af-af16-9e114a9cb64e
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F260%252F04cce84a187f4feba1fb8d7df6e0c1b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/260/04cce84a187f4feba1fb8d7df6e0c1b7/images/large/1.jpg not downloaded yet
2026-03-27 13:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6 with identifier: 1987175
2026-03-27 13:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6 with identifier: 1987175
2026-03-27 13:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6 with identifier: 1987175 to the API
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/524/a04a46f97bc142a19bc0c17ba66fd731/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 39833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6/8fddaac7-33f6-5dd4-b3a9-bc63c9572bc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/524/a04a46f97bc142a19bc0c17ba66fd731/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987175%27 HTTP/1.1" 200 None
2026-03-27 13:36:46 [ayvens.es] INFO: Saving data for 1987175: {'created_time': 1774618606.567852, 'last_price_update_time': 1774618606.567862, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987175') HTTP/1.1" 204 0
2026-03-27 13:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff585bc6-f345-53a5-b8fe-90866a77408f with identifier: 1987177
2026-03-27 13:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff585bc6-f345-53a5-b8fe-90866a77408f with identifier: 1987177
2026-03-27 13:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ff585bc6-f345-53a5-b8fe-90866a77408f with identifier: 1987177 to the API
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/353/72d62823913a4a80a13a9bc25eb82117/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff585bc6-f345-53a5-b8fe-90866a77408f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 156119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff585bc6-f345-53a5-b8fe-90866a77408f/ff585bc6-f345-53a5-b8fe-90866a77408f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/353/72d62823913a4a80a13a9bc25eb82117/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2018}
2026-03-27 13:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987177%27 HTTP/1.1" 200 None
2026-03-27 13:36:47 [ayvens.es] INFO: Saving data for 1987177: {'created_time': 1774618607.002799, 'last_price_update_time': 1774618607.00281, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987177') HTTP/1.1" 204 0
2026-03-27 13:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with identifier: 1987176
2026-03-27 13:36:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with identifier: 1987176
2026-03-27 13:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with identifier: 1987176 to the API
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/316/4d86354a07ee43739e9d13094ea78c69/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f6481a1d-4cbf-5930-8bdd-b162c36ff6e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 50349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6481a1d-4cbf-5930-8bdd-b162c36ff6e3/f6481a1d-4cbf-5930-8bdd-b162c36ff6e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/316/4d86354a07ee43739e9d13094ea78c69/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987176%27 HTTP/1.1" 200 None
2026-03-27 13:36:47 [ayvens.es] INFO: Saving data for 1987176: {'created_time': 1774618607.384351, 'last_price_update_time': 1774618607.384364, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987176') HTTP/1.1" 204 0
2026-03-27 13:36:47 [ayvens.es] INFO: Found listing with ID: 1987187
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987187%27 HTTP/1.1" 200 None
2026-03-27 13:36:47 [ayvens.es] INFO: Scrape type for 1987187: 1
2026-03-27 13:36:47 [ayvens.es] INFO: Extracting data for car ID: 1987187
2026-03-27 13:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7801a149-0d64-5b78-b165-0a64a47ecc77 with identifier: 1987187
2026-03-27 13:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7801a149-0d64-5b78-b165-0a64a47ecc77 with scrape type 1
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7801a149-0d64-5b78-b165-0a64a47ecc77
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252F7d2066b6e01c461499e0613167b3cafd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/7d2066b6e01c461499e0613167b3cafd/images/large/1.jpg not downloaded yet
2026-03-27 13:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/455/468cfebfc8ce41a8bd1a45ea97c9ac3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52945c2bd0>
2026-03-27 13:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a363f2b-bb22-52e8-a028-fb5fc1a4fdab/2a363f2b-bb22-52e8-a028-fb5fc1a4fdab_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F258%252Fcdfbdf0a74e241f282b457f1c1a27b68%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/258/cdfbdf0a74e241f282b457f1c1a27b68/images/large/1.jpg saved to cache
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab
2026-03-27 13:36:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab, skipping ID generation
2026-03-27 13:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with scrape type 1
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab sending to next pipeline
2026-03-27 13:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab, identifier: 1987178
2026-03-27 13:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295721c10>
2026-03-27 13:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3090931-9851-5578-a792-179afbece4dc/d3090931-9851-5578-a792-179afbece4dc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F555%252F87ca7d36876c43e9b0888e22c3d80bc0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/555/87ca7d36876c43e9b0888e22c3d80bc0/images/large/1.jpg saved to cache
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3090931-9851-5578-a792-179afbece4dc
2026-03-27 13:36:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3090931-9851-5578-a792-179afbece4dc, skipping ID generation
2026-03-27 13:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3090931-9851-5578-a792-179afbece4dc with scrape type 1
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3090931-9851-5578-a792-179afbece4dc sending to next pipeline
2026-03-27 13:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3090931-9851-5578-a792-179afbece4dc, identifier: 1987179
2026-03-27 13:36:47 [ayvens.es] INFO: Found listing with ID: 1987188
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987188%27 HTTP/1.1" 200 None
2026-03-27 13:36:47 [ayvens.es] INFO: Scrape type for 1987188: 1
2026-03-27 13:36:47 [ayvens.es] INFO: Extracting data for car ID: 1987188
2026-03-27 13:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f60679-7eff-50fc-882c-1c1438c72c65 with identifier: 1987188
2026-03-27 13:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f60679-7eff-50fc-882c-1c1438c72c65 with scrape type 1
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 14f60679-7eff-50fc-882c-1c1438c72c65
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252F0c174e26a0584f6687516879801182ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/0c174e26a0584f6687516879801182ea/images/large/1.jpg not downloaded yet
2026-03-27 13:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with identifier: 1987178
2026-03-27 13:36:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with identifier: 1987178
2026-03-27 13:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with identifier: 1987178 to the API
2026-03-27 13:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/258/cdfbdf0a74e241f282b457f1c1a27b68/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2a363f2b-bb22-52e8-a028-fb5fc1a4fdab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 113409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a363f2b-bb22-52e8-a028-fb5fc1a4fdab/2a363f2b-bb22-52e8-a028-fb5fc1a4fdab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/258/cdfbdf0a74e241f282b457f1c1a27b68/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987178%27 HTTP/1.1" 200 None
2026-03-27 13:36:48 [ayvens.es] INFO: Saving data for 1987178: {'created_time': 1774618608.116543, 'last_price_update_time': 1774618608.116554, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987178') HTTP/1.1" 204 0
2026-03-27 13:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3090931-9851-5578-a792-179afbece4dc with identifier: 1987179
2026-03-27 13:36:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3090931-9851-5578-a792-179afbece4dc with identifier: 1987179
2026-03-27 13:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3090931-9851-5578-a792-179afbece4dc with identifier: 1987179 to the API
2026-03-27 13:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/555/87ca7d36876c43e9b0888e22c3d80bc0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3090931-9851-5578-a792-179afbece4dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 260367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3090931-9851-5578-a792-179afbece4dc/d3090931-9851-5578-a792-179afbece4dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/555/87ca7d36876c43e9b0888e22c3d80bc0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Profesional Kombi 2.0 TDI 55kW BMT',
 'transmission': 'manual',
 'trim': 'Profesional Kombi 2.0 TDI 55kW BMT',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987179%27 HTTP/1.1" 200 None
2026-03-27 13:36:49 [ayvens.es] INFO: Saving data for 1987179: {'created_time': 1774618609.074877, 'last_price_update_time': 1774618609.074887, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987179') HTTP/1.1" 204 0
2026-03-27 13:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/435/320f9ea4df264399bbff9e244124c53f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/629/11aa7c4263f443ef8cd4143780314dc0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/861/7c783eee12ba4336978165875779576d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:49 [ayvens.es] INFO: Found listing with ID: 1987189
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987189%27 HTTP/1.1" 200 None
2026-03-27 13:36:49 [ayvens.es] INFO: Scrape type for 1987189: 1
2026-03-27 13:36:49 [ayvens.es] INFO: Extracting data for car ID: 1987189
2026-03-27 13:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5586b617-d741-5a89-a4d6-c082e3fcffed with identifier: 1987189
2026-03-27 13:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5586b617-d741-5a89-a4d6-c082e3fcffed with scrape type 1
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5586b617-d741-5a89-a4d6-c082e3fcffed
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F644%252Ff004194c071a429b97e101cd50bf5f87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/644/f004194c071a429b97e101cd50bf5f87/images/large/1.jpg not downloaded yet
2026-03-27 13:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529632eb10>
2026-03-27 13:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53a02e9-86c8-5b98-9994-fae7cbe38302/e53a02e9-86c8-5b98-9994-fae7cbe38302_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F455%252F468cfebfc8ce41a8bd1a45ea97c9ac3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/455/468cfebfc8ce41a8bd1a45ea97c9ac3f/images/large/1.jpg saved to cache
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e53a02e9-86c8-5b98-9994-fae7cbe38302
2026-03-27 13:36:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e53a02e9-86c8-5b98-9994-fae7cbe38302, skipping ID generation
2026-03-27 13:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53a02e9-86c8-5b98-9994-fae7cbe38302 with scrape type 1
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e53a02e9-86c8-5b98-9994-fae7cbe38302 sending to next pipeline
2026-03-27 13:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e53a02e9-86c8-5b98-9994-fae7cbe38302, identifier: 1987180
2026-03-27 13:36:49 [ayvens.es] INFO: Found listing with ID: 1987190
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987190%27 HTTP/1.1" 200 None
2026-03-27 13:36:49 [ayvens.es] INFO: Scrape type for 1987190: 1
2026-03-27 13:36:49 [ayvens.es] INFO: Extracting data for car ID: 1987190
2026-03-27 13:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c868f7e0-13ed-58dd-8902-30aa2edbe80d with identifier: 1987190
2026-03-27 13:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c868f7e0-13ed-58dd-8902-30aa2edbe80d with scrape type 1
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c868f7e0-13ed-58dd-8902-30aa2edbe80d
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252Ffe1c5eba396b45ffa500bc8e75eac877%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/fe1c5eba396b45ffa500bc8e75eac877/images/large/1.jpg not downloaded yet
2026-03-27 13:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e53a02e9-86c8-5b98-9994-fae7cbe38302 with identifier: 1987180
2026-03-27 13:36:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e53a02e9-86c8-5b98-9994-fae7cbe38302 with identifier: 1987180
2026-03-27 13:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e53a02e9-86c8-5b98-9994-fae7cbe38302 with identifier: 1987180 to the API
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/455/468cfebfc8ce41a8bd1a45ea97c9ac3f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Negro profundo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e53a02e9-86c8-5b98-9994-fae7cbe38302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 105690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a02e9-86c8-5b98-9994-fae7cbe38302/e53a02e9-86c8-5b98-9994-fae7cbe38302_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/455/468cfebfc8ce41a8bd1a45ea97c9ac3f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Advance 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987180%27 HTTP/1.1" 200 None
2026-03-27 13:36:49 [ayvens.es] INFO: Saving data for 1987180: {'created_time': 1774618609.688971, 'last_price_update_time': 1774618609.688981, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987180') HTTP/1.1" 204 0
2026-03-27 13:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/067/cb92fb14c52e4b9e809e8e7105598278/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/463/097445d18b33455dbba54b0b68854bc4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:49 [ayvens.es] INFO: Found listing with ID: 1987191
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987191%27 HTTP/1.1" 200 None
2026-03-27 13:36:49 [ayvens.es] INFO: Scrape type for 1987191: 1
2026-03-27 13:36:49 [ayvens.es] INFO: Extracting data for car ID: 1987191
2026-03-27 13:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5487f55d-85bd-518e-ad3d-06870a462059 with identifier: 1987191
2026-03-27 13:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487f55d-85bd-518e-ad3d-06870a462059 with scrape type 1
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5487f55d-85bd-518e-ad3d-06870a462059
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252Fbdf0554569204d55bde8d72e8ceabb77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/bdf0554569204d55bde8d72e8ceabb77/images/large/1.jpg not downloaded yet
2026-03-27 13:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295ff0290>
2026-03-27 13:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f82a3d-f45f-5818-abab-c152b735de4c/28f82a3d-f45f-5818-abab-c152b735de4c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F435%252F320f9ea4df264399bbff9e244124c53f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/435/320f9ea4df264399bbff9e244124c53f/images/large/1.jpg saved to cache
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28f82a3d-f45f-5818-abab-c152b735de4c
2026-03-27 13:36:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28f82a3d-f45f-5818-abab-c152b735de4c, skipping ID generation
2026-03-27 13:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f82a3d-f45f-5818-abab-c152b735de4c with scrape type 1
2026-03-27 13:36:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28f82a3d-f45f-5818-abab-c152b735de4c sending to next pipeline
2026-03-27 13:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 28f82a3d-f45f-5818-abab-c152b735de4c, identifier: 1987181
2026-03-27 13:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529570d790>
2026-03-27 13:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbf9c12-b252-5132-aafa-3e3fd1f09825/8bbf9c12-b252-5132-aafa-3e3fd1f09825_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252F11aa7c4263f443ef8cd4143780314dc0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/11aa7c4263f443ef8cd4143780314dc0/images/large/1.jpg saved to cache
2026-03-27 13:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825
2026-03-27 13:36:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bbf9c12-b252-5132-aafa-3e3fd1f09825, skipping ID generation
2026-03-27 13:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with scrape type 1
2026-03-27 13:36:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bbf9c12-b252-5132-aafa-3e3fd1f09825 sending to next pipeline
2026-03-27 13:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8bbf9c12-b252-5132-aafa-3e3fd1f09825, identifier: 1987182
2026-03-27 13:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52956e97d0>
2026-03-27 13:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296/e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F861%252F7c783eee12ba4336978165875779576d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/861/7c783eee12ba4336978165875779576d/images/large/1.jpg saved to cache
2026-03-27 13:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296
2026-03-27 13:36:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296, skipping ID generation
2026-03-27 13:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with scrape type 1
2026-03-27 13:36:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 sending to next pipeline
2026-03-27 13:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296, identifier: 1987183
2026-03-27 13:36:50 [ayvens.es] INFO: Found listing with ID: 1987192
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987192%27 HTTP/1.1" 200 None
2026-03-27 13:36:50 [ayvens.es] INFO: Scrape type for 1987192: 1
2026-03-27 13:36:50 [ayvens.es] INFO: Extracting data for car ID: 1987192
2026-03-27 13:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84aa738e-2482-53a4-8d0f-e5663b79db4a with identifier: 1987192
2026-03-27 13:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84aa738e-2482-53a4-8d0f-e5663b79db4a with scrape type 1
2026-03-27 13:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84aa738e-2482-53a4-8d0f-e5663b79db4a
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252F42bf2e0fde03404091570573178e5f1c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/42bf2e0fde03404091570573178e5f1c/images/large/1.jpg not downloaded yet
2026-03-27 13:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 28f82a3d-f45f-5818-abab-c152b735de4c with identifier: 1987181
2026-03-27 13:36:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 28f82a3d-f45f-5818-abab-c152b735de4c with identifier: 1987181
2026-03-27 13:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 28f82a3d-f45f-5818-abab-c152b735de4c with identifier: 1987181 to the API
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/435/320f9ea4df264399bbff9e244124c53f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '28f82a3d-f45f-5818-abab-c152b735de4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 83212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f82a3d-f45f-5818-abab-c152b735de4c/28f82a3d-f45f-5818-abab-c152b735de4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/435/320f9ea4df264399bbff9e244124c53f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.0 TSI 81KW (110 CV) Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW (110 CV) Ambition',
 'vin': None,
 'year': 2023}
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987181%27 HTTP/1.1" 200 None
2026-03-27 13:36:50 [ayvens.es] INFO: Saving data for 1987181: {'created_time': 1774618610.830297, 'last_price_update_time': 1774618610.830312, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987181') HTTP/1.1" 204 0
2026-03-27 13:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with identifier: 1987182
2026-03-27 13:36:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with identifier: 1987182
2026-03-27 13:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8bbf9c12-b252-5132-aafa-3e3fd1f09825 with identifier: 1987182 to the API
2026-03-27 13:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/629/11aa7c4263f443ef8cd4143780314dc0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Plata metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8bbf9c12-b252-5132-aafa-3e3fd1f09825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 128374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbf9c12-b252-5132-aafa-3e3fd1f09825/8bbf9c12-b252-5132-aafa-3e3fd1f09825_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/629/11aa7c4263f443ef8cd4143780314dc0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D AWD Business Plus Auto',
 'transmission': 'manual',
 'trim': '2.0 B4 D AWD Business Plus Auto',
 'vin': None,
 'year': 2019}
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987182%27 HTTP/1.1" 200 None
2026-03-27 13:36:51 [ayvens.es] INFO: Saving data for 1987182: {'created_time': 1774618611.356745, 'last_price_update_time': 1774618611.356755, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987182') HTTP/1.1" 204 0
2026-03-27 13:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with identifier: 1987183
2026-03-27 13:36:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with identifier: 1987183
2026-03-27 13:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with identifier: 1987183 to the API
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/861/7c783eee12ba4336978165875779576d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Azul atlantico metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 205046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296/e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/861/7c783eee12ba4336978165875779576d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Sport 1.6 TDI 85kW (115CV) DSG',
 'transmission': 'manual',
 'trim': 'Sport 1.6 TDI 85kW (115CV) DSG',
 'vin': None,
 'year': 2017}
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987183%27 HTTP/1.1" 200 None
2026-03-27 13:36:51 [ayvens.es] INFO: Saving data for 1987183: {'created_time': 1774618611.76343, 'last_price_update_time': 1774618611.763442, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987183') HTTP/1.1" 204 0
2026-03-27 13:36:51 [ayvens.es] INFO: Found listing with ID: 1987193
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987193%27 HTTP/1.1" 200 None
2026-03-27 13:36:51 [ayvens.es] INFO: Scrape type for 1987193: 1
2026-03-27 13:36:51 [ayvens.es] INFO: Extracting data for car ID: 1987193
2026-03-27 13:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358cecdc-c39f-5175-a713-7ddc9d28db76 with identifier: 1987193
2026-03-27 13:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358cecdc-c39f-5175-a713-7ddc9d28db76 with scrape type 1
2026-03-27 13:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 358cecdc-c39f-5175-a713-7ddc9d28db76
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F897bd6694fc641819e9a1dd4551376d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/897bd6694fc641819e9a1dd4551376d9/images/large/1.jpg not downloaded yet
2026-03-27 13:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bf9e90>
2026-03-27 13:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e848f52-90f3-5169-93b5-0ad760c23dea/7e848f52-90f3-5169-93b5-0ad760c23dea_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252Fcb92fb14c52e4b9e809e8e7105598278%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/cb92fb14c52e4b9e809e8e7105598278/images/large/1.jpg saved to cache
2026-03-27 13:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e848f52-90f3-5169-93b5-0ad760c23dea
2026-03-27 13:36:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e848f52-90f3-5169-93b5-0ad760c23dea, skipping ID generation
2026-03-27 13:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e848f52-90f3-5169-93b5-0ad760c23dea with scrape type 1
2026-03-27 13:36:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e848f52-90f3-5169-93b5-0ad760c23dea sending to next pipeline
2026-03-27 13:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7e848f52-90f3-5169-93b5-0ad760c23dea, identifier: 1987184
2026-03-27 13:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529610cc10>
2026-03-27 13:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fbde2c-2b55-585d-8e4e-2547fa0e81b1/35fbde2c-2b55-585d-8e4e-2547fa0e81b1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F097445d18b33455dbba54b0b68854bc4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/097445d18b33455dbba54b0b68854bc4/images/large/1.jpg saved to cache
2026-03-27 13:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1
2026-03-27 13:36:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1, skipping ID generation
2026-03-27 13:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with scrape type 1
2026-03-27 13:36:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 sending to next pipeline
2026-03-27 13:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1, identifier: 1987185
2026-03-27 13:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/260/04cce84a187f4feba1fb8d7df6e0c1b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:52 [ayvens.es] INFO: Found listing with ID: 1987194
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987194%27 HTTP/1.1" 200 None
2026-03-27 13:36:52 [ayvens.es] INFO: Scrape type for 1987194: 1
2026-03-27 13:36:52 [ayvens.es] INFO: Extracting data for car ID: 1987194
2026-03-27 13:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with identifier: 1987194
2026-03-27 13:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with scrape type 1
2026-03-27 13:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F328%252Fd1fc5ae07adf4e07908a6bbdb5ec225e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/328/d1fc5ae07adf4e07908a6bbdb5ec225e/images/large/1.jpg not downloaded yet
2026-03-27 13:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7e848f52-90f3-5169-93b5-0ad760c23dea with identifier: 1987184
2026-03-27 13:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7e848f52-90f3-5169-93b5-0ad760c23dea with identifier: 1987184
2026-03-27 13:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7e848f52-90f3-5169-93b5-0ad760c23dea with identifier: 1987184 to the API
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/067/cb92fb14c52e4b9e809e8e7105598278/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7e848f52-90f3-5169-93b5-0ad760c23dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 45025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e848f52-90f3-5169-93b5-0ad760c23dea/7e848f52-90f3-5169-93b5-0ad760c23dea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/067/cb92fb14c52e4b9e809e8e7105598278/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 85kW (115CV) Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) Ambition',
 'vin': None,
 'year': 2024}
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987184%27 HTTP/1.1" 200 None
2026-03-27 13:36:52 [ayvens.es] INFO: Saving data for 1987184: {'created_time': 1774618612.53408, 'last_price_update_time': 1774618612.534091, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987184') HTTP/1.1" 204 0
2026-03-27 13:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with identifier: 1987185
2026-03-27 13:36:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with identifier: 1987185
2026-03-27 13:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with identifier: 1987185 to the API
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/463/097445d18b33455dbba54b0b68854bc4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 216,
 'color': 'Gris silicio',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '35fbde2c-2b55-585d-8e4e-2547fa0e81b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOUAREG',
 'odometer': 154642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fbde2c-2b55-585d-8e4e-2547fa0e81b1/35fbde2c-2b55-585d-8e4e-2547fa0e81b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/463/097445d18b33455dbba54b0b68854bc4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOUAREG R-Line 3.0 V6 TDI 210kW Tip 4M',
 'transmission': 'manual',
 'trim': 'R-Line 3.0 V6 TDI 210kW Tip 4M',
 'vin': None,
 'year': 2023}
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987185%27 HTTP/1.1" 200 None
2026-03-27 13:36:52 [ayvens.es] INFO: Saving data for 1987185: {'created_time': 1774618612.865959, 'last_price_update_time': 1774618612.865969, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987185') HTTP/1.1" 204 0
2026-03-27 13:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/029/7d2066b6e01c461499e0613167b3cafd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:52 [ayvens.es] INFO: Found listing with ID: 1987195
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987195%27 HTTP/1.1" 200 None
2026-03-27 13:36:52 [ayvens.es] INFO: Scrape type for 1987195: 1
2026-03-27 13:36:52 [ayvens.es] INFO: Extracting data for car ID: 1987195
2026-03-27 13:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with identifier: 1987195
2026-03-27 13:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with scrape type 1
2026-03-27 13:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252Fb475b88fb08a4f118302d79b7c1df78f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/b475b88fb08a4f118302d79b7c1df78f/images/large/1.jpg not downloaded yet
2026-03-27 13:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52962fbe90>
2026-03-27 13:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2942e398-94ca-57af-af16-9e114a9cb64e/2942e398-94ca-57af-af16-9e114a9cb64e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F260%252F04cce84a187f4feba1fb8d7df6e0c1b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/260/04cce84a187f4feba1fb8d7df6e0c1b7/images/large/1.jpg saved to cache
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2942e398-94ca-57af-af16-9e114a9cb64e
2026-03-27 13:36:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2942e398-94ca-57af-af16-9e114a9cb64e, skipping ID generation
2026-03-27 13:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2942e398-94ca-57af-af16-9e114a9cb64e with scrape type 1
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2942e398-94ca-57af-af16-9e114a9cb64e sending to next pipeline
2026-03-27 13:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2942e398-94ca-57af-af16-9e114a9cb64e, identifier: 1987186
2026-03-27 13:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/336/0c174e26a0584f6687516879801182ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:53 [ayvens.es] INFO: Found listing with ID: 1987196
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987196%27 HTTP/1.1" 200 None
2026-03-27 13:36:53 [ayvens.es] INFO: Scrape type for 1987196: 1
2026-03-27 13:36:53 [ayvens.es] INFO: Extracting data for car ID: 1987196
2026-03-27 13:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc503e9f-481e-5b5b-9752-7f42330407c1 with identifier: 1987196
2026-03-27 13:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc503e9f-481e-5b5b-9752-7f42330407c1 with scrape type 1
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc503e9f-481e-5b5b-9752-7f42330407c1
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F928%252Fcad832903e0f47e6b8fb9c1226a6fc24%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/928/cad832903e0f47e6b8fb9c1226a6fc24/images/large/1.jpg not downloaded yet
2026-03-27 13:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2942e398-94ca-57af-af16-9e114a9cb64e with identifier: 1987186
2026-03-27 13:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2942e398-94ca-57af-af16-9e114a9cb64e with identifier: 1987186
2026-03-27 13:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2942e398-94ca-57af-af16-9e114a9cb64e with identifier: 1987186 to the API
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/260/04cce84a187f4feba1fb8d7df6e0c1b7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '2942e398-94ca-57af-af16-9e114a9cb64e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'AYGO',
 'odometer': 35473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2942e398-94ca-57af-af16-9e114a9cb64e/2942e398-94ca-57af-af16-9e114a9cb64e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/260/04cce84a187f4feba1fb8d7df6e0c1b7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA AYGO 1.0 70 x-play',
 'transmission': 'manual',
 'trim': '1.0 70 x-play',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987186%27 HTTP/1.1" 200 None
2026-03-27 13:36:53 [ayvens.es] INFO: Saving data for 1987186: {'created_time': 1774618613.537427, 'last_price_update_time': 1774618613.537437, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987186') HTTP/1.1" 204 0
2026-03-27 13:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/644/f004194c071a429b97e101cd50bf5f87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/538/fe1c5eba396b45ffa500bc8e75eac877/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:53 [ayvens.es] INFO: Found listing with ID: 1987197
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987197%27 HTTP/1.1" 200 None
2026-03-27 13:36:53 [ayvens.es] INFO: Scrape type for 1987197: 1
2026-03-27 13:36:53 [ayvens.es] INFO: Extracting data for car ID: 1987197
2026-03-27 13:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead18666-8c3c-5229-a9e9-b6a604534dc8 with identifier: 1987197
2026-03-27 13:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead18666-8c3c-5229-a9e9-b6a604534dc8 with scrape type 1
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ead18666-8c3c-5229-a9e9-b6a604534dc8
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F277%252Fa15024798f774222b9e2ae16abdd4165%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/277/a15024798f774222b9e2ae16abdd4165/images/large/1.jpg not downloaded yet
2026-03-27 13:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b1e50>
2026-03-27 13:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7801a149-0d64-5b78-b165-0a64a47ecc77/7801a149-0d64-5b78-b165-0a64a47ecc77_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252F7d2066b6e01c461499e0613167b3cafd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/7d2066b6e01c461499e0613167b3cafd/images/large/1.jpg saved to cache
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7801a149-0d64-5b78-b165-0a64a47ecc77
2026-03-27 13:36:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7801a149-0d64-5b78-b165-0a64a47ecc77, skipping ID generation
2026-03-27 13:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7801a149-0d64-5b78-b165-0a64a47ecc77 with scrape type 1
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7801a149-0d64-5b78-b165-0a64a47ecc77 sending to next pipeline
2026-03-27 13:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7801a149-0d64-5b78-b165-0a64a47ecc77, identifier: 1987187
2026-03-27 13:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295744a90>
2026-03-27 13:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f60679-7eff-50fc-882c-1c1438c72c65/14f60679-7eff-50fc-882c-1c1438c72c65_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252F0c174e26a0584f6687516879801182ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/0c174e26a0584f6687516879801182ea/images/large/1.jpg saved to cache
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14f60679-7eff-50fc-882c-1c1438c72c65
2026-03-27 13:36:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14f60679-7eff-50fc-882c-1c1438c72c65, skipping ID generation
2026-03-27 13:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f60679-7eff-50fc-882c-1c1438c72c65 with scrape type 1
2026-03-27 13:36:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14f60679-7eff-50fc-882c-1c1438c72c65 sending to next pipeline
2026-03-27 13:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 14f60679-7eff-50fc-882c-1c1438c72c65, identifier: 1987188
2026-03-27 13:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/684/bdf0554569204d55bde8d72e8ceabb77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:54 [ayvens.es] INFO: Found listing with ID: 1987198
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987198%27 HTTP/1.1" 200 None
2026-03-27 13:36:54 [ayvens.es] INFO: Scrape type for 1987198: 1
2026-03-27 13:36:54 [ayvens.es] INFO: Extracting data for car ID: 1987198
2026-03-27 13:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891ad3b5-7865-5f9f-b125-66f8d3827625 with identifier: 1987198
2026-03-27 13:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891ad3b5-7865-5f9f-b125-66f8d3827625 with scrape type 1
2026-03-27 13:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 891ad3b5-7865-5f9f-b125-66f8d3827625
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252Feb5b40917f4e4514aff6c20deca23b5b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/eb5b40917f4e4514aff6c20deca23b5b/images/large/1.jpg not downloaded yet
2026-03-27 13:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7801a149-0d64-5b78-b165-0a64a47ecc77 with identifier: 1987187
2026-03-27 13:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7801a149-0d64-5b78-b165-0a64a47ecc77 with identifier: 1987187
2026-03-27 13:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7801a149-0d64-5b78-b165-0a64a47ecc77 with identifier: 1987187 to the API
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/029/7d2066b6e01c461499e0613167b3cafd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '7801a149-0d64-5b78-b165-0a64a47ecc77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 102327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7801a149-0d64-5b78-b165-0a64a47ecc77/7801a149-0d64-5b78-b165-0a64a47ecc77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/029/7d2066b6e01c461499e0613167b3cafd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2022}
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987187%27 HTTP/1.1" 200 None
2026-03-27 13:36:54 [ayvens.es] INFO: Saving data for 1987187: {'created_time': 1774618614.392682, 'last_price_update_time': 1774618614.392692, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987187') HTTP/1.1" 204 0
2026-03-27 13:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 14f60679-7eff-50fc-882c-1c1438c72c65 with identifier: 1987188
2026-03-27 13:36:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 14f60679-7eff-50fc-882c-1c1438c72c65 with identifier: 1987188
2026-03-27 13:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 14f60679-7eff-50fc-882c-1c1438c72c65 with identifier: 1987188 to the API
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/336/0c174e26a0584f6687516879801182ea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Azul orion',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '14f60679-7eff-50fc-882c-1c1438c72c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 124383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f60679-7eff-50fc-882c-1c1438c72c65/14f60679-7eff-50fc-882c-1c1438c72c65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/0c174e26a0584f6687516879801182ea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance Plus',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance Plus',
 'vin': None,
 'year': 2020}
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987188%27 HTTP/1.1" 200 None
2026-03-27 13:36:54 [ayvens.es] INFO: Saving data for 1987188: {'created_time': 1774618614.838626, 'last_price_update_time': 1774618614.838639, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987188') HTTP/1.1" 204 0
2026-03-27 13:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/654/897bd6694fc641819e9a1dd4551376d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:54 [ayvens.es] INFO: Found listing with ID: 1987199
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987199%27 HTTP/1.1" 200 None
2026-03-27 13:36:54 [ayvens.es] INFO: Scrape type for 1987199: 1
2026-03-27 13:36:54 [ayvens.es] INFO: Extracting data for car ID: 1987199
2026-03-27 13:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5923fa3d-36a7-5d75-a2a1-9409ce9cb628 with identifier: 1987199
2026-03-27 13:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5923fa3d-36a7-5d75-a2a1-9409ce9cb628 with scrape type 1
2026-03-27 13:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5923fa3d-36a7-5d75-a2a1-9409ce9cb628
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F158%252F018ec98fdf534af89f6d953942725d73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/158/018ec98fdf534af89f6d953942725d73/images/large/1.jpg not downloaded yet
2026-03-27 13:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529630a750>
2026-03-27 13:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5586b617-d741-5a89-a4d6-c082e3fcffed/5586b617-d741-5a89-a4d6-c082e3fcffed_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F644%252Ff004194c071a429b97e101cd50bf5f87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/644/f004194c071a429b97e101cd50bf5f87/images/large/1.jpg saved to cache
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5586b617-d741-5a89-a4d6-c082e3fcffed
2026-03-27 13:36:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5586b617-d741-5a89-a4d6-c082e3fcffed, skipping ID generation
2026-03-27 13:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5586b617-d741-5a89-a4d6-c082e3fcffed with scrape type 1
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5586b617-d741-5a89-a4d6-c082e3fcffed sending to next pipeline
2026-03-27 13:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5586b617-d741-5a89-a4d6-c082e3fcffed, identifier: 1987189
2026-03-27 13:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296309d50>
2026-03-27 13:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c868f7e0-13ed-58dd-8902-30aa2edbe80d/c868f7e0-13ed-58dd-8902-30aa2edbe80d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252Ffe1c5eba396b45ffa500bc8e75eac877%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/fe1c5eba396b45ffa500bc8e75eac877/images/large/1.jpg saved to cache
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c868f7e0-13ed-58dd-8902-30aa2edbe80d
2026-03-27 13:36:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c868f7e0-13ed-58dd-8902-30aa2edbe80d, skipping ID generation
2026-03-27 13:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c868f7e0-13ed-58dd-8902-30aa2edbe80d with scrape type 1
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c868f7e0-13ed-58dd-8902-30aa2edbe80d sending to next pipeline
2026-03-27 13:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c868f7e0-13ed-58dd-8902-30aa2edbe80d, identifier: 1987190
2026-03-27 13:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529577fe50>
2026-03-27 13:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487f55d-85bd-518e-ad3d-06870a462059/5487f55d-85bd-518e-ad3d-06870a462059_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252Fbdf0554569204d55bde8d72e8ceabb77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/bdf0554569204d55bde8d72e8ceabb77/images/large/1.jpg saved to cache
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5487f55d-85bd-518e-ad3d-06870a462059
2026-03-27 13:36:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5487f55d-85bd-518e-ad3d-06870a462059, skipping ID generation
2026-03-27 13:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487f55d-85bd-518e-ad3d-06870a462059 with scrape type 1
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5487f55d-85bd-518e-ad3d-06870a462059 sending to next pipeline
2026-03-27 13:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5487f55d-85bd-518e-ad3d-06870a462059, identifier: 1987191
2026-03-27 13:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/716/42bf2e0fde03404091570573178e5f1c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:55 [ayvens.es] INFO: Found listing with ID: 1987200
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987200%27 HTTP/1.1" 200 None
2026-03-27 13:36:55 [ayvens.es] INFO: Scrape type for 1987200: 1
2026-03-27 13:36:55 [ayvens.es] INFO: Extracting data for car ID: 1987200
2026-03-27 13:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26afaa03-5e5c-5d1e-8ef2-65340cca4009 with identifier: 1987200
2026-03-27 13:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26afaa03-5e5c-5d1e-8ef2-65340cca4009 with scrape type 1
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26afaa03-5e5c-5d1e-8ef2-65340cca4009
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F617%252F91792f7e3e8e4ef98914575a4596f743%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/617/91792f7e3e8e4ef98914575a4596f743/images/large/1.jpg not downloaded yet
2026-03-27 13:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5586b617-d741-5a89-a4d6-c082e3fcffed with identifier: 1987189
2026-03-27 13:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5586b617-d741-5a89-a4d6-c082e3fcffed with identifier: 1987189
2026-03-27 13:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5586b617-d741-5a89-a4d6-c082e3fcffed with identifier: 1987189 to the API
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/644/f004194c071a429b97e101cd50bf5f87/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris urano',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5586b617-d741-5a89-a4d6-c082e3fcffed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 121924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5586b617-d741-5a89-a4d6-c082e3fcffed/5586b617-d741-5a89-a4d6-c082e3fcffed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/644/f004194c071a429b97e101cd50bf5f87/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 85kW (115CV) Variant',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) Variant',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987189%27 HTTP/1.1" 200 None
2026-03-27 13:36:55 [ayvens.es] INFO: Saving data for 1987189: {'created_time': 1774618615.867411, 'last_price_update_time': 1774618615.867421, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987189') HTTP/1.1" 204 0
2026-03-27 13:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c868f7e0-13ed-58dd-8902-30aa2edbe80d with identifier: 1987190
2026-03-27 13:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c868f7e0-13ed-58dd-8902-30aa2edbe80d with identifier: 1987190
2026-03-27 13:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c868f7e0-13ed-58dd-8902-30aa2edbe80d with identifier: 1987190 to the API
2026-03-27 13:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/538/fe1c5eba396b45ffa500bc8e75eac877/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c868f7e0-13ed-58dd-8902-30aa2edbe80d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 52059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c868f7e0-13ed-58dd-8902-30aa2edbe80d/c868f7e0-13ed-58dd-8902-30aa2edbe80d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/538/fe1c5eba396b45ffa500bc8e75eac877/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Life 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Life 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987190%27 HTTP/1.1" 200 None
2026-03-27 13:36:56 [ayvens.es] INFO: Saving data for 1987190: {'created_time': 1774618616.179454, 'last_price_update_time': 1774618616.179465, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987190') HTTP/1.1" 204 0
2026-03-27 13:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5487f55d-85bd-518e-ad3d-06870a462059 with identifier: 1987191
2026-03-27 13:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5487f55d-85bd-518e-ad3d-06870a462059 with identifier: 1987191
2026-03-27 13:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5487f55d-85bd-518e-ad3d-06870a462059 with identifier: 1987191 to the API
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/684/bdf0554569204d55bde8d72e8ceabb77/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '5487f55d-85bd-518e-ad3d-06870a462059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 61625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487f55d-85bd-518e-ad3d-06870a462059/5487f55d-85bd-518e-ad3d-06870a462059_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/684/bdf0554569204d55bde8d72e8ceabb77/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS Edition 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987191%27 HTTP/1.1" 200 None
2026-03-27 13:36:56 [ayvens.es] INFO: Saving data for 1987191: {'created_time': 1774618616.508008, 'last_price_update_time': 1774618616.508021, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987191') HTTP/1.1" 204 0
2026-03-27 13:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/328/d1fc5ae07adf4e07908a6bbdb5ec225e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:56 [ayvens.es] INFO: Found listing with ID: 1987201
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987201%27 HTTP/1.1" 200 None
2026-03-27 13:36:56 [ayvens.es] INFO: Scrape type for 1987201: 1
2026-03-27 13:36:56 [ayvens.es] INFO: Extracting data for car ID: 1987201
2026-03-27 13:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a with identifier: 1987201
2026-03-27 13:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a with scrape type 1
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F590%252F39c6e46217ea4fb6bd349e5ed13cd485%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/590/39c6e46217ea4fb6bd349e5ed13cd485/images/large/1.jpg not downloaded yet
2026-03-27 13:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295e52c10>
2026-03-27 13:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358cecdc-c39f-5175-a713-7ddc9d28db76/358cecdc-c39f-5175-a713-7ddc9d28db76_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F897bd6694fc641819e9a1dd4551376d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/897bd6694fc641819e9a1dd4551376d9/images/large/1.jpg saved to cache
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 358cecdc-c39f-5175-a713-7ddc9d28db76
2026-03-27 13:36:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 358cecdc-c39f-5175-a713-7ddc9d28db76, skipping ID generation
2026-03-27 13:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358cecdc-c39f-5175-a713-7ddc9d28db76 with scrape type 1
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 358cecdc-c39f-5175-a713-7ddc9d28db76 sending to next pipeline
2026-03-27 13:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 358cecdc-c39f-5175-a713-7ddc9d28db76, identifier: 1987193
2026-03-27 13:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52957ac610>
2026-03-27 13:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84aa738e-2482-53a4-8d0f-e5663b79db4a/84aa738e-2482-53a4-8d0f-e5663b79db4a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252F42bf2e0fde03404091570573178e5f1c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/42bf2e0fde03404091570573178e5f1c/images/large/1.jpg saved to cache
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84aa738e-2482-53a4-8d0f-e5663b79db4a
2026-03-27 13:36:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84aa738e-2482-53a4-8d0f-e5663b79db4a, skipping ID generation
2026-03-27 13:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84aa738e-2482-53a4-8d0f-e5663b79db4a with scrape type 1
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84aa738e-2482-53a4-8d0f-e5663b79db4a sending to next pipeline
2026-03-27 13:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84aa738e-2482-53a4-8d0f-e5663b79db4a, identifier: 1987192
2026-03-27 13:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/746/b475b88fb08a4f118302d79b7c1df78f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:56 [ayvens.es] INFO: Found listing with ID: 1987202
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987202%27 HTTP/1.1" 200 None
2026-03-27 13:36:56 [ayvens.es] INFO: Scrape type for 1987202: 1
2026-03-27 13:36:56 [ayvens.es] INFO: Extracting data for car ID: 1987202
2026-03-27 13:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46c16fd6-e1b2-563e-8f31-c9f2887dcba6 with identifier: 1987202
2026-03-27 13:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c16fd6-e1b2-563e-8f31-c9f2887dcba6 with scrape type 1
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 46c16fd6-e1b2-563e-8f31-c9f2887dcba6
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252Ff9ec3946402c4d6eae30b26a0a68f852%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/f9ec3946402c4d6eae30b26a0a68f852/images/large/1.jpg not downloaded yet
2026-03-27 13:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 358cecdc-c39f-5175-a713-7ddc9d28db76 with identifier: 1987193
2026-03-27 13:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 358cecdc-c39f-5175-a713-7ddc9d28db76 with identifier: 1987193
2026-03-27 13:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 358cecdc-c39f-5175-a713-7ddc9d28db76 with identifier: 1987193 to the API
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/654/897bd6694fc641819e9a1dd4551376d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '358cecdc-c39f-5175-a713-7ddc9d28db76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 72021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358cecdc-c39f-5175-a713-7ddc9d28db76/358cecdc-c39f-5175-a713-7ddc9d28db76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/654/897bd6694fc641819e9a1dd4551376d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC (O) Advance R-Line 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Advance R-Line 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987193%27 HTTP/1.1" 200 None
2026-03-27 13:36:57 [ayvens.es] INFO: Saving data for 1987193: {'created_time': 1774618617.559493, 'last_price_update_time': 1774618617.559504, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987193') HTTP/1.1" 204 0
2026-03-27 13:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84aa738e-2482-53a4-8d0f-e5663b79db4a with identifier: 1987192
2026-03-27 13:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84aa738e-2482-53a4-8d0f-e5663b79db4a with identifier: 1987192
2026-03-27 13:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84aa738e-2482-53a4-8d0f-e5663b79db4a with identifier: 1987192 to the API
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/716/42bf2e0fde03404091570573178e5f1c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '84aa738e-2482-53a4-8d0f-e5663b79db4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 111359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84aa738e-2482-53a4-8d0f-e5663b79db4a/84aa738e-2482-53a4-8d0f-e5663b79db4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/716/42bf2e0fde03404091570573178e5f1c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2017}
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987192%27 HTTP/1.1" 200 None
2026-03-27 13:36:57 [ayvens.es] INFO: Saving data for 1987192: {'created_time': 1774618617.865417, 'last_price_update_time': 1774618617.865427, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987192') HTTP/1.1" 204 0
2026-03-27 13:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/928/cad832903e0f47e6b8fb9c1226a6fc24/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/277/a15024798f774222b9e2ae16abdd4165/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:57 [ayvens.es] INFO: Found listing with ID: 1987203
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987203%27 HTTP/1.1" 200 None
2026-03-27 13:36:57 [ayvens.es] INFO: Scrape type for 1987203: 1
2026-03-27 13:36:57 [ayvens.es] INFO: Extracting data for car ID: 1987203
2026-03-27 13:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8694b73a-5b71-572b-b93e-0ae59082cf16 with identifier: 1987203
2026-03-27 13:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8694b73a-5b71-572b-b93e-0ae59082cf16 with scrape type 1
2026-03-27 13:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8694b73a-5b71-572b-b93e-0ae59082cf16
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252F994be5847d4b44a3901d479865341cfb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-27 13:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/994be5847d4b44a3901d479865341cfb/images/large/1.jpg not downloaded yet
2026-03-27 13:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b0610>
2026-03-27 13:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da8f32a-e1f2-59ca-b1df-811b16a0de96/4da8f32a-e1f2-59ca-b1df-811b16a0de96_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F328%252Fd1fc5ae07adf4e07908a6bbdb5ec225e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/328/d1fc5ae07adf4e07908a6bbdb5ec225e/images/large/1.jpg saved to cache
2026-03-27 13:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96
2026-03-27 13:36:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4da8f32a-e1f2-59ca-b1df-811b16a0de96, skipping ID generation
2026-03-27 13:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with scrape type 1
2026-03-27 13:36:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96 sending to next pipeline
2026-03-27 13:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4da8f32a-e1f2-59ca-b1df-811b16a0de96, identifier: 1987194
2026-03-27 13:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961b3a10>
2026-03-27 13:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f9e6d2-1ae0-5b38-8cde-1c8eca61f576/63f9e6d2-1ae0-5b38-8cde-1c8eca61f576_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252Fb475b88fb08a4f118302d79b7c1df78f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/b475b88fb08a4f118302d79b7c1df78f/images/large/1.jpg saved to cache
2026-03-27 13:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576
2026-03-27 13:36:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576, skipping ID generation
2026-03-27 13:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with scrape type 1
2026-03-27 13:36:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 sending to next pipeline
2026-03-27 13:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576, identifier: 1987195
2026-03-27 13:36:58 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 600
2026-03-27 13:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with identifier: 1987194
2026-03-27 13:36:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with identifier: 1987194
2026-03-27 13:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with identifier: 1987194 to the API
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/328/d1fc5ae07adf4e07908a6bbdb5ec225e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'color': 'Denim blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4da8f32a-e1f2-59ca-b1df-811b16a0de96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 100840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da8f32a-e1f2-59ca-b1df-811b16a0de96/4da8f32a-e1f2-59ca-b1df-811b16a0de96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/328/d1fc5ae07adf4e07908a6bbdb5ec225e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 T8 AWD Recharge Inscription Exp Auto',
 'transmission': 'manual',
 'trim': '2.0 T8 AWD Recharge Inscription Exp Auto',
 'vin': None,
 'year': 2022}
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987194%27 HTTP/1.1" 200 None
2026-03-27 13:36:58 [ayvens.es] INFO: Saving data for 1987194: {'created_time': 1774618618.687792, 'last_price_update_time': 1774618618.687803, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987194') HTTP/1.1" 204 0
2026-03-27 13:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with identifier: 1987195
2026-03-27 13:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with identifier: 1987195
2026-03-27 13:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with identifier: 1987195 to the API
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/746/b475b88fb08a4f118302d79b7c1df78f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '63f9e6d2-1ae0-5b38-8cde-1c8eca61f576',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 120687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f9e6d2-1ae0-5b38-8cde-1c8eca61f576/63f9e6d2-1ae0-5b38-8cde-1c8eca61f576_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/746/b475b88fb08a4f118302d79b7c1df78f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-27 13:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987195%27 HTTP/1.1" 200 None
2026-03-27 13:36:59 [ayvens.es] INFO: Saving data for 1987195: {'created_time': 1774618619.000773, 'last_price_update_time': 1774618619.000783, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987195') HTTP/1.1" 204 0
2026-03-27 13:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/080/eb5b40917f4e4514aff6c20deca23b5b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 13:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961d9850>
2026-03-27 13:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc503e9f-481e-5b5b-9752-7f42330407c1/dc503e9f-481e-5b5b-9752-7f42330407c1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F928%252Fcad832903e0f47e6b8fb9c1226a6fc24%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/928/cad832903e0f47e6b8fb9c1226a6fc24/images/large/1.jpg saved to cache
2026-03-27 13:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc503e9f-481e-5b5b-9752-7f42330407c1
2026-03-27 13:36:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc503e9f-481e-5b5b-9752-7f42330407c1, skipping ID generation
2026-03-27 13:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc503e9f-481e-5b5b-9752-7f42330407c1 with scrape type 1
2026-03-27 13:36:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc503e9f-481e-5b5b-9752-7f42330407c1 sending to next pipeline
2026-03-27 13:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc503e9f-481e-5b5b-9752-7f42330407c1, identifier: 1987196
2026-03-27 13:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52961dbc90>
2026-03-27 13:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead18666-8c3c-5229-a9e9-b6a604534dc8/ead18666-8c3c-5229-a9e9-b6a604534dc8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F277%252Fa15024798f774222b9e2ae16abdd4165%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/277/a15024798f774222b9e2ae16abdd4165/images/large/1.jpg saved to cache
2026-03-27 13:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ead18666-8c3c-5229-a9e9-b6a604534dc8
2026-03-27 13:36:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ead18666-8c3c-5229-a9e9-b6a604534dc8, skipping ID generation
2026-03-27 13:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead18666-8c3c-5229-a9e9-b6a604534dc8 with scrape type 1
2026-03-27 13:36:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ead18666-8c3c-5229-a9e9-b6a604534dc8 sending to next pipeline
2026-03-27 13:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ead18666-8c3c-5229-a9e9-b6a604534dc8, identifier: 1987197
2026-03-27 13:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/158/018ec98fdf534af89f6d953942725d73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc503e9f-481e-5b5b-9752-7f42330407c1 with identifier: 1987196
2026-03-27 13:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc503e9f-481e-5b5b-9752-7f42330407c1 with identifier: 1987196
2026-03-27 13:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc503e9f-481e-5b5b-9752-7f42330407c1 with identifier: 1987196 to the API
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/928/cad832903e0f47e6b8fb9c1226a6fc24/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc503e9f-481e-5b5b-9752-7f42330407c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 97400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc503e9f-481e-5b5b-9752-7f42330407c1/dc503e9f-481e-5b5b-9752-7f42330407c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/928/cad832903e0f47e6b8fb9c1226a6fc24/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Advance 2.0 TDI 110kW (150CV) 4Mot DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) 4Mot DSG',
 'vin': None,
 'year': 2021}
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987196%27 HTTP/1.1" 200 None
2026-03-27 13:36:59 [ayvens.es] INFO: Saving data for 1987196: {'created_time': 1774618619.704449, 'last_price_update_time': 1774618619.70446, 'auction_closing_time': 1774868400.0}
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987196') HTTP/1.1" 204 0
2026-03-27 13:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ead18666-8c3c-5229-a9e9-b6a604534dc8 with identifier: 1987197
2026-03-27 13:36:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ead18666-8c3c-5229-a9e9-b6a604534dc8 with identifier: 1987197
2026-03-27 13:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ead18666-8c3c-5229-a9e9-b6a604534dc8 with identifier: 1987197 to the API
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/277/a15024798f774222b9e2ae16abdd4165/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Gris intenso metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ead18666-8c3c-5229-a9e9-b6a604534dc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO',
 'odometer': 206807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead18666-8c3c-5229-a9e9-b6a604534dc8/ead18666-8c3c-5229-a9e9-b6a604534dc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/277/a15024798f774222b9e2ae16abdd4165/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TAIGO Life 1.0 TSI 81kW (110CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 1.0 TSI 81kW (110CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987197%27 HTTP/1.1" 200 None
2026-03-27 13:37:00 [ayvens.es] INFO: Saving data for 1987197: {'created_time': 1774618620.031094, 'last_price_update_time': 1774618620.031104, 'auction_closing_time': 1774868400.0}
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987197') HTTP/1.1" 204 0
2026-03-27 13:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/617/91792f7e3e8e4ef98914575a4596f743/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5297c2ed50>
2026-03-27 13:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_891ad3b5-7865-5f9f-b125-66f8d3827625/891ad3b5-7865-5f9f-b125-66f8d3827625_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252Feb5b40917f4e4514aff6c20deca23b5b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/eb5b40917f4e4514aff6c20deca23b5b/images/large/1.jpg saved to cache
2026-03-27 13:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 891ad3b5-7865-5f9f-b125-66f8d3827625
2026-03-27 13:37:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 891ad3b5-7865-5f9f-b125-66f8d3827625, skipping ID generation
2026-03-27 13:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891ad3b5-7865-5f9f-b125-66f8d3827625 with scrape type 1
2026-03-27 13:37:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 891ad3b5-7865-5f9f-b125-66f8d3827625 sending to next pipeline
2026-03-27 13:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 891ad3b5-7865-5f9f-b125-66f8d3827625, identifier: 1987198
2026-03-27 13:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52960f52d0>
2026-03-27 13:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5923fa3d-36a7-5d75-a2a1-9409ce9cb628/5923fa3d-36a7-5d75-a2a1-9409ce9cb628_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F158%252F018ec98fdf534af89f6d953942725d73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/158/018ec98fdf534af89f6d953942725d73/images/large/1.jpg saved to cache
2026-03-27 13:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5923fa3d-36a7-5d75-a2a1-9409ce9cb628
2026-03-27 13:37:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5923fa3d-36a7-5d75-a2a1-9409ce9cb628, skipping ID generation
2026-03-27 13:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5923fa3d-36a7-5d75-a2a1-9409ce9cb628 with scrape type 1
2026-03-27 13:37:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5923fa3d-36a7-5d75-a2a1-9409ce9cb628 sending to next pipeline
2026-03-27 13:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5923fa3d-36a7-5d75-a2a1-9409ce9cb628, identifier: 1987199
2026-03-27 13:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/590/39c6e46217ea4fb6bd349e5ed13cd485/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 891ad3b5-7865-5f9f-b125-66f8d3827625 with identifier: 1987198
2026-03-27 13:37:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 891ad3b5-7865-5f9f-b125-66f8d3827625 with identifier: 1987198
2026-03-27 13:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 891ad3b5-7865-5f9f-b125-66f8d3827625 with identifier: 1987198 to the API
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/080/eb5b40917f4e4514aff6c20deca23b5b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '891ad3b5-7865-5f9f-b125-66f8d3827625',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PRIUS+',
 'odometer': 39300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891ad3b5-7865-5f9f-b125-66f8d3827625/891ad3b5-7865-5f9f-b125-66f8d3827625_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/080/eb5b40917f4e4514aff6c20deca23b5b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'TOYOTA PRIUS+ Advance+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': 'Advance+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987198%27 HTTP/1.1" 200 None
2026-03-27 13:37:00 [ayvens.es] INFO: Saving data for 1987198: {'created_time': 1774618620.835006, 'last_price_update_time': 1774618620.835019, 'auction_closing_time': 1774868400.0}
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987198') HTTP/1.1" 204 0
2026-03-27 13:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5923fa3d-36a7-5d75-a2a1-9409ce9cb628 with identifier: 1987199
2026-03-27 13:37:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5923fa3d-36a7-5d75-a2a1-9409ce9cb628 with identifier: 1987199
2026-03-27 13:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5923fa3d-36a7-5d75-a2a1-9409ce9cb628 with identifier: 1987199 to the API
2026-03-27 13:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/158/018ec98fdf534af89f6d953942725d73/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '5923fa3d-36a7-5d75-a2a1-9409ce9cb628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 45920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5923fa3d-36a7-5d75-a2a1-9409ce9cb628/5923fa3d-36a7-5d75-a2a1-9409ce9cb628_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/158/018ec98fdf534af89f6d953942725d73/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2022}
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987199%27 HTTP/1.1" 200 None
2026-03-27 13:37:01 [ayvens.es] INFO: Saving data for 1987199: {'created_time': 1774618621.18936, 'last_price_update_time': 1774618621.189369, 'auction_closing_time': 1774868400.0}
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987199') HTTP/1.1" 204 0
2026-03-27 13:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/940/f9ec3946402c4d6eae30b26a0a68f852/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5296064550>
2026-03-27 13:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26afaa03-5e5c-5d1e-8ef2-65340cca4009/26afaa03-5e5c-5d1e-8ef2-65340cca4009_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F617%252F91792f7e3e8e4ef98914575a4596f743%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/617/91792f7e3e8e4ef98914575a4596f743/images/large/1.jpg saved to cache
2026-03-27 13:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26afaa03-5e5c-5d1e-8ef2-65340cca4009
2026-03-27 13:37:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26afaa03-5e5c-5d1e-8ef2-65340cca4009, skipping ID generation
2026-03-27 13:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26afaa03-5e5c-5d1e-8ef2-65340cca4009 with scrape type 1
2026-03-27 13:37:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26afaa03-5e5c-5d1e-8ef2-65340cca4009 sending to next pipeline
2026-03-27 13:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 26afaa03-5e5c-5d1e-8ef2-65340cca4009, identifier: 1987200
2026-03-27 13:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295bfd3d0>
2026-03-27 13:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a/c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F590%252F39c6e46217ea4fb6bd349e5ed13cd485%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/590/39c6e46217ea4fb6bd349e5ed13cd485/images/large/1.jpg saved to cache
2026-03-27 13:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a
2026-03-27 13:37:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a, skipping ID generation
2026-03-27 13:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a with scrape type 1
2026-03-27 13:37:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a sending to next pipeline
2026-03-27 13:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a, identifier: 1987201
2026-03-27 13:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/376/994be5847d4b44a3901d479865341cfb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-27 13:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 26afaa03-5e5c-5d1e-8ef2-65340cca4009 with identifier: 1987200
2026-03-27 13:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 26afaa03-5e5c-5d1e-8ef2-65340cca4009 with identifier: 1987200
2026-03-27 13:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 26afaa03-5e5c-5d1e-8ef2-65340cca4009 with identifier: 1987200 to the API
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/617/91792f7e3e8e4ef98914575a4596f743/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '26afaa03-5e5c-5d1e-8ef2-65340cca4009',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 28153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26afaa03-5e5c-5d1e-8ef2-65340cca4009/26afaa03-5e5c-5d1e-8ef2-65340cca4009_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/617/91792f7e3e8e4ef98914575a4596f743/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2023}
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987200%27 HTTP/1.1" 200 None
2026-03-27 13:37:01 [ayvens.es] INFO: Saving data for 1987200: {'created_time': 1774618621.961166, 'last_price_update_time': 1774618621.961177, 'auction_closing_time': 1774868400.0}
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987200') HTTP/1.1" 204 0
2026-03-27 13:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a with identifier: 1987201
2026-03-27 13:37:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 13:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-27 13:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a with identifier: 1987201
2026-03-27 13:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a with identifier: 1987201 to the API
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/590/39c6e46217ea4fb6bd349e5ed13cd485/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Azul ori',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 164967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a/c45cf83f-bd0f-57d1-99d5-b8c7fab0af1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/590/39c6e46217ea4fb6bd349e5ed13cd485/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS E-CVT TOU SPORT',
 'vin': None,
 'year': 2023}
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987201%27 HTTP/1.1" 200 None
2026-03-27 13:37:02 [ayvens.es] INFO: Saving data for 1987201: {'created_time': 1774618622.342402, 'last_price_update_time': 1774618622.342416, 'auction_closing_time': 1774868400.0}
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987201') HTTP/1.1" 204 0
2026-03-27 13:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f529619c9d0>
2026-03-27 13:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46c16fd6-e1b2-563e-8f31-c9f2887dcba6/46c16fd6-e1b2-563e-8f31-c9f2887dcba6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252Ff9ec3946402c4d6eae30b26a0a68f852%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/f9ec3946402c4d6eae30b26a0a68f852/images/large/1.jpg saved to cache
2026-03-27 13:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46c16fd6-e1b2-563e-8f31-c9f2887dcba6
2026-03-27 13:37:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46c16fd6-e1b2-563e-8f31-c9f2887dcba6, skipping ID generation
2026-03-27 13:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c16fd6-e1b2-563e-8f31-c9f2887dcba6 with scrape type 1
2026-03-27 13:37:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46c16fd6-e1b2-563e-8f31-c9f2887dcba6 sending to next pipeline
2026-03-27 13:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 46c16fd6-e1b2-563e-8f31-c9f2887dcba6, identifier: 1987202
2026-03-27 13:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 46c16fd6-e1b2-563e-8f31-c9f2887dcba6 with identifier: 1987202
2026-03-27 13:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 46c16fd6-e1b2-563e-8f31-c9f2887dcba6 with identifier: 1987202
2026-03-27 13:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 46c16fd6-e1b2-563e-8f31-c9f2887dcba6 with identifier: 1987202 to the API
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/940/f9ec3946402c4d6eae30b26a0a68f852/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '46c16fd6-e1b2-563e-8f31-c9f2887dcba6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 176911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46c16fd6-e1b2-563e-8f31-c9f2887dcba6/46c16fd6-e1b2-563e-8f31-c9f2887dcba6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/940/f9ec3946402c4d6eae30b26a0a68f852/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2018}
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987202%27 HTTP/1.1" 200 None
2026-03-27 13:37:02 [ayvens.es] INFO: Saving data for 1987202: {'created_time': 1774618622.867664, 'last_price_update_time': 1774618622.867673, 'auction_closing_time': 1774868400.0}
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987202') HTTP/1.1" 204 0
2026-03-27 13:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 13:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5295716610>
2026-03-27 13:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 13:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8694b73a-5b71-572b-b93e-0ae59082cf16/8694b73a-5b71-572b-b93e-0ae59082cf16_image_0.jpg HTTP/1.1" 201 0
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252F994be5847d4b44a3901d479865341cfb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-27 13:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/994be5847d4b44a3901d479865341cfb/images/large/1.jpg saved to cache
2026-03-27 13:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8694b73a-5b71-572b-b93e-0ae59082cf16
2026-03-27 13:37:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8694b73a-5b71-572b-b93e-0ae59082cf16, skipping ID generation
2026-03-27 13:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8694b73a-5b71-572b-b93e-0ae59082cf16 with scrape type 1
2026-03-27 13:37:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8694b73a-5b71-572b-b93e-0ae59082cf16 sending to next pipeline
2026-03-27 13:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8694b73a-5b71-572b-b93e-0ae59082cf16, identifier: 1987203
2026-03-27 13:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8694b73a-5b71-572b-b93e-0ae59082cf16 with identifier: 1987203
2026-03-27 13:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8694b73a-5b71-572b-b93e-0ae59082cf16 with identifier: 1987203
2026-03-27 13:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8694b73a-5b71-572b-b93e-0ae59082cf16 with identifier: 1987203 to the API
2026-03-27 13:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 13:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 13:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/376/994be5847d4b44a3901d479865341cfb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8694b73a-5b71-572b-b93e-0ae59082cf16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41092',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 141398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8694b73a-5b71-572b-b93e-0ae59082cf16/8694b73a-5b71-572b-b93e-0ae59082cf16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/376/994be5847d4b44a3901d479865341cfb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Edition 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-27 13:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271987203%27 HTTP/1.1" 200 None
2026-03-27 13:37:03 [ayvens.es] INFO: Saving data for 1987203: {'created_time': 1774618623.43441, 'last_price_update_time': 1774618623.434423, 'auction_closing_time': 1774868400.0}
2026-03-27 13:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1987203') HTTP/1.1" 204 0
2026-03-27 13:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-27 13:37:03 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 13:37:03 [ayvens.es] INFO: ayvens.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 5, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-27 13:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 13:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20last_price_update_time%20lt%201774186623 HTTP/1.1" 200 None
2026-03-27 13:37:03 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (555 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.es/task_38_2026-03-27T13_30_00.jl
2026-03-27 13:37:03 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 263265,
 'downloader/request_count': 553,
 'downloader/request_method_count/GET': 546,
 'downloader/request_method_count/POST': 7,
 'downloader/response_bytes': 220431934,
 'downloader/response_count': 553,
 'downloader/response_status_count/200': 553,
 'elapsed_time_seconds': 418.675979,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 13, 37, 3, 863903, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 555,
 'log_count/DEBUG': 9817,
 'log_count/INFO': 11257,
 'memusage/max': 185524224,
 'memusage/startup': 149901312,
 'photo_download_count': 545,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 133,
 'playwright/request_count/aborted': 13,
 'playwright/request_count/method/GET': 129,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 5,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 24,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 117,
 'playwright/response_count/method/GET': 115,
 'playwright/response_count/method/POST': 2,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 4,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 11,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 3,
 'request_depth_max': 7,
 'response_received_count': 8,
 'scheduler/dequeued': 553,
 'scheduler/dequeued/memory': 553,
 'scheduler/enqueued': 553,
 'scheduler/enqueued/memory': 553,
 'scrape_type/new': 555,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 7,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 9.214516740292309,
 'scrapy-zyte-api/mean_response_seconds': 9.225498546247502,
 'scrapy-zyte-api/processed': 7,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 7,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 7,
 'scrapy-zyte-api/request_args/httpRequestBody': 7,
 'scrapy-zyte-api/request_args/httpRequestMethod': 7,
 'scrapy-zyte-api/request_args/httpResponseBody': 7,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 7,
 'scrapy-zyte-api/request_args/url': 7,
 'scrapy-zyte-api/status_codes/200': 7,
 'scrapy-zyte-api/success': 7,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 27, 13, 30, 5, 187924, tzinfo=datetime.timezone.utc)}
2026-03-27 13:37:03 [scrapy.core.engine] INFO: Spider closed (finished)